I have an application that has generating data for the past 15 years. Currently, no retention period is configured so the data size grows day by day. I would like to add a retention period to the data so that we can avoid unnecessary memory & performance overhead.
I was exploring how can I determine the best suitable retention period based on the data usage, but couldn't find anything. Some ideas I had in mind:
*Understand query patterns. *Add application logs for data accessibility.
Wondering if there are any already solved solutions to this problem?