I have a table with aprox. 22 Bn rows, for each month I have made one partition that and each partition has two data files. I created the columnstore index on this table and the performance improvement is really fantastic. However I'm getting each day around 30-50 Mio new rows that I have to load as fast as possible and make available for the users. I have seen recommendations to make for each day on partition and do partition swapping. This would result for the data I have at the moment in 4380 partitions. Even thinking of the scripts to create this makes me wonder if this is really a smart approach.
What would be best practice in such a situation ? Does disabling and rebuilding the columnstore index only rebuilt for the added 30 - 50 mio rows, or over the whole 22 Bn rows ?
The time frame I have to add these daily new rows is around 30-45 min max.