Currently, I'm comparing two data sets, that contain unique
The 1st data set has the unique
StoreKey/ProductKey combinations for sales between begin January 2012 and end May 2014 (result = 450K lines). The 2nd data set has the unique
StoreKey/ProductKey combinations, for sales begin June 2014, until today (result = 190K lines).
I'm looking to find the
StoreKey/ProductKey combinations that are in the 2nd set, but not in the 1st set - i.e. new products sold from the beginning of June.
Up until now, I've dumped the two data sets into temp tables, created indexes for both tables on both keys, and used the
EXCEPT statement to find unique items.
What is the most efficient way of comparing such large data sets? Is there a more efficient way of doing this type of large comparison?