I'm not sure if that is the correct term "Compact Insert Statement" It is just what I have always heard it referred to. It goes as follows:
INSERT INTO [tblUsers] ([username], [password]) VALUES ('user1', 'pass1'), ('user2', 'pass2')
Anyway We have a table of just over 5M rows, and are about to import some data, BUT the probability is high that about 75% of the data is duplicated (we buy data from multiple sources, but they share around 30-40% with each of our sources :/).
If I do a unique constraint on the column, the entire insert fails from that point forward (unless wrapped in a transaction, of course).
I am just at a loss for how to do this efficiently and with code that can be reused going forward.