I have 2 databases: Current Database & Archive Database.
I need to import the archive data back into the main database. There are 174,425,460 records that need to be pushed back to the main database.
Currently, I'm running an INSERT INTO, SELECT WHERE NOT EXISTS query in 10,000 row chunks, moving about 100,000 records an hour. Inserts are based on the clustered index column. Indexes aren't fragmented so I figure the page splits are what's taking the majority of the time.
This is going to be a weekend only process as to not affect production customers. It's going to take months to move the data this way! Does anyone have recommendations on speeding this process up?