0

I am loading data from csv file to my sql table through SSIS. Is there any default limit specified on number of records to be read from csv file ?

While loading the csv file, my data flow component is processing only 5000 records, though it contains 5341 records,as shown in the image below.How can i fix this ?

enter image description here

1

The source file shows only 5000 coming through from the first step.

This means all of the data in the file got imported and there was a bad delimiter making some of the data get merged in the import or you have error notification / truncation notification turned off and the data was truncated due to destination or transformation constraints.

You could also have configured data rows to skip on accident or there are actually only 5000 rows of data. I'd start by examining the data, then looking into the logs. Make sure SSIS logging is enabled and look to the logs for more information. I would also add a count step between each of the steps and store them into a table for tracking so I can verify the amount of rows coming through each way.

  • agreed. Bad delimiter or improper text qualification. If you have commas in text values, I'd suggest changing the delimiter to '|' (pipe). – MguerraTorres Dec 20 '16 at 14:35

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.