0

I am loading data from csv file to my sql table through SSIS. Is there any default limit specified on number of records to be read from csv file ?

While loading the csv file, my data flow component is processing only 5000 records, though it contains 5341 records,as shown in the image below.How can i fix this ?

enter image description here

Improve this question

1 Answer 1

Reset to default
1

The source file shows only 5000 coming through from the first step.

This means all of the data in the file got imported and there was a bad delimiter making some of the data get merged in the import or you have error notification / truncation notification turned off and the data was truncated due to destination or transformation constraints.

You could also have configured data rows to skip on accident or there are actually only 5000 rows of data. I'd start by examining the data, then looking into the logs. Make sure SSIS logging is enabled and look to the logs for more information. I would also add a count step between each of the steps and store them into a table for tracking so I can verify the amount of rows coming through each way.

Improve this answer
1
  • agreed. Bad delimiter or improper text qualification. If you have commas in text values, I'd suggest changing the delimiter to '|' (pipe).
    – SQLDevDBA
    Dec 20, 2016 at 14:35

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.