I've got 125 csv files to upload into a database. The files are typically ~200K rows and 30 columns.

In order to make the data more relational I was going to column map during LOAD DATA INFILE process (specific columns into specific tables) via bash script. But now I'm wondering if it makes more sense to LOAD all the files and use INSERT SELECT INTO to do my ETL'ing.

Any recommendations?

1 Answer 1


Since you have CSV files, it makes a lot more sense to use LOAD DATA. Put them into 125 tables. After that, you can do the massaging that you suggest doing with bash.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.