Database Administrators Stack Exchange is a question and answer site for database professionals who wish to improve their database skills and learn from others in the community. It only takes a minute to sign up.
Sign up to join this community
I've got 125 csv files to upload into a database. The files are typically ~200K rows and 30 columns.
In order to make the data more relational I was going to column map during LOAD DATA INFILE process (specific columns into specific tables) via bash script. But now I'm wondering if it makes more sense to LOAD all the files and use INSERT SELECT INTO to do my ETL'ing.
Any recommendations?
Since you have CSV files, it makes a lot more sense to use LOAD DATA. Put them into 125 tables. After that, you can do the massaging that you suggest doing with bash.
