2

While loading different csv files to different tables of the same database using innodb storage engine(even tested on aria), csv files seems not to be loaded concurrently. Because, a single csv loading to a table is taking x minutes, so i am assuming that loading 3 different csv files to 3 different table should take almost the same(if they are being loaded concurrently), rather it takes 3x minutes in total. Is there any configuration metrics that I am missing to enable concurrent loading to different tables or is it not supported?

NB: I am loading 3 csv into 3 different tables from 3 different connection to mariadb.

  • Can you detail what method(s) are you using to load those csv files? – Jesus Uzcanga Oct 10 '19 at 14:39
  • I am using the load command from mysql cli: LOAD DATA LOCAL INFILE '/foo.csv' INTO TABLE bar FIELDS TERMINATED BY ',' LINES TERMINATED BY '\n' – mghh Oct 13 '19 at 4:13
  • and I have experienced the same timing in case of using 3 different db for 3 different tables, what are the hardware constraints i need to consider if there's any? – mghh Oct 13 '19 at 4:38
  • Thank you for explaining that you are using LOAD DATA INFILE. Can you detail what process are you using to call that LOAD DATA.... statements? Are you using bash scripts? I don't understand the process of how you are loading into 3 tables from 3 different connections. – Jesus Uzcanga Oct 15 '19 at 14:26
  • 1
    Sounds like the disk bandwidth is saturated. – Rick James Oct 20 '19 at 16:06

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.