Timeline for import data from csv to mysql - good database structure
Current License: CC BY-SA 3.0
7 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jan 16, 2013 at 14:50 | comment | added | Michal Kaut | At the end, I went the C++ route. It was not that difficult, but it turned out the Poco Data MySQL connector is quite slow, so I ended up dumping the big EST table into a csv file and importing this from a bash script - see this thread. | |
| Jan 8, 2013 at 7:04 | vote | accept | Michal Kaut | ||
| Jan 7, 2013 at 12:40 | history | migrated | from stackoverflow.com (revisions) | ||
| Jan 7, 2013 at 11:05 | comment | added | Michal Kaut | I do not know how to do this with bash, since I would need access to the auto-generated IDs. I am considering C++, using some CSV parser (Boost tokenizer?) and a POCO Data library to access the database - but it will be some work. An alternative could be reading the whole file into a temp. table and then use SQL commands to create the two tables - but I do not have enough SQL skill to do this, or even to estimate how difficult it is :-( | |
| Jan 7, 2013 at 10:27 | comment | added | Adder | I can't really give an unbiased answer to this, since I mostly do php on a webserver and use PDO database layer there. You can probably use bash and awk to import the data. Or you could write a small C program that accesses the mysql database. I don't know what tools you are good at .. | |
| Jan 7, 2013 at 10:18 | comment | added | Michal Kaut | Thanks, this sounds like a good structure. The question now is, how do I get this from the CSV files to the mysql? | |
| Jan 7, 2013 at 9:57 | history | answered | Adder | CC BY-SA 3.0 |