0
votes
0answers
228 views

CSV File Into MYSQL Merging - LOAD DATA on Duplicate Key?

Hey Dba Stack Exchange, My question to you is with regards to mysql. Right now I have a medium to small sized csv with 25k lines I need imported into mysql for a client. Problem is, their is only ...
4
votes
2answers
649 views

Index before or after bulk load using load infile?

I have a database with over 1B rows and two columns that are indexed (in addition to the PK). Is it better to have the index pre-defined in the table before the load infile or better to index after ...
1
vote
1answer
444 views

bulk insert from file

I am often requested to upload data from file (let's say csv) into a Sql Server 2008 db. I would like to use BULK INSERT, but I have no access to the db server file system. Questions is there a ...
9
votes
1answer
1k views

Best way to re-import large amount of data with minimal downtime

I need to import about 500,000 records containing IP lookup (read-only reference) data about once a week (only three int/bigint cols). I don't really want to worry about merging the data with the ...
9
votes
3answers
8k views

Why is 'LOAD DATA INFILE' faster than normal INSERT statements?

I've read an article that mentioned we can achieve 60,000 inserts per second by LOAD DATA IN FILE statement that read from csv files and insert it into database. Why should it differ from normal ...
1
vote
1answer
287 views

Importing large file while keeping table available for other operations

We need to import millions of rows in a quite big table. Say like 5 million rows into a table with more than 1 billion rows. After preprocessing the import file we will have update operations and ...
6
votes
3answers
701 views

Suggestion for Bulk Data Import

We are working on a project which requires import data from Excel spreadsheet on daily basis. The data will be import from pre-define template and what we're thinking, first we will upload data in ...