Questions tagged [import]

The import of data is the automated or semi-automated input of data sets between different software applications.

Filter by
Sorted by
Tagged with
3
votes
1answer
1k views

VLDB with large quantity of data file imports

I am a little out of my league with this scenario and hope this community can help get me on the right direction. I have recently been tasked with re-designing and implementing a database application ...
22
votes
3answers
32k views

Why is 'LOAD DATA INFILE' faster than normal INSERT statements?

I've read an article that mentioned we can achieve 60,000 inserts per second by using the LOAD DATA IN FILE statement, that reads from csv files and inserts the data into a database. Why should it ...
4
votes
1answer
2k views

Why would the size of MySQL MyISAM table indexes (aka MYI file) not match after mysqldump import?

I've been archiving some MySQL (version 5.0.96) MyISAM tables locally and deleting from my server after checking the data. Every time the process has been pretty similar and comes off mostly without a ...
3
votes
2answers
5k views

Loading data in mysql using LOAD DATA INFILE, replication safe?

I am trying to load data into mysql database form CSV file. I found that we could use LOAD DATA INFILE command to do it. But as per the mysql documentation it is not replication safe. (See here) Is ...
218
votes
14answers
183k views

How can I monitor the progress of an import of a large .sql file?

I am importing a 7 GB foobar.sql to restore a table in a local database. $ mysql -h localhost -u root 'my_data' < foobar.sql $ mysql --version /usr/local/mysql/bin/mysql Ver 14.12 Distrib 5.0....
5
votes
1answer
12k views

Update oracle sql database from CSV

I tried google at first but no luck. Is it possible to update tables from csv file? I am using SQL developer and I am using a script to export edited rows to a csv file. I would like to update the ...
2
votes
2answers
1k views

MySQL export user with semi-colon “;” on the end

I am trying to set up automatic export of user accounts from one server to import into another. I am running the following command; $ mysql -u root -p -B -s -e "show grants for 'myuser'@'localhost';" ...
2
votes
1answer
3k views

Import data from one Database to another script

As part of a data migration I would like to script a data transfer from the existing to a new database. I used to do this with DTS on older versions of MS SQL. I am currently using SQL 2012. Note the ...
30
votes
7answers
187k views

Import a Oracle DMP file into a Fresh install of oracle

A client sent us an Oracle database we need to test against. We don't use Oracle or have any in-house Oracle expertise. We need to setup the database so we can connect to it and debug a problem. I ...
10
votes
3answers
7k views

InnoDB import performance

I'm struggling with bulk importing a quite big InnoDB-Table consisting of roughly 10 Million rows (or 7GB) (which for me is the biggest table I've worked with so far). I did some research how to ...
13
votes
2answers
63k views

Importing schema to new or different tablespace

Is there a convenient way to import a schema into Oracle 11gR2 using a single new or different tablespace than where the data originated? As an example, I have exported BLOG_DATA from OLDDB, where ...
2
votes
3answers
15k views

Easiest way to import access db (.accdb) into SQL Server 2016?

I have a .accfb file from an access 2016 database and am trying to import this database into a SQL Server 2016 developer edition instance. While I found posts online discussing using import/export ...
1
vote
3answers
19k views

How to import Sybase .db file into SQL Server database?

I've been given a Sybase .db file by a client and I need to import that into a new SQL Server database so that I may see the data as well as the tables and their relationships, any ideas on how that ...
1
vote
1answer
3k views

PostgreSQL \COPY fails “ERROR: missing data for column ”column name2“”

We are importing bulk data i.e millions of records. We observed that due to a null value for a column , the import is getting failed. Is there a way we could skip the import error when a record is ...
5
votes
1answer
9k views

MySQL settings useful to speed up a mysqldump import

Recently I had to import a 7 Gb MySQL dump file to a MySQL 5.6 server. The import took around 7 hours on a mono-core CPU with 1 Gb of RAM. Someone else tested the import on a MySQL server which has, ...
42
votes
1answer
21k views

Why is a .bacpac file so small compared to a .bak file of the same database?

I've been doing backups of my SQL Server 2014 Express databases for import to other servers and noticed a difference in file size between .bacpac and .bak. Why is a .bacpac file so small compared to ...
9
votes
1answer
32k views

Dump of a mysql table on import replaced existing records

I took a dump using mysqldump.. mysqldump -u... -p... mydb t1 > mydb_table.sql Then I imported the dump in another database having same table, but different records.. mysql -u...-p... mydb < ...
3
votes
1answer
776 views

T-SQL: CSV->table pipeline with custom parsed numeric data, lookup values

Problem Wish to insert thousands of records into a table [Child] from a CSV file (and do this from tens of files into the same table). However, I want to A. substitute a lookup value into the table (...
9
votes
1answer
27k views

How can I import the contents of an Oracle database into Visio to create an Entity Relationship Diagram?

I have an Oracle database, and I would like to create an ERD in Visio 2007 Pro. I have so far looked at DBMS_METADATA.GET_DDL commands to generate DDL. I know that I can import an Access DB into ...
2
votes
1answer
559 views

In SQL Server, are there any other options of data Import and Export

I've been working with SQL Server since SQL Server 7. So I know about BCP, Bulk insert, openrowset and SSIS. My question is a simple one: Do you know of any other ways to Import/Export data using ...
6
votes
2answers
5k views

Index before or after bulk load using load infile?

I have a database with over 1B rows and two columns that are indexed (in addition to the PK). Is it better to have the index pre-defined in the table before the load infile or better to index after ...
3
votes
2answers
20k views

PostgreSQL not working, pgAdmin always says server not listening

I am brand new at this so maybe it's a simple mistake. I was given a very large .sql file with the instructions to make a copy of a database locally on a computer. I was told "to be able to install ...
2
votes
1answer
2k views

Import XML data while creating IDs with relationships

I need to parse XML from a file into tables while retaining their relationships through custom-generated ID values. For example, if I had the following XML: <root> <construction> ...
6
votes
2answers
3k views

Importing LARGE quantity of data into a PostgreSQL database

I am importing a large amount of data into a PostgreSQL server (across multiple databases on the server). When I last attempted to import the data, it effectively "crashed" my machine (Ubuntu 10.0.4),...
6
votes
1answer
3k views

MySQL Import CSV with Multiple Field Separators

I'm trying to import this CSV file into MySQL that appears to be optionally enclosed by more than one character. Unfortunately, MySQL only supports one character as a field separator. I am stuck ...
6
votes
4answers
5k views

Exporting/Importing a large MySQL database without mysqldump

I'm attempting to export about 150GB of data from a database with hundreds of tables, and have found mysqldump to be very buggy. After running a simple --all-databases dump succeeds, but the import ...
4
votes
1answer
2k views

Bringing web service data into SQL server

I need to retrieve a data set daily from a hosted Web service. I can retrieve the XML "column names" in an SSIS package. But I need to retrieve all the data in the data set in csv format or bring ...
3
votes
2answers
5k views

Character Conversion Issue Importing From CSV File

After doing a load of CSV files, there are various words that are "written" to the database incorrectly. Some examples: Diã¡ria should be Diária Crã©dito should be Crédito Ligaã§ãµes should be ...
2
votes
2answers
7k views

Restore data from remote server using “.sql” file

I have a ".SQL" file which contains data at a remote server. I could download that file to my local machine and import data in my local DB, but because of network issues, and the size of ".sql" file (...
2
votes
1answer
6k views

MySQL import csv only gets half the lines

I use the following command to read in a csv: LOAD DATA INFILE '/Users/Tyler/Desktop/players_escaped.txt' INTO TABLE players FIELDS TERMINATED BY ',' ENCLOSED BY '^' LINES TERMINATED BY '\n'; The ...
2
votes
2answers
4k views

Importing CSV's into MySQL(5.6) tables leaves date fields as 0000-00-00

During the import from a CSV file created from an MS Access table into a MySQL table it converts all date fields in the csv into 0000-00-00. I use the following Load Data command for the import. ...
1
vote
1answer
55 views

Microsoft SQL Server v13 bulk add users from active directory

I would like to import all users from Active Directory into Security/Users. What I do is the following: Go to Security -> Users Right click Users -> New User... User type: Windows user, click on '......
1
vote
1answer
2k views

Getting error while importing large data through csv

I am new Postgres. I am getting constraint violation errors while importing a large CSV file. I want to disable all of the database constraints temporarily - I do not know how to do this.
0
votes
0answers
381 views

How best to export from Oracle Ent Ed (EE) to Oracle Express Edition (XE)?

I am aware that Oracle Ent Ed (EE) has more functionality than Oracle Express Ed (XE). But I would like to do a FULL export from EE to XE. Is this even possible? The only solution I can assume will ...
10
votes
1answer
3k views

Get minimal logging when loading data into temporary tables

Even after reading The Data Loading Performance Guide , I am still unsure if its necessary to add the TABLOCK table hint to an empty temporary table, defined with a clustered index in order to get ...
7
votes
3answers
10k views

How to extract Procedure, Function, etc. Source Code from an Oracle Export

I have generated an EXPDAT.DMP file of an Oracle database with the command: exp userid=usr/pass@db owner=own rows=n compress=n I then ran the following command to generate a file containing the '...
5
votes
2answers
3k views

Import XML files into SQL Server 2012

Every Friday I have to import a couple (sometimes more than 300) of XML files into 2 tables. The structure of one of the tables, R000000, looks like this: R00000010 | R00000020 | R00000030 | ...
5
votes
2answers
21k views

MySQL Error when importing CSV with empty fields

I have CSV file with exported table, that has rows with fields that do not contain values. Columns are separated using "," and if fields have no values they look like that: ,,,,,, I tried to load data ...
4
votes
3answers
1k views

Import CSV file into Mysql with Multiple Delimiters/Field Separators

I'm trying to import a large csv file into Mysql. Unfortunately, the data within the file is separated both by spaces and tabs. As a result, whenever I load the data into my table, I end up with ...
4
votes
3answers
15k views

Using OPENQUERY to execute a script

I have a SQL Server 2008 instance which I want to use to import data from an Oracle server. I have set up a linked server that works correctly when running simple queries like SELECT * FROM table. ...
4
votes
1answer
4k views

MySql Workbench Data Import .csv

Hi I am trying to use to MySql Workbench Data Import facility to import a .csv file (thousands of records). However it stops importing the first 5 records. After studying the .csv file I could see ...
2
votes
1answer
3k views

Import .frm and .ibd files into a new instance of MySQL

I have the .frm and .ibd files from an old, non-working MySQL server (on Windows). I took out the hard drive and was able to get the data directory copied to my machine. How would I get them into ...
1
vote
0answers
5k views

ERROR: relation “name” does not exist

I am trying to import a postgresql database table sent to me in phpPgAdmin, I am following the instruction from this import database But after doing so, several error appear, I also tried to import ...
1
vote
1answer
9k views

restore database from dmp file

I have a situation: I have a dmp file and a database with old data server crashed and the latest data we have ar in the dmp file! we managed to pull the server back but it has old data! so we need to ...
0
votes
3answers
3k views

How do I determine the appropriate size for my tablespace when importing a .dmp file?

I have a 14g DMP file. How large should I size my tablespace to import it into an Oracle 11g database?