Questions tagged [import]

The import of data is the automated or semi-automated input of data sets between different software applications.

Filter by
Sorted by
Tagged with
240
votes
14answers
203k views

How can I monitor the progress of an import of a large .sql file?

I am importing a 7 GB foobar.sql to restore a table in a local database. $ mysql -h localhost -u root 'my_data' < foobar.sql $ mysql --version /usr/local/mysql/bin/mysql Ver 14.12 Distrib 5.0....
48
votes
2answers
25k views

Why is a .bacpac file so small compared to a .bak file of the same database?

I've been doing backups of my SQL Server 2014 Express databases for import to other servers and noticed a difference in file size between .bacpac and .bak. Why is a .bacpac file so small compared to ...
45
votes
6answers
287k views

How to import a .sql file in MySQL?

I am trying to import a .sql file using MySQL Workbench and I get this error: ERROR 1046 (3D000) at line 28: No database selected I have first created an empty database called with the same name as ...
40
votes
8answers
212k views

MySQL DB import/export command line in Windows

How to export / import a database in MySQL through the command line? MySQL system configuration, WampServer server installed. OS: Windows The advice for my local host, not an live hosting...
31
votes
7answers
193k views

Import a Oracle DMP file into a Fresh install of oracle

A client sent us an Oracle database we need to test against. We don't use Oracle or have any in-house Oracle expertise. We need to setup the database so we can connect to it and debug a problem. I ...
22
votes
3answers
34k views

Why is 'LOAD DATA INFILE' faster than normal INSERT statements?

I've read an article that mentioned we can achieve 60,000 inserts per second by using the LOAD DATA IN FILE statement, that reads from csv files and inserts the data into a database. Why should it ...
21
votes
4answers
15k views

Why is BULK INSERT Considered Dangerous?

I would like to understand why cyber-security teams in general (more than one organization I've dealt with) is dead set against granting BULK INSERT (e.g. TSQL) rights to applications and database ...
14
votes
3answers
26k views

Create a table from a CSV file with headers

I'm seeking to find a way to generate a new MySQL table solely based on the contents of a specified CSV. The CSV files I'll be using have the following properties; "|" delimited. First row specifies ...
13
votes
2answers
64k views

Importing schema to new or different tablespace

Is there a convenient way to import a schema into Oracle 11gR2 using a single new or different tablespace than where the data originated? As an example, I have exported BLOG_DATA from OLDDB, where ...
11
votes
4answers
34k views

Oracle Import problem caused by different character sets

I'm trying to import an Oracle 11 export into Oracle 11 XE. I get the following messages: import in XE fehlerhaft import done in WE8MSWIN1252 character set and AL16UTF16 NCHAR character set ...
11
votes
1answer
3k views

Best way to re-import large amount of data with minimal downtime

I need to import about 500,000 records containing IP lookup (read-only reference) data about once a week (only three int/bigint cols). I don't really want to worry about merging the data with the ...
10
votes
3answers
7k views

InnoDB import performance

I'm struggling with bulk importing a quite big InnoDB-Table consisting of roughly 10 Million rows (or 7GB) (which for me is the biggest table I've worked with so far). I did some research how to ...
10
votes
1answer
4k views

Get minimal logging when loading data into temporary tables

Even after reading The Data Loading Performance Guide , I am still unsure if its necessary to add the TABLOCK table hint to an empty temporary table, defined with a clustered index in order to get ...
9
votes
1answer
36k views

Dump of a mysql table on import replaced existing records

I took a dump using mysqldump.. mysqldump -u... -p... mydb t1 > mydb_table.sql Then I imported the dump in another database having same table, but different records.. mysql -u...-p... mydb < ...
9
votes
1answer
10k views

Improve speed of index rebuild on SQL server

I'm importing a large amount of data into an empty database, and before I start I disabled all non-unique non-clustered indexes to see if I could improve the performance of the import. Now I want to ...
9
votes
3answers
85k views

How to grant all privileges on all tables in a schema to a user in IBM DB2?

At first place, I want to export database from IBM DB2 AIX into IBM DB2 windows. Unfortunately, I can't use BACKUP and RESTORE command because of difference OS issue. So I have to resort to db2move ...
9
votes
1answer
28k views

How can I import the contents of an Oracle database into Visio to create an Entity Relationship Diagram?

I have an Oracle database, and I would like to create an ERD in Visio 2007 Pro. I have so far looked at DBMS_METADATA.GET_DDL commands to generate DDL. I know that I can import an Access DB into ...
9
votes
2answers
43k views

How to import export.sql in sql developer?

In SQL Developer, from the top menu choose Tools > Data Export. This launches the Data Export wizard. So that is export. It creatres export.sql file. Now how to do import ? I am usgin SqlDeveloper ...
8
votes
3answers
12k views

How to import blanks as nulls instead of zeros while importing txt using wizard

I'm using the Import Wizard to load a text file and need blanks in integer fields to be nulls, but only zeros are inserted. How to import it properly?
8
votes
4answers
970 views

Suggestion for Bulk Data Import

We are working on a project which requires import data from Excel spreadsheet on daily basis. The data will be import from pre-define template and what we're thinking, first we will upload data in ...
8
votes
2answers
4k views

SQL Server avoid repeating the collation type multiple times in a query

I have a query which selects rows from a source database (DatabaseA), and inserts them into a target database (Database B). The collation type differs between the databases and they cannot be changed. ...
8
votes
3answers
13k views

Import in postgres json data in a csv file

I'm trying to import into postgres a csv file containing the data for a table. One of the column of the table has jsonb type. One line of my csv file contains something like 1,{"a":"b"} Suppose the ...
7
votes
4answers
31k views

Import CSV or JSON file into DynamoDB

I have 1000 CSV files. Each CSV file is between 1 and 500 MB and is formatted the same way (i.e. same column order). I have a header file for column headers, which match my DynamoDB table's column ...
7
votes
3answers
11k views

How to extract Procedure, Function, etc. Source Code from an Oracle Export

I have generated an EXPDAT.DMP file of an Oracle database with the command: exp userid=usr/pass@db owner=own rows=n compress=n I then ran the following command to generate a file containing the '...
7
votes
2answers
4k views

Bulk Data Loading and Transaction Log

I'm currently working on a project which bulk import data from flat files (csv) about 18 different files each linking to a specific table through some stored procedure. I followed the steps as ...
7
votes
1answer
11k views

Create index on a Postgres table as fast as possible

I have a large database import (100GB) on a Postgres table without indexes. After the import, I want to create an index for queries as fast as possible. No data is accessed in the table as long as ...
7
votes
3answers
23k views

Import Oracle full dump file to fresh Oracle installation

I am importing a Oracle dump fill created on a AIX Oracle 9.2 installation with a Full Export option to a Windows Oracle 10.2.0.4 on Windows 2008 R2 x64. I want to import the file to a clean ...
7
votes
2answers
52k views

Importing a different character set export dump into another DB instance

I am trying to import a given dump file using oracle imp utility. However; I am facing the following issues. C:\Users\AD>imp DB_USER/*****@dev1 file=C:\test\db42312.dmp log=C:\test\import2.log ...
6
votes
2answers
6k views

Importing large SQL dump with millions of INSERT statements

I need to import a big .sql file (8.1GB when unpacked) into PostgreSQL. I tried to use \i /path/to/file.sql but it is way too slow. How does one speed up the import? I need to import this data weekly....
6
votes
2answers
4k views

Error on import of mysqldump file - Illegal double value found during parsing

I am currently getting the following error while trying to import / restore a mysqldump file: ERROR 1367 (22007) at line 445: Illegal double '1.79769313486232e+308' value found during parsing I ...
6
votes
2answers
5k views

Index before or after bulk load using load infile?

I have a database with over 1B rows and two columns that are indexed (in addition to the PK). Is it better to have the index pre-defined in the table before the load infile or better to index after ...
6
votes
1answer
12k views

MySQL settings useful to speed up a mysqldump import

Recently I had to import a 7 Gb MySQL dump file to a MySQL 5.6 server. The import took around 7 hours on a mono-core CPU with 1 Gb of RAM. Someone else tested the import on a MySQL server which has, ...
6
votes
4answers
2k views

Mysql (percona-server 5.5) completely stalls during import (myloader)

While configuring our new servers (IBM X3650M4, 2x Intel Xeon E5-2620, 64G RAM, RAID 10 (4x 240G SSD)) we bumped into a strange problem. We're trying to import dumps (mydumper) from our (old) ...
6
votes
2answers
3k views

Importing LARGE quantity of data into a PostgreSQL database

I am importing a large amount of data into a PostgreSQL server (across multiple databases on the server). When I last attempted to import the data, it effectively "crashed" my machine (Ubuntu 10.0.4),...
6
votes
4answers
5k views

Exporting/Importing a large MySQL database without mysqldump

I'm attempting to export about 150GB of data from a database with hundreds of tables, and have found mysqldump to be very buggy. After running a simple --all-databases dump succeeds, but the import ...
6
votes
1answer
27k views

Oracle error 12154 while importing DMP file

My Setup I'm running Windows 7 64-bit, using Oracle DB 11g R2 for Windows 64-bit. I have Oracle SQL Developer Release 3.0 (4.0.2.15.21) as the GUI for my database. Question I followed the ...
6
votes
2answers
224 views

Workaround to importing data

I am trying to import data into a SQL Server. I can import through the Import and Export Data wizard. I cannot import from my machine using BULK IMPORT or OPENROWSET since the file is not on the ...
6
votes
1answer
28k views

Create dump file using Oracle SQL Developer

I think I'm missing a simple point, but I couldn't find a way to use Oracle export (exp/expdp) and Oracle import (ipm/impdp) with Oracle SQL Developer (version 1.5.5)? Is there a way for it? If ...
6
votes
2answers
21k views

Import from Access .accdb file to SQL Server [duplicate]

How to import data from Access .accdb file to SQL Server? What should I choose in SQL Server Import and Export Wizard? Suppose we choose OLE DB Provider for SQL Server Integration Services, then if ...
6
votes
3answers
6k views

SQLite CSV import won't create a table automatically

According to https://www.sqlite.org/cli.html#csv, sqlite> .mode csv sqlite> .import C:/work/somedata.csv tab1 There are two cases to consider: (1) Table "tab1" does not previously exist ...
6
votes
1answer
12k views

How can I load csv data into mongodb and choose the types I'd like to have created for each column?

I'm looking for a method to load csv data in mongodb and specify the types that I'd like to have created for each column? I've been using mongoimport but I find it quite painful because there doesn't ...
6
votes
2answers
36k views

Inserting all csv files into a table in MySQL

I am looking for a way to insert all my csv files into MySQL without having to write several LOAD DATA INFILE statements. I have many csv files I need to insert and the files themselves are very ...
6
votes
1answer
3k views

MySQL Import CSV with Multiple Field Separators

I'm trying to import this CSV file into MySQL that appears to be optionally enclosed by more than one character. Unfortunately, MySQL only supports one character as a field separator. I am stuck ...
5
votes
3answers
16k views

Using OPENQUERY to execute a script

I have a SQL Server 2008 instance which I want to use to import data from an Oracle server. I have set up a linked server that works correctly when running simple queries like SELECT * FROM table. ...
5
votes
2answers
3k views

Directly import a csv gzip'ed file into SQLite 3

I'd like to import a 15GB file comma delimited gzip compressed file into Sqlite 3 without having to use temporary files. I'd like to run a command like: zcat input/surgical_code.csv.gz | tail -n +...
5
votes
2answers
2k views

How to import CSV file in SQL server 2008?

I am trying to import a CSV file in SQL Server 2008. BULK INSERT is a way to go but it is applicable for CSV from SQL Server 2014 onwards. What would be an alternative way to achieve this goal? Any ...
5
votes
2answers
926 views

Shall I use enum when are too many “categories” with PostgreSQL?

Problem I plan to load a CSV with more 10 million records into PostgreSQL v12.1, one of its columns has "categorical" values, so creating an enumerated type for it seems to be a good choice, but it ...
5
votes
3answers
1k views

Azure SQL Warehouse - Data Ingestion - Convert a huge fixed width (with commas) file to delimited

I am not even sure if I am framing this question right, but I will try - I have a bunch of huge text files generated from an Oracle export on a Linux system. Each file is about 30 GB in size, and I ...
5
votes
3answers
1k views

Export to format compatible with SQL Server

I need to provide data in a format that could be imported into a Microsoft SQL Server database; however, I do not have Windows or access to a SQL Server instance. The data is currently in several CSV ...
5
votes
2answers
28k views

Importing SQL Server database from a .sql file

I'd like to import a database without knowing its name from a .sql file. In MySql server it is easy because there is tools like heidSQL in which I can import easily my database from a sql file but in ...

1
2 3 4 5
11