The import of data is the automated or semi-automated input of data sets between different software applications.

learn more… | top users | synonyms

1
vote
1answer
106 views

LOAD DATA INFILE decline in performance

Query for insert: LOCK TABLE tbl WRITE; ALTER TABLE tbl DISABLE KEYS; load data local infile "E:/One.txt" into table tbl fields terminated by "\t" lines terminated by "\n" (user_id, sexid, cityid); ...
0
votes
0answers
71 views

MySQL import gets slower and slower until it virtually grinds to a halt, what can I do to maintain constant speeds?

I'm importing a large set of sql data into a MySQL (MariaDB 5.5) database, the files are from 200mb to 3g. I'm importing it one after the other, and it starts importing at speeds around 1MiB/s to ...
1
vote
1answer
222 views

Generate INSERT statement from SELECT query

I have two databases, in first database I have a table called zoom_city and in the second database I have a table called courrier_city. The SQL for each is below: CREATE TABLE IF NOT EXISTS ...
0
votes
1answer
114 views

How to export oracle 11g database partially

I have a huge oracle test database whose size is more than 100 GB. I want to export only 1% of all the data and import it into my local database to have a local replica of that application. Is it ...
0
votes
2answers
152 views

How to generate error log file while executing a .sql file in terminal

I just started learning coding 2 week ago and I am in a middle of an issue that I am not really able to find online, SO i though why not ask. I am trying to import Import a MySql DB of around 8 Gigs ...
0
votes
0answers
43 views

MySQL import low use of resources

I'm importing a largish DB into MySQL (20tables of ~25mill records). As expected this is taking a long time, but I'm curious as to why the process is running using only 0.000 to 0.700 %CPU and 0.87 ...
0
votes
0answers
17 views

Network flow for Import Export Wizard

When I use the Import Export Wizard on my workstation to move data from ServerA to ServerB does the data flow over the network directly from ServerA to ServerB? Or does it go from ServerA to my ...
0
votes
0answers
537 views

How can I backup/dump MYSQL database with foreign key constraints?

I wanted to take the dump of the MySQL database with all the constraints on that database. The dump (.sql file) I am having right now don't show any reference key(foreign key) relationship. I am ...
1
vote
1answer
154 views

Error while importing sql - Specified key was too long; max key length is 1000 bytes

I am trying to import an sql file which shows me the following error: Error SQL query: -- -------------------------------------------------------- -- -- Table structure for table `users` -- CREATE ...
0
votes
0answers
134 views

Undo tablespace size in many data import in short number of tables

Yesterday i've had many problems trying to import a big dump file with only 9 tables but many rows in each table. In common use the undo tablespace has a size of 1.5 Gb. But when trying to import the ...
1
vote
1answer
54 views

Import (imp) not showing final report stats/results

I'm trying to execute an import of a dmp file an not obtaining the final results of the import. It's really weird because i obtained really big files (nohup.out and imp_xxx.log) with the following ...
3
votes
2answers
987 views

Oracle imp crashes without error

I have Oracle 10g XE database locally. I export schema with something like exp %USER%/%PASSWD%@XE statistics=NONE owner=%USER% file=dump.dmp Exp is 10.2.0.1.0 version - so is the DB. Than I take ...
0
votes
2answers
62 views

I can't import my database into mysql

I have a website based on drupal and I tried to export its database via both Backup wizard and phpmyadmin. the database was exported but I can't import it on my localhost database.this the error ...
1
vote
1answer
85 views

Appending imported data in Postgres

This is what I typically use to import csv data into my postgres database.. \COPY master_list FROM '/root/raw/file.txt' DELIMITER ',' CSV; Usually it's into a blank table, but in this case, I need ...
-2
votes
1answer
116 views

Bulk Insert / Data Transformation [closed]

What techniques do people use to upload data from a flat file into a normalised database? We are planning on using MySQL or MariaDB. I have a number of large excel spreadsheets that I would like to ...
1
vote
1answer
36 views

Accessing Data after importing from file

I'm going to preface this with saying I'm a complete newbie at this database stuff before the rolling of the eyes happens, so please be patient with me. I have an sql dump that I am trying to import ...
0
votes
0answers
70 views

Viewing tables and data from a tablespace that was attached from another database

I'm using a database Oracle 11g. I have a DBF file of an old tablespace from a different database that I want to connect to the existing database. I've created a tablespace with REUSE caluse, and it ...
1
vote
1answer
370 views

Import XML data retaining while creating ID's with relationships

I need to parse XML from a file into tables while retaining their relationships through custom-generated ID values. IE, if I had the following XML: <root> <construction> ...
35
votes
3answers
16k views

How can I monitor the progress of an import of a large .sql file?

I am importing a 7 GB foobar.sql to restore a table in a local database. $ mysql -h localhost -u root 'my_data' < foobar.sql $ mysql --version /usr/local/mysql/bin/mysql Ver 14.12 Distrib ...
0
votes
0answers
130 views

In mySQL possible to change auto-increment ids that have huge gaps and if so how?

I am importing a 50 table relational database (I'm not a dba) with 250,000+ records in most of the tables, yet the auto increment is off in most tables, some for example showing the last ID at 5 ...
1
vote
0answers
85 views

Import from incremental backups to a new host in Oracle 11g

I am using Oracle 11g. I would like to know that whether it is possible to import from incremental level 0 & 1 backups to a new host using RMAN. If yes, how can I do that? For level 1 I am using ...
0
votes
1answer
107 views

imp paused mid import

OK, I'm new to Oracle administration but I'm trying to import a previous dump (no pun intended) which was split into two files. The import is happening from an Oracle 9i to 11gR2 on Windows I used ...
0
votes
0answers
113 views

Import only selected column from tsv into mongodb

Edit I am uploading very big tsv file thats why i dont want to import unnecessary column in mongodb, I know how to upload file into mongodb(just as attachment) as:- mongoimport --db xyztsv--c ...
4
votes
3answers
4k views

Import Oracle full dump file to fresh Oracle installation

I am importing a Oracle dump fill created on a AIX Oracle 9.2 installation with a Full Export option to a Windows Oracle 10.2.0.4 on Windows 2008 R2 x64. I want to import the file to a clean ...
0
votes
1answer
113 views

Writing with multiple psql processes to database seems to damage data

I have a couple terabytes of CSV data that I am trying to import into a PostgreSQL 8.4 database (on a RedHat 6.2 server), whose data directory is initialized on a multipath hardware RAID. There are ...
0
votes
1answer
800 views

Why would SequelPro only import 23k rows out of 130k?

I use SequelPro for mysql on a Mac OS X -- and I used the import function to upload a 130k .csv file to my database. Everything seems to work fine, then I get the message File Read Error: An error ...
1
vote
1answer
827 views

Creating a USER using the imp command [duplicate]

I was told I can use exp to export a certain USER, then DROP the user and with the imp command I can recreate that USER with all of its tables. Is it true? How do I do it? I already have an ADMIN ...
1
vote
1answer
162 views

Using a PostgreSQL tablespace from two different servers

I have a PostgreSQL database living on an external hard disk (RAID0 via Thunderbolt). So far I accessed it from a PostgreSQL server running on my MacBook Pro. As my work on this database is getting ...
0
votes
1answer
220 views

Help with Postgres 9.1 data import (is 4x expected data size, 4x slower than MySQL, and index still needed)

I have 25 billion <int, int, float> rows that I'm trying to import into Postgres, and after 77% of the data being imported, the Postgres data folder is taking up 840GB, about 4x the storage ...
1
vote
3answers
182 views

SQL Server Import Job Removed Data After Job Failed

I have a SQL Server Job set up to import data from a table to a table on another server, using the Import/Export data wizard. In one instance, the job failed (with, I believe a SQL connection issue), ...
-2
votes
1answer
765 views

Importing delimited files into SQL server [closed]

I am trying to import a large file into SQL server that is | delimited. I know basically nothing about the data, I just want to get it imported. When I go to Database->tasks->import I use the ...
0
votes
0answers
109 views

Importing large .sql file stops before even midway and starts deleting

Okay so i'm trying to import my minecraft servers .sql file into database and after first 1GB of importing data it stops without error and starts deleting what already has been imported any ideas? ...
0
votes
1answer
485 views

MongoDB fast upsert

For non-incremental, but overlapping, imports, I worry about upserts to be very slow and locking the resources for hours. From different sources, I receive 1 json dump per day per source for up to 3 ...
1
vote
0answers
291 views

How do I safely import MySQL data in a directory to a running MariaDB server?

We're integrating another office into ours. That includes some of their data. I have a new installed MariaDB 5.5 server. The data dir = /home/data/MariaDB. I've done a new/fresh install into that ...
0
votes
0answers
84 views

Locking and Faulting on import

My collection with a _id and a single field index is run on a single node/on localhost, has 48GB RAM and 16 core CPU available. The hdd is in RAID1, without SSD cache. Mongo version 2.4. I run a ...
5
votes
7answers
28k views

How to import a .sql file in MySQL?

I am trying to import a .sql file using MySQL Workbench and I get this error: ERROR 1046 (3D000) at line 28: No database selected I have first created an empty database called with the same name as ...
0
votes
0answers
140 views

Efficient, up-to-date way to import an Oracle database into MySql

Here's the situation: I need to automatically merge data from an Oracle and a MySql server into a single, new MySql server. The merging will happen daily, and the resulting server will be hosted on a ...
2
votes
1answer
121 views

Import issue with Replication

When I import some data from excel file to a table that is part of a merge replication, the data is imported successfully to the table, but those new records are not synced to subscribers that belong ...
3
votes
1answer
384 views

Can I monitor the progress of importing a large .sql file in sqlite3 using zenity --progress?

I'm trying to monitor the progress of a sqlite3 command importing a large .sql file into a database using zenity --progress. I've tried the following which will import the file, however progress is ...
1
vote
1answer
157 views

Any way to estimate the required space for a SQL dump file?

I want to import a Wikipedia XML dump file into MySQL. The uncompressed XML dump file is 65GB. Does this mean I should free up almost 64GB in the MySQL data path? Is there any way to estimate the ...
0
votes
0answers
326 views

CSV File Into MYSQL Merging - LOAD DATA on Duplicate Key?

Hey Dba Stack Exchange, My question to you is with regards to mysql. Right now I have a medium to small sized csv with 25k lines I need imported into mysql for a client. Problem is, their is only ...
4
votes
2answers
653 views

Import Data replaces NULL with 0

I am using sql server 2008 r2 express. I am getting some problems when i use import data feature to import data from one database to another. I am using SSMS to do it. While using the wizard i choose ...
0
votes
1answer
3k views

Importing SQL Server database from a .sql file

I'd like to import a database without knowing its name from a .sql file. In MySql server it is easy because there is tools like heidSQL in which I can import easily my database from a sql file but in ...
0
votes
0answers
514 views

How to import a text file with '|' delimited data to PostgreSQL database? [closed]

I have a text file with | delimited data that I want to import to a table in PostgreSQL database. PgAdminIII only exports CSV files. I converted the file to a CSV file using MS excel but still was ...
3
votes
1answer
244 views

VLDB with large quantity of data file imports

I am a little out of my league with this scenario and hope this community can help get me on the right direction. I have recently been tasked with re-designing and implementing a database application ...
2
votes
1answer
1k views

Using Workbench to export. Views no longer work

I'm using Workbench 5.2 from my production DB machine (Ubuntu Linux). I've been trying to export. First try.. I had the entire schema selected including all tables and views in the right hand ...
6
votes
3answers
733 views

Suggestion for Bulk Data Import

We are working on a project which requires import data from Excel spreadsheet on daily basis. The data will be import from pre-define template and what we're thinking, first we will upload data in ...
0
votes
2answers
417 views

Import batches of rows from Excel in parallel

We receive an Excel file weekly currently containing about 250k rows. The file grows by about 300 rows each week. In SSIS I've hooked up an Excel source to an OLE DB destination to import the file ...
0
votes
1answer
494 views

Exporting and importing a database

I have setup an Oracle 11g Database and have a question about exporting and importing a database. I am using Enterprise Manager and have browsed to the following: Data Movement->Export to Export ...
2
votes
2answers
6k views

PostgreSQL not working, pgAdmin always says server not listening

I am brand new at this so maybe it's a simple mistake. I was given a very large .sql file with the instructions to make a copy of a database locally on a computer. I was told "to be able to install ...