The import of data is the automated or semi-automated input of data sets between different software applications.

learn more… | top users | synonyms (1)

1
vote
0answers
58 views

how to directly import a csv gzip'ed file into SQlite 3?

I'd like to import a 15GB file comma delimited gzip compressed file into Sqlite 3 without having to use temporary files. I'd like to run a command like: zcat input/surgical_code.csv.gz | tail -n ...
91
votes
7answers
56k views

How can I monitor the progress of an import of a large .sql file?

I am importing a 7 GB foobar.sql to restore a table in a local database. $ mysql -h localhost -u root 'my_data' < foobar.sql $ mysql --version /usr/local/mysql/bin/mysql Ver 14.12 Distrib ...
0
votes
2answers
331 views

Import a sample database into SQL Server on AWS RDS free tier

I asked this on stack overflow but someone there suggested I try here as I might get better answers. So here goes... I'm signed up to Amazon Web Service (AWS) free tier, which allows you to run some ...
1
vote
1answer
968 views

Import XML data retaining while creating ID's with relationships

I need to parse XML from a file into tables while retaining their relationships through custom-generated ID values. IE, if I had the following XML: <root> <construction> ...
0
votes
1answer
89 views

MySql Workbench Data Import .csv

Hi I am trying to use to MySql Workbench Data Import facility to import a .csv file (thousands of records). However it stops importing the first 5 records. After studying the .csv file I could see ...
2
votes
2answers
3k views

Import Oracle schema data without losing modifications of stored procedures

I have this scenario: One huge (thousands of tables), complex, Oracle 8 production database, One huge (thousands of tables), complex, Oracle 9 development database, (same structure as production) ...
0
votes
1answer
38 views

How to import a single table in Windows environment

I am running Windows 7 with xampp. I can easily import a database with the following command: mysql -u user -p database < backup.sql The problem is that I have a database around 8.5 GB, which ...
29
votes
8answers
115k views

MySQL DB import/export command line in Windows

How to export / import a database in MySQL through the command line? MySQL system configuration, WampServer server installed. OS: Windows The advice for my local host, not an live hosting...
0
votes
0answers
32 views

Error in SQL server import - code page error

Error 0xc02020f4: Data Flow Task 1: The column "DEALER_ID" cannot be processed because more than one code page (1256 and 1252) are specified for it. (SQL Server Import and Export Wizard) ...
1
vote
2answers
106 views

Can error 1231 after importing a MySQL database be a compatibility issue?

ERROR 1231 (42000): Variable 'character_set_client' can't be set to the value of 'NULL' Query OK, 0 rows affected (0.00 sec) ERROR 1231 (42000): Variable 'collation_connection' can't be set ...
1
vote
4answers
977 views

How to find out which data I just imported into Oracle?

I imported two dump files (no idea what they contained, my goal is precisely to find out what they contain) into Oracle, but now I am struggling to identify what is the data I imported, and what data ...
0
votes
2answers
2k views

SQLite CSV import won't create a table automatically

According to https://www.sqlite.org/cli.html#csv, sqlite> .mode csv sqlite> .import C:/work/somedata.csv tab1 There are two cases to consider: (1) Table "tab1" does not previously ...
19
votes
7answers
95k views

Import a Oracle DMP file into a Fresh install of oracle

A client sent us an Oracle database we need to test against. We don't use Oracle or have any in-house Oracle expertise. We need to setup the database so we can connect to it and debug a problem. I ...
4
votes
2answers
3k views

Create a table from a CSV file with headers

I'm seeking to find a way to generate a new MySQL table solely based on the contents of a specified CSV. The CSV files I'll be using have the following properties; "|" delimited. First row ...
3
votes
1answer
276 views

csv file with fields having commas in them

I have a CSV file with fields given as follows. number1, string1, "string2, string3", number2, string4, "string5, string6" where number's are numbers and string's are strings. I am trying to read ...
3
votes
1answer
340 views

many csv file loading using bash script

#!/bin/bash # show commands being executed, per debug #set -x # define database connectivity _db="mydata" _db_user="root" _db_password="123" # define directory containing CSV files ...
4
votes
2answers
2k views

ERROR 1166 (42000) at line 65203: Incorrect column name ''

I have a big snapshot database size is about 44GB in mydata.sql. When I run it overnight, it show this error message: $ mysql -u root < mydata.sql ERROR 1166 (42000) at line 65203: Incorrect ...
0
votes
1answer
43 views

mySQL Data loading: Better to column map or INSERT SELECT INTO ETL?

I've got 125 csv files to upload into a database. The files are typically ~200K rows and 30 columns. In order to make the data more relational I was going to column map during LOAD DATA INFILE ...
3
votes
2answers
178 views

How to import blanks as nulls instead of zeros while importing txt using wizard

I'm using the Import Wizard to load a text file and need blanks in integer fields to be nulls, but only zeros are inserted. How to import it properly?
6
votes
4answers
767 views

Mysql (percona-server 5.5) completely stalls during import (myloader)

While configuring our new servers (IBM X3650M4, 2x Intel Xeon E5-2620, 64G RAM, RAID 10 (4x 240G SSD)) we bumped into a strange problem. We're trying to import dumps (mydumper) from our (old) ...
1
vote
1answer
59 views

Post data deploy in SSDT

I need to create post deployment script which will upload data from .csv file to my database. But I can't understand how can I do this. When I tried to deploy my project on my server I receive this ...
0
votes
1answer
652 views

Load csv file to mysql using load data local infile

I need a simple way to load a csv file from my computer to the database (which is on a remote server). I'm trying to load the file using a php page that executes this code: $file = ...
0
votes
0answers
15 views

PostgreSQL dump import only imprts tables and not data

I'm trying to import a postgreSQL dump into my DB. The dump is saved in a .sql file. I use the following command : psql -U postgres -d dhris < dbDump.sql and the table was created before. The ...
1
vote
1answer
47 views

Is there a way to specify the initial size of MySQL File-Per-Table Tablespaces?

Preparing for massive data import into a MySQL 5.7 community instance, I'd like to know if there is a way to allocate upfront the total amount of space that will be used by the volume of information? ...
0
votes
1answer
234 views

Line-breaks in Text column of CSV file

I have come across an awkward situation where I have got CSV files with | as the column delimiter. In these files, I don't have Text column qualifier. (i.e. "). My problem is when I am importing these ...
0
votes
1answer
236 views

PhpMyAdmin Import Error-MySQL server has gone away/Unrecognized Keyword

So I've exported a MySQL database from PHPMyAdmin (which I access from within IIS Express on a Windows 8 machine) and I'm trying to import this database onto another machine, however on that machine I ...
1
vote
0answers
34 views

SSIS Guarantee that all data will be moved to target when running data flows in parallel

My package has the following two tasks which run in parallel. DF - Move source data to target loads a copy of all source data to target via OLEDB Dest - Target and also loads a copy of source PK ...
2
votes
1answer
113 views

In SQL Server, are there any other options of data Import and Export

I've been working with SQL Server since SQL Server 7. So I know about BCP, Bulk insert, openrowset and SSIS. My question is a simple one: Do you know of any other ways to Import/Export data using ...
0
votes
4answers
687 views

which one is the fastest way of moving database form local to live server in sql server

I am using SQL Server 2008, I have a big database of almost 500 MB. Now I wanted to upload or deploy this DB to the Live server. Currently I am generating scripts and then uploading them to live and ...
0
votes
0answers
23 views

Efficient import of 1 million SQL files in Postgresql

I have a huge problem. I have 1 million SQL files varying in size from 9KB to 3MB that I need to import into one table very quickly. The files represent hundreds of billions of rows. Is there a ...
0
votes
1answer
71 views

Import quoted CSV

I have a set of quoted CSV files, which I need to import into SQL Server. Files look like this: "ColA","ColB","ColC" "12345","John Smith","-75.33" "12356","Jane Doe","43.12" BCP and BULK INSERT ...
0
votes
0answers
99 views

MySQL Export not possible to import due to ERROR 1064

we are currently in the progress of moving from MySQL to PG. To do so we are in the progress of setting up a test environment for our database operations. The process is rather simple: We have ...
6
votes
2answers
2k views

Error on import of mysqldump file - Illegal double value found during parsing

I am currently getting the following error while trying to import / restore a mysqldump file: ERROR 1367 (22007) at line 445: Illegal double '1.79769313486232e+308' value found during parsing I ...
0
votes
1answer
377 views

Using Identity Insert on a linked server

We have a database hosted in Microsoft Azure and using this database connection details I have created a linked server object in SSMS on our on-premise SQL box and I can insert into it as following ...
2
votes
2answers
260 views

Importing CSV's into MySQL(5.6) tables leaves date fields as 0000-00-00

During the import from a CSV file created from an MS Access table into a MySQL table it converts all date fields in the csv into 0000-00-00. I use the following Load Data command for the import. ...
0
votes
2answers
68 views

Mysqlimport very slow when importing two smaller files

I am trying to import a large file, it was really big and it did not seem to be working so I broke it into pieces. The first piece takes 2 minutes, and the second one takes almost an hour!!! How can ...
0
votes
0answers
176 views

Mysql dump import shows error 1556 (HY000) “you can't use locks with log tables”

I'm trying to setup a replication slave for an existent MySQL server. Therefore I dumped all data from the master like this: mysqldump --skip-lock-tables --single-transaction --flush-logs --hex-blob ...
0
votes
2answers
548 views

How to import into database when records contain multi-line data [closed]

I am setting up a new database and I want to import lots of data from multiple spreadsheet files. One of the fields in these documents contains an array of data, each item declared on seperate rows as ...
5
votes
2answers
331 views

Import XML files into SQL Server 2012

Every Friday I have to import a couple (sometimes more than 300) of XML files into 2 tables. The structure of one of the tables, R000000, looks like this: R00000010 | R00000020 | R00000030 | ...
1
vote
1answer
8k views

Oracle 10g dump file into Oracle 11g database

I went through this link for my answer to the same question. I was not sure if i could continue in the same link, so created a new question. Oracle 10g dump file push into Oracle 11g database Sorry ...
3
votes
1answer
60 views

Migrating database from old software to new software

I am a young web developer and I am facing a problem I cannot solve on my own and need some help and/or orientation. My client has an agenda (Lotus), which is a very old software, and I have ...
0
votes
1answer
70 views

Import sql structure from sql file which has data

I have a giant sql file that I created from my working server, but have had to shut that server down. I'm trying to import the sql into my test server (very small). I just want to import the table ...
2
votes
3answers
673 views

Creating a MySQL db from an Informix database

There is an existing database that was created in Informix. I would like to export it and then import it into MySQL. I tried to export it using dbschema and it created the dbase.sql file and several ...
1
vote
1answer
266 views

import text file getting command is not allowed with this MySQL version

here is my table CREATE TABLE cities ( country CHAR(2), city_ascii VARCHAR(100), city VARCHAR(255), region CHAR(2), population INT UNSIGNED, ...
0
votes
1answer
78 views

Fastest way to sync (or keep import) 3.5TB data from hadoop to sharded mongodb cluster

There are 3.5TB data in our hadoop cluster(yes on hdfs). And we have newly built a sharded mongodb cluster(the latest 3.x) with 3 mongos, 3 configdb and 3 shards(each shard has 1 primary and 2 ...
1
vote
2answers
218 views

Are expdp/impdp commands appropriate for daily schema sync?

I've done following comands: expdp system/password@localdb ^ schemas=SCH directory=dumps_dir dumpfile=SCH_%date%.dmp logfile=expdpSCH_%date%.log It runs great, without errors. But when I use ...
0
votes
0answers
105 views

Oracle NLS_CHARACTERSET mismatch while import

I have source Dump with NLS_CHARACTERSET WE8MSWIN1252 NLS_NCHAR_CHARACTERSET AL16UTF16 Requires the target database system is with NLS_CHARACTERSET AL32UTF8 NLS_NCHAR_CHARACTERSET ...
0
votes
0answers
24 views

MySQL: Automated reinstall, export + import all, for a fresh start?

I have the suspiction that my MySQL installation and all databases are somehow borked. For a fresh start, I would like to create dumps from all the databases, uninstall MySQL, delete the data in ...
0
votes
1answer
187 views

Import (flat file) into SQL Server

I've seen a couple of questions about the subject backfiring so I'll try to be specific about my concern... I have an old (MS Access) frontend I'm trying to rebuild and I left the part that troubles ...
0
votes
0answers
158 views

How to know imdp size?

I have a dump file using expdp with compression (oracle version >= 11g). Before running impdp I want to check if there is enough space on the machine but it seems as there is no parameter in the impdp ...