The import of data is the automated or semi-automated input of data sets between different software applications.

learn more… | top users | synonyms (1)

0
votes
1answer
47 views

Postgres Data Dump problem

I am trying to dump this data into Postgres: COPY address_types (game_id, device_type) FROM stdin; 1 Ps3 2 Xbox 3 Other \. But I always get this error: [Err] ERROR: syntax error at or ...
1
vote
0answers
11k views

how to import .xls file into SQLite database?

I have an issue with importing .xls file into SQLite database. I am working on windows xp and using a SQLite manager for maintain the database. I can import the .csv file to the database by using ...
1
vote
1answer
49 views

Importing CSV file - PostgreSQL 9.2

I'm trying to import data from a CSV file on a PostgreSQL 9.2 server, but I get errors when doing that. Pgadmin: ERROR: Cannot execute COPY FROM in a read-only transaction Why am I getting that ...
0
votes
2answers
27 views

Importing mysqlnd database to MySQL server

Importing a mysqlnd (5.0.12) database to MySQL server (5.1.66) causes error? Currently we are performing this task and encountering errors (like below): ERROR 1146 (42S02): Table 'xx-xxx-xxx-xxx' ...
2
votes
3answers
76 views

Date conversion and integer truncation during import

I am doing some data file imports using: LOAD DATA INFILE 'apa.txt' INTO TABLE Test_Stock_Daily FIELDS TERMINATED BY ',' (symbol, date, open, high, low, close, volume); The date in the file is ...
1
vote
1answer
69 views

MySQL Database import into 5.7 hangs with CLI or with Workbench 6.3 CE

I have a SQL dump file that I exported using Workbench from a server that is being decommissioned. The host and target OS is Microsoft Windows Server 2008 R2 (therefore is x64 natively). There seems ...
0
votes
0answers
100 views

Can Firebase serve as my DB-driven app's primary DB (and if not, what's a good choice)?

I've created a data scraping workflow that creates .csv files. I've been populating a Postgres DB with those .csv files thusfar. After a contractor failed to successfully develop a REST API to query ...
0
votes
1answer
152 views

Load data from flat file into oracle table [closed]

I created a new database, then created a table "users". Now, I'm trying to load data to this table from a flat file called 'users.tbl', that has some records with the following format: 1|john|email@...
1
vote
1answer
74 views

SQL Data in form of Date+Time bulk insert into one column

Background of problem: To insert 2 seperated fields of data (from a big flat file document of data) with bulk insert. Columns in question that i want to get data from is in its current form in date ...
0
votes
2answers
33 views

Excel Import ID, Data Type Double

I get a file from another department that contains an id column. The id column is mostly numbers, but also contains some letters. I receive the file in XLS format. When I try to use the import ...
0
votes
0answers
23 views

XML to Database with XMLSpy

I am using XML Spy to take a XML file (looks like this) and create a database structure after it. I then import the data from my XML file to fill in the rows, etc. I find that some , about 1/4 of the ...
0
votes
1answer
138 views

Selecting from a table contains a XML column

I have received an Excel file (verion 2010) and based on the requirement I was asked to save it as an XML file and then import into SQL data ready to be queried in normal SELECT statements. Below is ...
5
votes
1answer
246 views

Mysql LOAD DATA INFILE 100,000 csv records perfect BUT 300,000 records - 0 rows inserted

The following query imports 100,000 perfectly, but larger files nothing happens. No errors, no rows loaded. Any clues you can offer are appreciated. I spent hours looking into max file and memory ...
3
votes
1answer
96 views

SSMS: Import from flat file (.csv)

In SQL Server Management Studio (SSMS) 2008 R2, I wish to import a not-quite-properly formatted CSV into a database table. I was trying to use the wizard at <database name>->Tasks->Import Data. ...
93
votes
7answers
58k views

How can I monitor the progress of an import of a large .sql file?

I am importing a 7 GB foobar.sql to restore a table in a local database. $ mysql -h localhost -u root 'my_data' < foobar.sql $ mysql --version /usr/local/mysql/bin/mysql Ver 14.12 Distrib 5.0....
0
votes
2answers
365 views

Import a sample database into SQL Server on AWS RDS free tier

I asked this on stack overflow but someone there suggested I try here as I might get better answers. So here goes... I'm signed up to Amazon Web Service (AWS) free tier, which allows you to run some ...
1
vote
1answer
988 views

Import XML data retaining while creating ID's with relationships

I need to parse XML from a file into tables while retaining their relationships through custom-generated ID values. IE, if I had the following XML: <root> <construction> <...
1
vote
1answer
115 views

MySql Workbench Data Import .csv

Hi I am trying to use to MySql Workbench Data Import facility to import a .csv file (thousands of records). However it stops importing the first 5 records. After studying the .csv file I could see ...
2
votes
2answers
3k views

Import Oracle schema data without losing modifications of stored procedures

I have this scenario: One huge (thousands of tables), complex, Oracle 8 production database, One huge (thousands of tables), complex, Oracle 9 development database, (same structure as production) ...
0
votes
1answer
40 views

How to import a single table in Windows environment

I am running Windows 7 with xampp. I can easily import a database with the following command: mysql -u user -p database < backup.sql The problem is that I have a database around 8.5 GB, which ...
0
votes
0answers
32 views

Error in SQL server import - code page error

Error 0xc02020f4: Data Flow Task 1: The column "DEALER_ID" cannot be processed because more than one code page (1256 and 1252) are specified for it. (SQL Server Import and Export Wizard) This ...
1
vote
2answers
134 views

Can error 1231 after importing a MySQL database be a compatibility issue?

ERROR 1231 (42000): Variable 'character_set_client' can't be set to the value of 'NULL' Query OK, 0 rows affected (0.00 sec) ERROR 1231 (42000): Variable 'collation_connection' can't be set to ...
1
vote
4answers
989 views

How to find out which data I just imported into Oracle?

I imported two dump files (no idea what they contained, my goal is precisely to find out what they contain) into Oracle, but now I am struggling to identify what is the data I imported, and what data ...
1
vote
2answers
2k views

SQLite CSV import won't create a table automatically

According to https://www.sqlite.org/cli.html#csv, sqlite> .mode csv sqlite> .import C:/work/somedata.csv tab1 There are two cases to consider: (1) Table "tab1" does not previously ...
19
votes
7answers
98k views

Import a Oracle DMP file into a Fresh install of oracle

A client sent us an Oracle database we need to test against. We don't use Oracle or have any in-house Oracle expertise. We need to setup the database so we can connect to it and debug a problem. I ...
3
votes
1answer
303 views

csv file with fields having commas in them

I have a CSV file with fields given as follows. number1, string1, "string2, string3", number2, string4, "string5, string6" where number's are numbers and string's are strings. I am trying to read ...
3
votes
1answer
383 views

many csv file loading using bash script

#!/bin/bash # show commands being executed, per debug #set -x # define database connectivity _db="mydata" _db_user="root" _db_password="123" # define directory containing CSV files _csv_directory="/...
4
votes
2answers
2k views

ERROR 1166 (42000) at line 65203: Incorrect column name ''

I have a big snapshot database size is about 44GB in mydata.sql. When I run it overnight, it show this error message: $ mysql -u root < mydata.sql ERROR 1166 (42000) at line 65203: Incorrect ...
0
votes
1answer
46 views

mySQL Data loading: Better to column map or INSERT SELECT INTO ETL?

I've got 125 csv files to upload into a database. The files are typically ~200K rows and 30 columns. In order to make the data more relational I was going to column map during LOAD DATA INFILE ...
3
votes
2answers
203 views

How to import blanks as nulls instead of zeros while importing txt using wizard

I'm using the Import Wizard to load a text file and need blanks in integer fields to be nulls, but only zeros are inserted. How to import it properly?
6
votes
4answers
853 views

Mysql (percona-server 5.5) completely stalls during import (myloader)

While configuring our new servers (IBM X3650M4, 2x Intel Xeon E5-2620, 64G RAM, RAID 10 (4x 240G SSD)) we bumped into a strange problem. We're trying to import dumps (mydumper) from our (old) ...
1
vote
1answer
68 views

Post data deploy in SSDT

I need to create post deployment script which will upload data from .csv file to my database. But I can't understand how can I do this. When I tried to deploy my project on my server I receive this ...
1
vote
1answer
756 views

Load csv file to mysql using load data local infile

I need a simple way to load a csv file from my computer to the database (which is on a remote server). I'm trying to load the file using a php page that executes this code: $file = $_FILES['csv']['...
0
votes
0answers
15 views

PostgreSQL dump import only imprts tables and not data

I'm trying to import a postgreSQL dump into my DB. The dump is saved in a .sql file. I use the following command : psql -U postgres -d dhris < dbDump.sql and the table was created before. The ...
1
vote
1answer
50 views

Is there a way to specify the initial size of MySQL File-Per-Table Tablespaces?

Preparing for massive data import into a MySQL 5.7 community instance, I'd like to know if there is a way to allocate upfront the total amount of space that will be used by the volume of information? ...
0
votes
1answer
258 views

Line-breaks in Text column of CSV file

I have come across an awkward situation where I have got CSV files with | as the column delimiter. In these files, I don't have Text column qualifier. (i.e. "). My problem is when I am importing these ...
0
votes
1answer
262 views

PhpMyAdmin Import Error-MySQL server has gone away/Unrecognized Keyword

So I've exported a MySQL database from PHPMyAdmin (which I access from within IIS Express on a Windows 8 machine) and I'm trying to import this database onto another machine, however on that machine I ...
1
vote
0answers
34 views

SSIS Guarantee that all data will be moved to target when running data flows in parallel

My package has the following two tasks which run in parallel. DF - Move source data to target loads a copy of all source data to target via OLEDB Dest - Target and also loads a copy of source PK ...
2
votes
1answer
120 views

In SQL Server, are there any other options of data Import and Export

I've been working with SQL Server since SQL Server 7. So I know about BCP, Bulk insert, openrowset and SSIS. My question is a simple one: Do you know of any other ways to Import/Export data using ...
0
votes
4answers
694 views

which one is the fastest way of moving database form local to live server in sql server

I am using SQL Server 2008, I have a big database of almost 500 MB. Now I wanted to upload or deploy this DB to the Live server. Currently I am generating scripts and then uploading them to live and ...
0
votes
0answers
27 views

Efficient import of 1 million SQL files in Postgresql

I have a huge problem. I have 1 million SQL files varying in size from 9KB to 3MB that I need to import into one table very quickly. The files represent hundreds of billions of rows. Is there a ...
0
votes
1answer
76 views

Import quoted CSV

I have a set of quoted CSV files, which I need to import into SQL Server. Files look like this: "ColA","ColB","ColC" "12345","John Smith","-75.33" "12356","Jane Doe","43.12" BCP and BULK INSERT ...
0
votes
0answers
115 views

MySQL Export not possible to import due to ERROR 1064

we are currently in the progress of moving from MySQL to PG. To do so we are in the progress of setting up a test environment for our database operations. The process is rather simple: We have ...
6
votes
2answers
2k views

Error on import of mysqldump file - Illegal double value found during parsing

I am currently getting the following error while trying to import / restore a mysqldump file: ERROR 1367 (22007) at line 445: Illegal double '1.79769313486232e+308' value found during parsing I ...
0
votes
1answer
415 views

Using Identity Insert on a linked server

We have a database hosted in Microsoft Azure and using this database connection details I have created a linked server object in SSMS on our on-premise SQL box and I can insert into it as following ...
2
votes
2answers
282 views

Importing CSV's into MySQL(5.6) tables leaves date fields as 0000-00-00

During the import from a CSV file created from an MS Access table into a MySQL table it converts all date fields in the csv into 0000-00-00. I use the following Load Data command for the import. ...
0
votes
2answers
68 views

Mysqlimport very slow when importing two smaller files

I am trying to import a large file, it was really big and it did not seem to be working so I broke it into pieces. The first piece takes 2 minutes, and the second one takes almost an hour!!! How can ...
0
votes
0answers
202 views

Mysql dump import shows error 1556 (HY000) “you can't use locks with log tables”

I'm trying to setup a replication slave for an existent MySQL server. Therefore I dumped all data from the master like this: mysqldump --skip-lock-tables --single-transaction --flush-logs --hex-blob -...
0
votes
2answers
580 views

How to import into database when records contain multi-line data [closed]

I am setting up a new database and I want to import lots of data from multiple spreadsheet files. One of the fields in these documents contains an array of data, each item declared on seperate rows as ...
5
votes
2answers
379 views

Import XML files into SQL Server 2012

Every Friday I have to import a couple (sometimes more than 300) of XML files into 2 tables. The structure of one of the tables, R000000, looks like this: R00000010 | R00000020 | R00000030 | ...