The import of data is the automated or semi-automated input of data sets between different software applications.

learn more… | top users | synonyms (1)

0
votes
0answers
15 views

Import large DB 300 GB from ubuntu command line

My DB Size is 300 GB , I have 2 SQL Dump file , one is 100 GB and Other one 200 GB , When I import the database it is disconnected due to some problem. almost 90 GB data’s are imported from both the ...
-1
votes
0answers
19 views

How to import multiple .csv files as a batch?

How can I load multiple .csv files to a remote MySQL database? For example I want to load all these CSV files C:\csvFiles\file1.csv C:\csvFiles\file2.csv C:\csvFiles\file3.csv C:\csvFiles\file4.csv ...
2
votes
1answer
27 views

Mysql LOAD DATA INFILE 100,000 csv records perfect BUT 300,000 records - 0 rows inserted

The following query imports 100,000 perfectly, but larger files nothing happens. No errors, no rows loaded. Any clues you can offer are appreciated. I spent hours looking into max file and memory ...
1
vote
1answer
18 views

SSMS: Import from flat file (.csv)

In SQL Server Management Studio (SSMS) 2008 R2, I wish to import a not-quite-properly formatted CSV into a database table. I was trying to use the wizard at <database name>->Tasks->Import Data. ...
0
votes
0answers
8 views

how to directly import a csv gzip'ed file into SQlite 3?

I'd like to import a 15GB file comma delimited gzip compressed file into Sqlite 3 without having to use temporary files. I'd like to run a command like: zcat input/surgical_code.csv.gz | tail -n ...
0
votes
1answer
35 views

MySql Workbench Data Import .csv

Hi I am trying to use to MySql Workbench Data Import facility to import a .csv file (thousands of records). However it stops importing the first 5 records. After studying the .csv file I could see ...
0
votes
1answer
33 views

How to import a single table in Windows environment

I am running Windows 7 with xampp. I can easily import a database with the following command: mysql -u user -p database < backup.sql The problem is that I have a database around 8.5 GB, which ...
0
votes
0answers
28 views

Error in SQL server import - code page error

Error 0xc02020f4: Data Flow Task 1: The column "DEALER_ID" cannot be processed because more than one code page (1256 and 1252) are specified for it. (SQL Server Import and Export Wizard) ...
1
vote
2answers
43 views

Can error 1231 after importing a MySQL database be a compatibility issue?

ERROR 1231 (42000): Variable 'character_set_client' can't be set to the value of 'NULL' Query OK, 0 rows affected (0.00 sec) ERROR 1231 (42000): Variable 'collation_connection' can't be set ...
3
votes
1answer
201 views

csv file with fields having commas in them

I have a CSV file with fields given as follows. number1, string1, "string2, string3", number2, string4, "string5, string6" where number's are numbers and string's are strings. I am trying to read ...
3
votes
2answers
106 views

How to import blanks as nulls instead of zeros while importing txt using wizard

I'm using the Import Wizard to load a text file and need blanks in integer fields to be nulls, but only zeros are inserted. How to import it properly?
0
votes
1answer
28 views

mySQL Data loading: Better to column map or INSERT SELECT INTO ETL?

I've got 125 csv files to upload into a database. The files are typically ~200K rows and 30 columns. In order to make the data more relational I was going to column map during LOAD DATA INFILE ...
1
vote
1answer
18 views

Post data deploy in SSDT

I need to create post deployment script which will upload data from .csv file to my database. But I can't understand how can I do this. When I tried to deploy my project on my server I receive this ...
0
votes
1answer
152 views

Load csv file to mysql using load data local infile

I need a simple way to load a csv file from my computer to the database (which is on a remote server). I'm trying to load the file using a php page that executes this code: $file = ...
0
votes
0answers
11 views

PostgreSQL dump import only imprts tables and not data

I'm trying to import a postgreSQL dump into my DB. The dump is saved in a .sql file. I use the following command : psql -U postgres -d dhris < dbDump.sql and the table was created before. The ...
1
vote
1answer
32 views

Is there a way to specify the initial size of MySQL File-Per-Table Tablespaces?

Preparing for massive data import into a MySQL 5.7 community instance, I'd like to know if there is a way to allocate upfront the total amount of space that will be used by the volume of information? ...
0
votes
1answer
98 views

Line-breaks in Text column of CSV file

I have come across an awkward situation where I have got CSV files with | as the column delimiter. In these files, I don't have Text column qualifier. (i.e. "). My problem is when I am importing these ...
0
votes
1answer
104 views

PhpMyAdmin Import Error-MySQL server has gone away/Unrecognized Keyword

So I've exported a MySQL database from PHPMyAdmin (which I access from within IIS Express on a Windows 8 machine) and I'm trying to import this database onto another machine, however on that machine I ...
6
votes
4answers
431 views

Mysql (percona-server 5.5) completely stalls during import (myloader)

While configuring our new servers (IBM X3650M4, 2x Intel Xeon E5-2620, 64G RAM, RAID 10 (4x 240G SSD)) we bumped into a strange problem. We're trying to import dumps (mydumper) from our (old) ...
2
votes
1answer
75 views

In SQL Server, are there any other options of data Import and Export

I've been working with SQL Server since SQL Server 7. So I know about BCP, Bulk insert, openrowset and SSIS. My question is a simple one: Do you know of any other ways to Import/Export data using ...
1
vote
0answers
29 views

SSIS Guarantee that all data will be moved to target when running data flows in parallel

My package has the following two tasks which run in parallel. DF - Move source data to target loads a copy of all source data to target via OLEDB Dest - Target and also loads a copy of source PK ...
0
votes
0answers
19 views

Efficient import of 1 million SQL files in Postgresql

I have a huge problem. I have 1 million SQL files varying in size from 9KB to 3MB that I need to import into one table very quickly. The files represent hundreds of billions of rows. Is there a ...
0
votes
2answers
105 views

Whats the best and fast way to import a huge DBF file to a Postgres in Windows?

I have some huge DBF files (about 35 GB) to import to Postgres. Whats the best and fast way to do it? OBS: I have 300 GB of free disk space and 8 GB RAM.
0
votes
1answer
54 views

Import quoted CSV

I have a set of quoted CSV files, which I need to import into SQL Server. Files look like this: "ColA","ColB","ColC" "12345","John Smith","-75.33" "12356","Jane Doe","43.12" BCP and BULK INSERT ...
0
votes
0answers
47 views

MySQL Export not possible to import due to ERROR 1064

we are currently in the progress of moving from MySQL to PG. To do so we are in the progress of setting up a test environment for our database operations. The process is rather simple: We have ...
0
votes
0answers
86 views

Mysql dump import shows error 1556 (HY000) “you can't use locks with log tables”

I'm trying to setup a replication slave for an existent MySQL server. Therefore I dumped all data from the master like this: mysqldump --skip-lock-tables --single-transaction --flush-logs --hex-blob ...
0
votes
1answer
79 views

Can I do an impdp with a file on my local computer

I was given a dump file which is currently on my local computer. I want to import this to our Oracle 11G DB which is hosted on a server. Do I need to move this file to the server to do the impdp or ...
0
votes
1answer
120 views

problems when importing csv files into SQL using SSIS when the columns are not consistent from quarter to quarter

I am using SSIS to upload a bunch of csv tables into SQLexpress. the csv files are quarterly data files. they are largely consistent but every couple of years a column may be added or an existing ...
5
votes
2answers
180 views

Import XML files into SQL Server 2012

Every Friday I have to import a couple (sometimes more than 300) of XML files into 2 tables. The structure of one of the tables, R000000, looks like this: R00000010 | R00000020 | R00000030 | ...
1
vote
1answer
99 views

After Insert Trigger never fires using Import Wizard

Using Import Wizard I tried importing tables tcc_Block and PROJECT_IDENTITY. These 2 table structures already exist in SQL Server and they are related with ProjectID columns. PROJECT_IDENTITY has ...
3
votes
1answer
56 views

Migrating database from old software to new software

I am a young web developer and I am facing a problem I cannot solve on my own and need some help and/or orientation. My client has an agenda (Lotus), which is a very old software, and I have ...
0
votes
3answers
1k views

mongoimport error - Failed: error connecting to db server: no reachable servers

I am currently trying to learn mongodb and I am having trouble finding a solution for this problem. When I run a mongoimport command it I get the following error: ~ mongoimport --host localhost ...
0
votes
1answer
46 views

Import sql structure from sql file which has data

I have a giant sql file that I created from my working server, but have had to shut that server down. I'm trying to import the sql into my test server (very small). I just want to import the table ...
1
vote
0answers
218 views

SQL Server 2014 Import Wizard missing data source option

I have already run the upsizing wizard from my production Access 2010 .accdb database to create all the table structures and move the data on to our new SQL Server 2014. This included adding some PKs ...
0
votes
2answers
63 views

Mysqlimport very slow when importing two smaller files

I am trying to import a large file, it was really big and it did not seem to be working so I broke it into pieces. The first piece takes 2 minutes, and the second one takes almost an hour!!! How can ...
0
votes
1answer
55 views

Fastest way to sync (or keep import) 3.5TB data from hadoop to sharded mongodb cluster

There are 3.5TB data in our hadoop cluster(yes on hdfs). And we have newly built a sharded mongodb cluster(the latest 3.x) with 3 mongos, 3 configdb and 3 shards(each shard has 1 primary and 2 ...
1
vote
2answers
133 views

Are expdp/impdp commands appropriate for daily schema sync?

I've done following comands: expdp system/password@localdb ^ schemas=SCH directory=dumps_dir dumpfile=SCH_%date%.dmp logfile=expdpSCH_%date%.log It runs great, without errors. But when I use ...
3
votes
1answer
170 views

many csv file loading using bash script

#!/bin/bash # show commands being executed, per debug #set -x # define database connectivity _db="mydata" _db_user="root" _db_password="123" # define directory containing CSV files ...
0
votes
0answers
21 views

MySQL: Automated reinstall, export + import all, for a fresh start?

I have the suspiction that my MySQL installation and all databases are somehow borked. For a fresh start, I would like to create dumps from all the databases, uninstall MySQL, delete the data in ...
0
votes
1answer
146 views

Import (flat file) into SQL Server

I've seen a couple of questions about the subject backfiring so I'll try to be specific about my concern... I have an old (MS Access) frontend I'm trying to rebuild and I left the part that troubles ...
0
votes
2answers
222 views

Fastest way to do bulk import in MYSQL

I have got a question about the fastest way to copy a large number of records (around 10 million) from 1 table to another in MySQL. The target table has 1 primary key, 4 indexes and 3 foreign key ...
0
votes
0answers
140 views

How to know imdp size?

I have a dump file using expdp with compression (oracle version >= 11g). Before running impdp I want to check if there is enough space on the machine but it seems as there is no parameter in the impdp ...
2
votes
1answer
53 views

MySQL Import Super Slow

I'm running MySQL on a HyperV virtual machine. The host has 384Gb of RAM and is nowhere near being fully committed. I've tried giving the VM 128G of RAM and 8 CPU and I've tried 2 CPU's and 32GB of ...
1
vote
1answer
218 views

Import data from one Database to another script

As part of a data migration I would like to script a data transfer from the existing to a new database. I used to do this with DTS on older versions of MS SQL. I am currently using SQL 2012. Note the ...
0
votes
0answers
133 views

Import CSV to MySQL with long text fields

I'm trying to import a CSV file (';' separated) to a MySQL table. Normaly, I use a SQL like: LOAD DATA LOCAL INFILE 'local-path/file.csv' INTO TABLE tmp_table CHARACTER SET latin1 FIELDS TERMINATED ...
0
votes
2answers
214 views

Import a sample database into SQL Server on AWS RDS free tier

I asked this on stack overflow but someone there suggested I try here as I might get better answers. So here goes... I'm signed up to Amazon Web Service (AWS) free tier, which allows you to run some ...
4
votes
3answers
248 views

Oracle - restore a single table

In a large database, an activity was performed to upload the data. Due to some mistake, a month's data was entered again, which was left in the temp holding table. So, to cover this up, we took dump ...
1
vote
0answers
128 views

Is there any way to set the default data source for the SQL Server Import and Export Wizard?

When I launch the SQL Server Import and Export Wizard for SQL Server 2014, the selection in the Data source drop-down defaults to .Net Framework Data Provider for ODBC. This happens regardless of ...
0
votes
0answers
48 views

.dmp file generating problem on oracle

I have a server windows2003 with oracle 10g and developer 6i. My experience is when I install developer 6i first and then install database 10g then .dmp file generate perfectly using imp or exp. but ...
0
votes
2answers
161 views

Unique constraint error Oracle

I have two databases - one is 11g and another 12c. 12c db has the exact data of 11g (expdp/impdp). Now I'm facing an error in one of the tables with unique constraint error. I have checked the ...