Questions tagged [import]
The import of data is the automated or semi-automated input of data sets between different software applications.
0
votes
0answers
8 views
How to know if a sql dump has been already imported?
I am writting a Dockerfile where the entrypoint script checks if any *.sql file present inside initdb.d dir then it import that *.sql file. However as this import mechanism is a part of entrypoint ...
0
votes
1answer
10 views
Oracle12c: Objects attempting to import to original tablespace (despite wanting to remap them)
I've exported a schema from a DB server (Oracle 12.2.0.1.0) using exp with the following command.
exp USERID=FOO/FOO2019 FILE="D:\app\ORACLE\admin\orcl\dpdump\FOO.dmp" LOG=FOO.log
I now want to ...
-2
votes
1answer
26 views
SQL query for import data [closed]
How can I write a single line SQL for importing 20k rows data from Excel to SQL server ?
Please don't tell me about import export wizard or to write 20 line repeatedly for do the same.
Please tell ...
3
votes
2answers
80 views
Structured .TXT Data To A Proper DBMS
I'm presented with multiple .txt documents (each with its own set of columns) containing rows separated by some type of delimiter (which is different across the files). Each .txt file has different ...
0
votes
1answer
23 views
System memory behavior during huge mysql import
I am importing a huge (~900GB ) dump in a mysql 5.5 server;
The system has 48GB of RAM.
Here are my InnoDB settings
innodb_read_io_threads = 16
innodb_write_io_threads = 16 #To ...
1
vote
1answer
32 views
Will the foreign key constraint throw an error while restoring a database?
I have never faced any issue like this, but I am just curious. Let's say I have a database dump file with me and I want to import the dump file to another database.
There are 2 tables table_A and ...
0
votes
1answer
26 views
Query or ETL process to insert data into fact tables in SSMS
I'm working on creating a star schema for my project. I want to use it for reporting. I have used Google Play Store dataset from Kaggle.
The thing that I'm having trouble loading data into my fact ...
1
vote
1answer
33 views
Microsoft SQL Server v13 bulk add users from active directory
I would like to import all users from Active Directory into Security/Users.
What I do is the following:
Go to Security -> Users
Right click Users -> New User...
User type: Windows user, click on '......
0
votes
1answer
44 views
sqlldr not recognizing new line/row
Our organization switched to a new tool and now our text files are generated with only a trailing CR instead of a CR & LF. Now sqlldr thinks all of the data in the file is 1 row. How can I fix ...
5
votes
2answers
405 views
How to import CSV file in SQL server 2008?
I am trying to import a CSV file in SQL Server 2008. BULK INSERT is a way to go but it is applicable for CSV from SQL Server 2014 onwards.
What would be an alternative way to achieve this goal?
Any ...
-1
votes
0answers
17 views
How to import a database knowing the WordPress DB information?
I have a WordPress site in which its files are hosted on server A, however, the database is not on localhost but on server B, so on my wp-config.php I have:
define('DB_NAME', 'theDatabaseName');
...
0
votes
1answer
38 views
Disable foreign key checks during import
I have started a humongous (~800GB sql dump) import to a mysql 5.5.
At some point I realized that while the db was being imported, the progress was starting slowing down as the db size increased;
...
1
vote
0answers
43 views
How to import .dbf files (with more than 256 columns) to SQL Server?
I would need once a month to import 12 .dbf files to SQL Server 2017. Files have dBase III version. They have a similar structure. They have no PK and no unique index and no combination of columns can ...
0
votes
1answer
18 views
mysql (5.5.) cmd unresponsive when selecting a huge db
I had initiated on Friday night a huge (~800G) dump from my machine to a remote host;
Today, (although the command does not seem to have returned yet), I am able to log in to the machine and mysql ...
1
vote
2answers
29 views
Importing huge dumps into a mysql server 5.5
I want to import a couple of huge .sql dumps (~600G each) into a mysql server 5.5 running on an Ubuntu 14.04.
The machine has about 8G of RAM allocated to it;
The previous machine had 128G;
Storage ...
0
votes
1answer
332 views
ORA-39001: ORA-39000: ORA-31640: ORA-27041: and Linux-x86_64 Error: 13: Permission denied [closed]
I used this command to export data:
expdp gsw/password DIRECTORY=gsw DUMPFILE=gsw.dmp logfile=gsw.log SCHEMAS=GSW
Now importing this to other server as:
[root@linux gsw]# impdp gsw/password ...
3
votes
2answers
2k views
Importing large SQL dump with millions of INSERT statements
I need to import a big .sql file (8.1GB when unpacked) into PostgreSQL. I tried to use \i /path/to/file.sql but it is way too slow.
How does one speed up the import? I need to import this data weekly....
0
votes
1answer
179 views
How to correct SQL Server Import and Export Wizard error that says my data conversion length must be between 0 and 4000?
The message I get from the 2017 SQL Server Import and Export Wizard which I need help with is,
"Error 0xc0204016: SSIS.Pipeline: The 'Data Conversion 0 - 0.Outputs[Data Conversion Output].Columns[...
2
votes
0answers
92 views
SQL Server: INSERT-SELECT Statement occasionally fails silently and works upon re-run
We have a batch import process that BULK INSERTs raw data into staging tables, does some data mapping, and then pushes it to another database for validation.
The procedure where my issue occurs is ...
0
votes
1answer
75 views
Oracle 9i import error IMP-00017: following statement failed with ORACLE error 3113
I try to import a schema in my database 9i of copy which is a clone of the original from where I made the export 9i also and when trying to import the schema after many hours gives the following error:...
2
votes
1answer
73 views
Handling variable fields in a CSV file with JSON?
Im trying to figure out the engineering to get a CSV file into PostgreSQL.
Requirements:
The CSV has X number of predetermined required fields
The CSV file has Y number of dynamic fields
Example:
...
0
votes
2answers
119 views
Oracle - Extract user DDL for migration
I need to export and import data from a Oracle 9i to Oracle 12.2 database.
This old app doesn't log in as one privileged user - it logs in for each user. I have hundreds of users with nothing but ...
0
votes
0answers
140 views
Show progress for MySQL import of CSV data
This question says how to show progress of a MySQL restore (ie. rebuild a database from SQL statements) using pv.
However, how do you show progress for an MySQL import (ie. fill a table from CSV data)...
-1
votes
1answer
1k views
Easiest Way to Migrate data from MySQL to MongoDB [closed]
My latest IT project has me working with MongoDB for the first time. While I have a bit (very little) experience with NoSQL, I have always mostly worked with MySQL using Workbench.
I need to migrate ...
1
vote
1answer
48 views
Error while importing full oracle database
I was trying to do full database import. I created tablespaces manually from sql developer DBA option. Then did import but am facing this errror.
Starting "SYSTEM"."SYS_IMPORT_FULL_01": system/****...
2
votes
1answer
25 views
Add Data from Columns Together
I am working on importing data from an old non-relational database, to a new relational one. I am currently working on importing data into the following table:
Table: job_part
job_id INT NOT ...
1
vote
2answers
88 views
foreign key relationships and auto-incrementing in Sql Server
I have two instances of a database with these two tables:
Foo
foo_id <-- primary key
Bar
bar_id <-- primary key
foo_id <-- foreign key
bar_id and foo_id are automatically incremented, ...
0
votes
0answers
136 views
mariadb import from dmp file excessively slow
I have a 32GB dmp file generated by the mysqldump command. I am loading this file into a newly database to server as the slave for a master/slave replication configuration. At the present rate will ...
2
votes
1answer
42 views
How do I bulk load data and still provide row-by-row feedback?
We want to allow our users to import CSVs containing many thousands of records to "pre-load" a particular table in our system. It's not strictly a one-time operation, it may be performed multiple ...
0
votes
1answer
129 views
MySQL user export PASSWORD is showing up as <secret>
I am trying to export all users from old MySQL server to new.
All the methods that I tried shows the PASSWORD as <secret>
pt-show-grants
phpMyAdmin 4.8.1
https://serverfault.com/questions/...
1
vote
0answers
194 views
Import Wikipedia .sql dump very slow
I'm having troubles to import one of the SQl dumps of Wikipedia into a local database. I've downloaded the categorylinks.sql from https://dumps.wikimedia.org/enwiki/latest/ which is around 17GB when ...
0
votes
0answers
31 views
Import MySQL Dump into Database Table with Another Table Name [duplicate]
I have exported the selected records from a table using mysqldump using --no-create-info and --where options.
But the dump contains a statement like
INSERT INTO `table_name` VALUES
I cannot ...
1
vote
0answers
22 views
A way to check Oracle finished sql
I've got Docker Compose cluster and one of the containers is Oracle 12c. There is schema.sql file to initialize the db. I would like my application to wait until the db executes all the sql. How can I ...
1
vote
1answer
260 views
How can I import CSV data stored in a bytea?
I have a CSV file that can be loaded into a table easily with COPY FROM, but the catch is that the file is stored in the database in a bytea field.
Is the only way to use COPY on this data to write ...
0
votes
0answers
45 views
Restoring LARGE MySQL Tables (3GB+) from .ibd, .frm
I am trying to restore two specific MySQL Tables, both which are over 3GB in size. I have been able to resort all my other tables using the CREATE TABLE SPACE, DISCARD TABLE SPACE etc commands.
...
1
vote
2answers
674 views
Character Conversion Issue Importing From CSV File
After doing a load of CSV files, there are various words that are "written" to the database incorrectly.
Some examples:
Diã¡ria should be Diária
Crã©dito should be Crédito
Ligaã§ãµes should be ...
0
votes
0answers
29 views
Data Types :Exporting/Importing between SQL and Excel (Using Wizard).
I have some data tables in Excel that I am trying to export into SQL Server.
and I wonder what types are needed when creating or selecting
AFAIK, the data types in Excel are CDLNT : Currency, ...
0
votes
1answer
38 views
Is there any scenario where a exported (.sql) database dump could be bigger in size, than the database itself?
I'm a developer in a local company, and I'm currently working on a project which involves migrating a website to my company's server, from some other hosting provider.
For some reason this other ...
1
vote
0answers
30 views
Replace oldSchema with newSchema in functions
I exported a database called oldDatabase using pg_dump in directory format. This database contains a schema, tables and functions owned by oldRole. These functions contain SQL statements like
...
0
votes
1answer
166 views
Import database from MSSQL export dump on Ubuntu localhost
I have an export file from an online database server that I need to use to generate the database locally on my system. I'm running MSSQL 2017 on Ubuntu 16.04.
The export file has Program(application/...
0
votes
1answer
225 views
Accelerate MySQL import - trigger execution process
I'm Fairly new to Database administration. Currently I have to resolve the following situation. I have a 256MB dump file from a MySQL InnoDB table (aproximately 3 million records) that I have to load ...
0
votes
1answer
784 views
Import issue: Missing columns values from CSV file
I have a problem with the importing of a CSV file to my table in MySQL. The values (3) of the columns (var1, var2, dates) are not loading, as shown in the image below:
First I created the table,
...
1
vote
0answers
1k views
Import Dump: Cannot Locate Master Table
I'm trying to import a dump file with the command below:
impdp system/password dumpfile=mw0sd1.dmp keep_master=Y
But it returns following error:
ORA-39002: invalid operation
ORA-39059: dump file ...
0
votes
1answer
19 views
How to deal with a large database containing zipped files.
(I'm a PhD student in applied math, I know some programming but admittedly I know very little about databases.)
My question is: how do I tackle/handle this database?
The problem is as follows. I ...
0
votes
0answers
54 views
how to import a 5GB CSV file into MapD Core?
what's the best way to import a 5GB CSV file that's on my laptop into a MapD Core running on another server?
I can figure out the schema, but I would really like a method that detects a reasonable ...
0
votes
0answers
201 views
Importing tab-delimited file with pgloader
I'm trying to import a tab-delimited file with pgloader, with no success. I can't seem to get the syntax correct. I get the following error, despite trying every format I can think of (including the ...
2
votes
1answer
3k views
Oracle 12c export and import schema with different data tablespace and index tablespace
Suppose that I exported the schema objects from my Oracle 12c database using the original export utility as below:
exp userid=<export_schema_name>/<export_schema_password>@<db_string&...
0
votes
1answer
85 views
Debuging import of a large dump file to MySQL
I'm trying to import a 50GB dump file to AWS RDS instance and have an issue. I get the following error:
ERROR 2013 (HY000) at line 15850: Lost connection to MySQL server during query
In the beaning ...
0
votes
2answers
65 views
How to load textfiles into SQL Server Database? [closed]
Sometimes I have to load csv-files to database. These files might be really huge (> 1TB).
I did not export them to this file and I cannot change anything about the format. The files just "fly in".
...
1
vote
3answers
2k views
Need FLOAT datatype with 2 digits after decimal point when importing from a CSV file
I am inporting a CSV file into SQL Server using the import/export wizard. The data in the CSV file looks like this:
...0.00,0.00,0.00,0.00,0.00,0.00,0.00,0.00,0.00,0.00,0.00,0.00,164051.00,...
All ...
