Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [import]

The import of data is the automated or semi-automated input of data sets between different software applications.

0
votes
1answer
8 views

Permission Error when trying to import SQL [on hold]

On an attempt to import an SQL into a Database I get this error. * Error 0xc002f210: Preparation SQL Task 1: Executing the query "IF NOT EXISTS(SELECT * FROM sys.schemas WHERE name..." failed with ...
0
votes
0answers
7 views

HANA Catalog Import Issue

I'm trying to import a data dump from HANA Enterprise to HANA Express (VM). I use the web-based DB browser. Having created the a tenant with the same name as my source DB, I'm trying to 'Import ...
0
votes
1answer
43 views

Tablespace 'XXX_SML_INDEX' does not exist using impdb

I am new in oracle. I am trying to import an Oracle database from one machine to another by using a dump file. I'm using the below command for the import impdp MOBILETEST/MOBILETEST directory=...
1
vote
1answer
55 views

Database size twice as large after mysql dump and re-import

After exporting and re-importing a mysql database, the size of the database on disk appears to be quadrupling in size. Any ideas why this my be? This is occurring when importing the sql dump right ...
0
votes
1answer
61 views

PostgreSQL \COPY fails “ERROR: missing data for column ”column name2“”

We are importing bulk data i.e millions of records. We observed that due to a null value for a column , the import is getting failed. Is there a way we could skip the import error when a record is ...
0
votes
1answer
20 views

Load flat file into a predetermined table

Scenario Table created Data in flat file loaded to the table but with errors. please advise how to fix it (a) 'address' is split to 3 columns causing mismatch between the source and destination (b)...
1
vote
1answer
22 views

Oracle SQL 11gR2 => find out all dates where “impdp” was performed

Hello my team performed several database Data Pump Import "impdp" over the last two years. The workflow was always to import all "application" schemas ( The schemas that are used from our ...
0
votes
1answer
27 views

Getting the contents of a json file as a variable in plpgsql?

I have a function based this post by Sean Huber in order to get the content of a file: CREATE FUNCTION file_read(file text) RETURNS void AS $$ DECLARE content text; tmp text; BEGIN file := ...
0
votes
1answer
29 views

Import data from excel to table in sql

Please I have issue that when I try to import data from excel to table in SQL it fails with below errors even I modified all the tables in the tables to be nvarchar(max) and I tried to enter dummy ...
0
votes
0answers
19 views

Import GeoJSON as sqlgeography

I have well over 16,000 Australian postcodes with GeoJSON describing each of postocdes boundaries. Most boundaries are simple polygons but there are some boundaries that consist out of multiple ...
0
votes
1answer
26 views

Import database Mysql structure Only

I have a huge dump.sql Mysql database of about 3GB that has the structure and the data
1
vote
1answer
223 views

How to insert very big XML data file to PostgreSQL

I'm using PostgreSQL 9.5 and trying to import XML data file to database. To load the XML I use this function from here CREATE OR REPLACE FUNCTION bytea_import(p_path text, p_result out bytea) as $$ ...
1
vote
1answer
43 views

\COPY not returning count psql

I am trying to copy CSV data into tables. Also I want to print the count. The command I'm using is: echo "begin; delete from a; \copy a from a.csv CSV HEADER; end;" | psql -hlocalhost -dpostgres -...
2
votes
2answers
109 views

Can't import flat file into SqlServer

I've got this tab-delimited flat file with fifty columns and two million rows. I am trying to import it into Sql Server 2017 Express. (I first tried working with it in Excel... hopeless.) I see two ...
0
votes
0answers
48 views

MySQL automatic import of (huge) csv files fails using mysqlimport

For testing purposes, I have to insert large Time Series data on a MySQL database, running on a Windows remote server. Firstly, the (very basic) table: CREATE TABLE 'sensor_data' ( '...
0
votes
0answers
22 views

mysql: make the server fail instead of just giving warnings

I have a mysql 5.7 server. I am trying to import some .csv files. Sometimes it may so happen that these are malformed. Here is a sample case: - 'mysql: [Warning] Using a password on the command ...
0
votes
2answers
370 views

postges: psql csv import fails although file exists

Trying to import a csv file as follows: psql -h 127.0.0.1 -d jira_statistics -U admin -p 5432 -c "COPY bugs FROM '/home/centos/bugs.csv' delimiter '|' csv;" Password for user admin: ERROR: could ...
0
votes
1answer
38 views

csv import fails without throwing an error

Ι am trying to import a csv file into an existing mysql 5.7 table. Here is the command (the db is in docker with bind mount for persistence) mysql -h 127.0.0.1 -uroot -prootpass --local_infile=1 ...
0
votes
1answer
23 views

Tools to ingest data to database in periods [closed]

We have an application that can work with Oracle or MySql or SQLServer databases. Also, there is a 3rd party data source that we need to have it's latest data records in our database every 15 minutes. ...
0
votes
0answers
292 views

Import .dmp file into Oracle Database

Guys. When I tried to import a .dmp file into a fresh oracle database (sqlplus), I got this error. dump file "exp_tbs_gxplt01282019.dmp" may be an Data Pump export dump file My step is: SQL> ...
1
vote
0answers
48 views

Impdp (Oracle 12c) on Ubuntu 16.04

I am trying to import a dump into Oracle 12c by using the below command: impdp SROUSER/<password> directory=dump_dir dumpfile=SROUSER.dmp logfile=dp.log full=yes Which is resulting in the ...
0
votes
0answers
10 views

How to know if a sql dump has been already imported?

I am writting a Dockerfile where the entrypoint script checks if any *.sql file present inside initdb.d dir then it import that *.sql file. However as this import mechanism is a part of entrypoint ...
0
votes
1answer
56 views

Oracle12c: Objects attempting to import to original tablespace (despite wanting to remap them)

I've exported a schema from a DB server (Oracle 12.2.0.1.0) using exp with the following command. exp USERID=FOO/FOO2019 FILE="D:\app\ORACLE\admin\orcl\dpdump\FOO.dmp" LOG=FOO.log I now want to ...
-2
votes
1answer
79 views

SQL query for import data [closed]

How can I write a single line SQL for importing 20k rows data from Excel to SQL server ? Please don't tell me about import export wizard or to write 20 line repeatedly for do the same. Please tell ...
3
votes
2answers
123 views

Structured .TXT Data To A Proper DBMS [closed]

I'm presented with multiple .txt documents (each with its own set of columns) containing rows separated by some type of delimiter (which is different across the files). Each .txt file has different ...
0
votes
1answer
77 views

System memory behavior during huge mysql import

I am importing a huge (~900GB ) dump in a mysql 5.5 server; The system has 48GB of RAM. Here are my InnoDB settings innodb_read_io_threads = 16 innodb_write_io_threads = 16 #To ...
1
vote
1answer
117 views

Will the foreign key constraint throw an error while restoring a database?

I have never faced any issue like this, but I am just curious. Let's say I have a database dump file with me and I want to import the dump file to another database. There are 2 tables table_A and ...
0
votes
1answer
201 views

Query or ETL process to insert data into fact tables in SSMS

I'm working on creating a star schema for my project. I want to use it for reporting. I have used Google Play Store dataset from Kaggle. The thing that I'm having trouble loading data into my fact ...
1
vote
1answer
48 views

Microsoft SQL Server v13 bulk add users from active directory

I would like to import all users from Active Directory into Security/Users. What I do is the following: Go to Security -> Users Right click Users -> New User... User type: Windows user, click on '......
0
votes
1answer
63 views

sqlldr not recognizing new line/row

Our organization switched to a new tool and now our text files are generated with only a trailing CR instead of a CR & LF. Now sqlldr thinks all of the data in the file is 1 row. How can I fix ...
5
votes
2answers
614 views

How to import CSV file in SQL server 2008?

I am trying to import a CSV file in SQL Server 2008. BULK INSERT is a way to go but it is applicable for CSV from SQL Server 2014 onwards. What would be an alternative way to achieve this goal? Any ...
0
votes
1answer
336 views

Disable foreign key checks during import

I have started a humongous (~800GB sql dump) import to a mysql 5.5. At some point I realized that while the db was being imported, the progress was starting slowing down as the db size increased; ...
1
vote
0answers
85 views

How to import .dbf files (with more than 256 columns) to SQL Server?

I would need once a month to import 12 .dbf files to SQL Server 2017. Files have dBase III version. They have a similar structure. They have no PK and no unique index and no combination of columns can ...
0
votes
1answer
25 views

mysql (5.5.) cmd unresponsive when selecting a huge db

I had initiated on Friday night a huge (~800G) dump from my machine to a remote host; Today, (although the command does not seem to have returned yet), I am able to log in to the machine and mysql ...
1
vote
2answers
42 views

Importing huge dumps into a mysql server 5.5

I want to import a couple of huge .sql dumps (~600G each) into a mysql server 5.5 running on an Ubuntu 14.04. The machine has about 8G of RAM allocated to it; The previous machine had 128G; Storage ...
1
vote
1answer
1k views

ORA-39001: ORA-39000: ORA-31640: ORA-27041: and Linux-x86_64 Error: 13: Permission denied [closed]

I used this command to export data: expdp gsw/password DIRECTORY=gsw DUMPFILE=gsw.dmp logfile=gsw.log SCHEMAS=GSW Now importing this to other server as: [root@linux gsw]# impdp gsw/password ...
4
votes
2answers
2k views

Importing large SQL dump with millions of INSERT statements

I need to import a big .sql file (8.1GB when unpacked) into PostgreSQL. I tried to use \i /path/to/file.sql but it is way too slow. How does one speed up the import? I need to import this data weekly....
0
votes
1answer
288 views

How to correct SQL Server Import and Export Wizard error that says my data conversion length must be between 0 and 4000?

The message I get from the 2017 SQL Server Import and Export Wizard which I need help with is, "Error 0xc0204016: SSIS.Pipeline: The 'Data Conversion 0 - 0.Outputs[Data Conversion Output].Columns[...
2
votes
0answers
144 views

SQL Server: INSERT-SELECT Statement occasionally fails silently and works upon re-run

We have a batch import process that BULK INSERTs raw data into staging tables, does some data mapping, and then pushes it to another database for validation. The procedure where my issue occurs is ...
0
votes
1answer
102 views

Oracle 9i import error IMP-00017: following statement failed with ORACLE error 3113

I try to import a schema in my database 9i of copy which is a clone of the original from where I made the export 9i also and when trying to import the schema after many hours gives the following error:...
2
votes
1answer
107 views

Handling variable fields in a CSV file with JSON?

Im trying to figure out the engineering to get a CSV file into PostgreSQL. Requirements: The CSV has X number of predetermined required fields The CSV file has Y number of dynamic fields Example: ...
0
votes
2answers
298 views

Oracle - Extract user DDL for migration

I need to export and import data from a Oracle 9i to Oracle 12.2 database. This old app doesn't log in as one privileged user - it logs in for each user. I have hundreds of users with nothing but ...
-1
votes
1answer
3k views

Easiest Way to Migrate data from MySQL to MongoDB [closed]

My latest IT project has me working with MongoDB for the first time. While I have a bit (very little) experience with NoSQL, I have always mostly worked with MySQL using Workbench. I need to migrate ...
1
vote
1answer
151 views

Error while importing full oracle database

I was trying to do full database import. I created tablespaces manually from sql developer DBA option. Then did import but am facing this errror. Starting "SYSTEM"."SYS_IMPORT_FULL_01": system/****...
2
votes
1answer
29 views

Add Data from Columns Together

I am working on importing data from an old non-relational database, to a new relational one. I am currently working on importing data into the following table: Table: job_part job_id INT NOT ...
1
vote
2answers
304 views

foreign key relationships and auto-incrementing in Sql Server

I have two instances of a database with these two tables: Foo foo_id <-- primary key Bar bar_id <-- primary key foo_id <-- foreign key bar_id and foo_id are automatically incremented, ...
2
votes
1answer
58 views

How do I bulk load data and still provide row-by-row feedback?

We want to allow our users to import CSVs containing many thousands of records to "pre-load" a particular table in our system. It's not strictly a one-time operation, it may be performed multiple ...
0
votes
1answer
202 views

MySQL user export PASSWORD is showing up as <secret>

I am trying to export all users from old MySQL server to new. All the methods that I tried shows the PASSWORD as <secret> pt-show-grants phpMyAdmin 4.8.1 https://serverfault.com/questions/...
1
vote
1answer
260 views

Import Wikipedia .sql dump very slow

I'm having troubles to import one of the SQl dumps of Wikipedia into a local database. I've downloaded the categorylinks.sql from https://dumps.wikimedia.org/enwiki/latest/ which is around 17GB when ...
1
vote
0answers
22 views

A way to check Oracle finished sql

I've got Docker Compose cluster and one of the containers is Oracle 12c. There is schema.sql file to initialize the db. I would like my application to wait until the db executes all the sql. How can I ...