Questions tagged [import]
The import of data is the automated or semi-automated input of data sets between different software applications.
473
questions
2
votes
1answer
22 views
Importing a single large table in Azure
I have an existing DB called MyDb in Azure SQL Server.
I have a bacpac of another DB with several tables in it. I'm interested in importing one single table (that table has no FK, it makes things ...
0
votes
0answers
28 views
How to import db-sample-schemas into Oracle's DB?
I need to import some sample dump file for educational and testing purposes. I've found the next dump file and tried to import it using:
imp testuser/oracle file=/home/oracle/PurchaseOrders.dmp
...
0
votes
2answers
108 views
Importing plain (raw) files into a postgres table (bytea and large objects)
What is a good way to insert/copy plain files into a postgres table, preferrably using the psql command-line?
In my case the files are a bunch of eMails from Maildir archives, so I tried to use COPY: ...
3
votes
0answers
61 views
Extremely long import times from Excel File to SQL Server Management Studio using Import Wizard
I have been importing an excel file with approximately 250,000 rows of data and 40 columns to SSMS on a weekly basis through the Import Wizard. Unfortunately, the import times take around 45 minutes, ...
0
votes
2answers
44 views
Can't see process progress, machine getting slow trying to import 500 million records
Working environment:
PostgreSQL 12.0, Ubuntu 18.10, 4GB memory, i5-3230M CPU @ 2.60GHz × 4, Os 64 bits
I'm trying to import a .csv file with more than 500 million records into a PostgreSQL db table, ...
0
votes
1answer
47 views
Import a large MySQL dump 68GB on RDS instance
I tried to import a large MySQL dump.sql (68GB) on RDS AWS instance MySQL 8.0 (db.t3.2xlarge: 32GB RAM).
The import takes more than six hours:
More than 500 tables
I have 2 large tables: the first ...
0
votes
1answer
73 views
Parse a unix/epoch value as a `TIMESTAMP` in PostgreSQL
PostgreSQL's COPY command is useful to quickly import lots of data, and the data must be in the textual representation for the datatype.
I am importing lots of data, includes a timestamp column, but ...
0
votes
0answers
479 views
mysql to mariadb: unknown collation utf8mb4_0900_ai_ci
I have a mysql 8.0 that I exported using mysqldump. I am trying to import it onto a Mariadb 10.4 database with phpmyadmin, both are the most current versions. Each time I do it though, I get:
Error: ...
4
votes
1answer
194 views
Importing Chinese characters via SSIS
I'm trying to import file that contains Chinese characters into a table. File encoding is Big5 (Traditional).
Here is a sample file like one that I need to import: https://www.pastiebin.com/...
0
votes
0answers
30 views
Import folder with Multiple CSV's into SSMS w/ out SSIS
I am wondering what's the best and most effective way to import csv's stored in a local folder into DB w/ in SSMS.
Folder path- C:\Users\ngutierrez\Desktop\Open_Air_Tables
Folder contains about 30 ...
0
votes
0answers
8 views
Allow only import table in phpmyadmin
We build a wordpress site as a database interface in localhost (only). We are using a plugin WpDataTables to display tables, statistics etc. Is it possible to expose somehow only the import option of ...
0
votes
0answers
59 views
MySQL8 crash recovery from IBD files with import tablespace
Our database MySQL8 crashed due to no space left on the data directory. After we arranged more space the database kept crashing with the error
[ERROR] [MY-013183] [InnoDB] Assertion failure: ...
0
votes
1answer
254 views
Import an xlsx file to Oracle SQL Developer and interpret it as a table
I have an xlsx file with content in the form of a database table - first row is column names, and columns contain varchars2, integers etc.
Since VBA and Excel worksheet functions are too slow for it, ...
0
votes
1answer
28 views
Will exporting tables in one db server to another db server release space in server?
Our production db server mount points are 95% full.There are a few tables which are not required. Hence if I export those tables to our test db server and drop those tables, will it release space in ...
0
votes
1answer
606 views
Importing CSV file into a PostgreSQL table
I am using Python with pandas to import a CSV file into a table in Postgres
import pandas as pd
import psycopg2
from sqlalchemy import create_engine
df = pd.read_csv('products.csv', sep=';', ...
1
vote
2answers
319 views
Postgres \copy command into single column without delimiter
I am trying to import big fixed length files into Postgres and I am using the copy command and a staging table following this guide.
The problem is that this files has a lot of different characters ...
0
votes
1answer
86 views
How to view databases and tables after 'imp' import using Oracle SQL developer
Maybe that's a wrong form of answer...
The problem is:
I've got an Oracle database dump file (very old, created with imp utility)
At last, I've imported it. The command was imp file=E:\Downloads\...
0
votes
0answers
97 views
SQL ERROR [ mysqli ] Can't find FULLTEXT index matching the column list [1191]
I faced this problem after importing the DB, recently i had to setup the fresh one so i used the already taken backup of files & db after importing db this following error shows,
General Error
...
0
votes
1answer
109 views
Permission Error when trying to import SQL [closed]
On an attempt to import an SQL into a Database I get this error.
* Error 0xc002f210: Preparation SQL Task 1: Executing the query "IF NOT EXISTS(SELECT * FROM sys.schemas WHERE name..." failed with ...
0
votes
0answers
22 views
HANA Catalog Import Issue
I'm trying to import a data dump from HANA Enterprise to HANA Express (VM). I use the web-based DB browser.
Having created the a tenant with the same name as my source DB, I'm trying to 'Import ...
0
votes
1answer
376 views
Tablespace 'XXX_SML_INDEX' does not exist using impdb
I am new in oracle. I am trying to import an Oracle database from one machine to another by using a dump file. I'm using the below command for the import
impdp MOBILETEST/MOBILETEST directory=...
2
votes
1answer
566 views
Database size twice as large after mysql dump and re-import
After exporting and re-importing a mysql database, the size of the database on disk appears to be quadrupling in size. Any ideas why this my be?
This is occurring when importing the sql dump right ...
1
vote
1answer
2k views
PostgreSQL \COPY fails “ERROR: missing data for column ”column name2“”
We are importing bulk data i.e millions of records.
We observed that due to a null value for a column , the import is getting failed.
Is there a way we could skip the import error when a record is ...
0
votes
1answer
20 views
Load flat file into a predetermined table
Scenario
Table created
Data in flat file loaded to the table but with errors. please advise how to fix it
(a) 'address' is split to 3 columns causing mismatch between the source and destination
(b)...
1
vote
1answer
40 views
Oracle SQL 11gR2 => find out all dates where “impdp” was performed
Hello my team performed several database Data Pump Import "impdp" over the last two years.
The workflow was always to import all "application" schemas ( The schemas that are used from our ...
0
votes
1answer
62 views
Getting the contents of a json file as a variable in plpgsql?
I have a function based this post by Sean Huber in order to get the content of a file:
CREATE FUNCTION file_read(file text) RETURNS void AS $$
DECLARE
content text;
tmp text;
BEGIN
file := ...
0
votes
2answers
107 views
Import data from excel to table in sql
Please I have issue that when I try to import data from excel to table in SQL it fails with below errors even I modified all the tables in the tables to be nvarchar(max) and I tried to enter dummy ...
0
votes
1answer
43 views
Import database Mysql structure Only
I have a huge dump.sql Mysql database of about 3GB that has the structure and the data
1
vote
1answer
707 views
How to insert very big XML data file to PostgreSQL
I'm using PostgreSQL 9.5 and trying to import XML data file to database.
To load the XML I use this function from here
CREATE OR REPLACE FUNCTION bytea_import(p_path text, p_result out bytea) as
$$
...
1
vote
1answer
130 views
\COPY not returning count psql
I am trying to copy CSV data into tables. Also I want to print the count.
The command I'm using is:
echo "begin; delete from a; \copy a from a.csv CSV HEADER; end;" | psql -hlocalhost -dpostgres -...
2
votes
2answers
1k views
Can't import flat file into SqlServer
I've got this tab-delimited flat file with fifty columns and two million rows. I am trying to import it into Sql Server 2017 Express. (I first tried working with it in Excel... hopeless.)
I see two ...
0
votes
0answers
226 views
MySQL automatic import of (huge) csv files fails using mysqlimport
For testing purposes, I have to insert large Time Series data on a MySQL database, running on a Windows remote server.
Firstly, the (very basic) table:
CREATE TABLE 'sensor_data' (
'...
0
votes
0answers
35 views
mysql: make the server fail instead of just giving warnings
I have a mysql 5.7 server.
I am trying to import some .csv files.
Sometimes it may so happen that these are malformed.
Here is a sample case:
- 'mysql: [Warning] Using a password on the command ...
1
vote
2answers
1k views
postges: psql csv import fails although file exists
Trying to import a csv file as follows:
psql -h 127.0.0.1 -d jira_statistics -U admin -p 5432 -c "COPY bugs FROM '/home/centos/bugs.csv' delimiter '|' csv;"
Password for user admin:
ERROR: could ...
0
votes
1answer
134 views
csv import fails without throwing an error
Ι am trying to import a csv file into an existing mysql 5.7 table.
Here is the command (the db is in docker with bind mount for persistence)
mysql -h 127.0.0.1 -uroot -prootpass --local_infile=1 ...
0
votes
1answer
25 views
Tools to ingest data to database in periods [closed]
We have an application that can work with Oracle or MySql or SQLServer databases. Also, there is a 3rd party data source that we need to have it's latest data records in our database every 15 minutes. ...
0
votes
0answers
1k views
Import .dmp file into Oracle Database
Guys. When I tried to import a .dmp file into a fresh oracle database (sqlplus), I got this error.
dump file "exp_tbs_gxplt01282019.dmp" may be an Data Pump export dump file
My step is:
SQL> ...
0
votes
1answer
129 views
Oracle12c: Objects attempting to import to original tablespace (despite wanting to remap them)
I've exported a schema from a DB server (Oracle 12.2.0.1.0) using exp with the following command.
exp USERID=FOO/FOO2019 FILE="D:\app\ORACLE\admin\orcl\dpdump\FOO.dmp" LOG=FOO.log
I now want to ...
-2
votes
1answer
300 views
SQL query for import data [closed]
How can I write a single line SQL for importing 20k rows data from Excel to SQL server ?
Please don't tell me about import export wizard or to write 20 line repeatedly for do the same.
Please tell ...
3
votes
2answers
198 views
Structured .TXT Data To A Proper DBMS [closed]
I'm presented with multiple .txt documents (each with its own set of columns) containing rows separated by some type of delimiter (which is different across the files). Each .txt file has different ...
-1
votes
1answer
154 views
System memory behavior during huge mysql import
I am importing a huge (~900GB ) dump in a mysql 5.5 server;
The system has 48GB of RAM.
Here are my InnoDB settings
innodb_read_io_threads = 16
innodb_write_io_threads = 16 #To ...
2
votes
1answer
315 views
Will the foreign key constraint throw an error while restoring a database?
I have never faced any issue like this, but I am just curious. Let's say I have a database dump file with me and I want to import the dump file to another database.
There are 2 tables table_A and ...
0
votes
1answer
895 views
Query or ETL process to insert data into fact tables in SSMS
I'm working on creating a star schema for my project. I want to use it for reporting. I have used Google Play Store dataset from Kaggle.
The thing that I'm having trouble loading data into my fact ...
1
vote
1answer
53 views
Microsoft SQL Server v13 bulk add users from active directory
I would like to import all users from Active Directory into Security/Users.
What I do is the following:
Go to Security -> Users
Right click Users -> New User...
User type: Windows user, click on '......
0
votes
1answer
274 views
sqlldr not recognizing new line/row
Our organization switched to a new tool and now our text files are generated with only a trailing CR instead of a CR & LF. Now sqlldr thinks all of the data in the file is 1 row. How can I fix ...
5
votes
2answers
1k views
How to import CSV file in SQL server 2008?
I am trying to import a CSV file in SQL Server 2008. BULK INSERT is a way to go but it is applicable for CSV from SQL Server 2014 onwards.
What would be an alternative way to achieve this goal?
Any ...
0
votes
1answer
2k views
Disable foreign key checks during import
I have started a humongous (~800GB sql dump) import to a mysql 5.5.
At some point I realized that while the db was being imported, the progress was starting slowing down as the db size increased;
...
1
vote
0answers
135 views
How to import .dbf files (with more than 256 columns) to SQL Server?
I would need once a month to import 12 .dbf files to SQL Server 2017. Files have dBase III version. They have a similar structure. They have no PK and no unique index and no combination of columns can ...
0
votes
1answer
34 views
mysql (5.5.) cmd unresponsive when selecting a huge db
I had initiated on Friday night a huge (~800G) dump from my machine to a remote host;
Today, (although the command does not seem to have returned yet), I am able to log in to the machine and mysql ...
1
vote
2answers
80 views
Importing huge dumps into a mysql server 5.5
I want to import a couple of huge .sql dumps (~600G each) into a mysql server 5.5 running on an Ubuntu 14.04.
The machine has about 8G of RAM allocated to it;
The previous machine had 128G;
Storage ...
