Questions tagged [import]
The import of data is the automated or semi-automated input of data sets between different software applications.
505
questions
0
votes
1answer
29 views
Importing files with a mix of decimal separators
Using SQL Server Management Studio 18.3 I want to import data (semicolon separated text file) that has some columns with dot as decimal separator, and some with comma as decimal separator. I can't ...
0
votes
0answers
9 views
Importing xml data to postgres database table
I used the following script to import data from xml to postgres db table-
DO $$
DECLARE xml_string xml;
BEGIN
xml_string := XMLPARSE(DOCUMENT convert_from(pg_read_file('C:\\Users\\pink\\Desktop\\...
1
vote
1answer
29 views
MongoDB + Compass exporting strings and numbers “columns” with value of 1 as “true”(boolean) and 2 or null as “false” to CSV
When I export my MongoDB collection to a CSV, the String and Number "column" data types values are converted to "true" for 1 and "false" for 2 and null - how do I retain ...
0
votes
0answers
6 views
Seed data in mysql for e2e testing using tables backups
I'm using cypress for e2e tests and I currently seed the database for each test using sql files.
The problem is that seeding many sql files adds up and take a significant amount of time
Currently I'm ...
1
vote
3answers
74 views
Japanese characters in VARCHAR column using Japanese_Unicode_CI_AS
I am loading a table with the Japanese names from CSV file that are changing into question marks into SQL Table. The table that is storing these values is a varchar column. I understand that the ...
0
votes
2answers
22 views
importing postgres tar file throws parallel not supported in postgres 12
I'm trying to import a db that someone sent me: testdb.tar (43GB size)
First I've imported using:
pg_restore --host localhost --port 5432 --username postgres --dbname testdb --role postgres --no-...
1
vote
0answers
31 views
oralce import joinning 2 tables using query
Is it possible to join 2 tables inside the query in oracle while importing ? I have a dump for 2 tables tab1 and tab2. and I am trying to query on 1 of the tables:
Directory=backup
DUMPFILE=twotables....
0
votes
0answers
21 views
mysqlimport and avoiding table lock
I reviewed the question & answer here (mysqlimport locks all tables system wide) but I seem to still be stuck on this.
I am standing up a new master/slave pair of 5.7 servers, and have already ...
-1
votes
1answer
86 views
Oracle 11gR2 - Export - Import (expdp, impdp) How To Exclude A Table Partiton And This Table's Indexes
I have a table partition (135GB) and index partition on this table (total=150GB) and I want to exclude owner schema of this table and indexes with excluding this table partition and it's indexes.
What ...
2
votes
2answers
168 views
How to Skip Existing Data While Restoring mysqldump File?
I use this query to import data using MySQL Dump (Command Prompt / Command Line)
mysql -u root -p database_name < database_name.sql
I want to import the large database (only new deltas) as of now ...
0
votes
1answer
123 views
Large MySQL import stuck at “Waiting for table flush”
Two weeks ago (!) I started a large import (dump sql file is 540GB). Now the import is stuck at this state:
"show processlist" shows: Command = "Field List", State="Waiting ...
0
votes
1answer
142 views
Windows 10, SQLServer Express (2019), Excel 2016 import to SQLServer error Microsoft.ACE.OLEDB.12.0’ provider is not registered on the local machine
Environment:
Workstation: 16GB RAM. 500MB SSD
Windows 10 Pro (64-bit)
Microsoft Office 2010? 2016? (Home/Student?) Not sure how to tell exactly. Office reports the version as 18.2005.1191.0 ; Excel ...
1
vote
1answer
87 views
mysql: slow import
I have a 83GB compressed .sql.gz file that I'm importing. The DB size on the source server (the size of the folder) was 240GB.
I'm importing it on a Amazon cloud server, with 2CPUs, 4GM RAM and SSD ...
1
vote
1answer
97 views
Copy csv file into different schema [closed]
I need to import data from a csv file which from database a schema a into another database b schema b.
I used the pgAdmin running the export and when I import the data using the same tool pgAdmin and/...
0
votes
2answers
47 views
How Are SQL Server Clients Connecting?
I am asking two questions in this post. If I see activity in netstat with port 1433 for an unnamed instance, whose tcp addresses are not enabled, what does that mean?
What is the preferred way to ...
0
votes
2answers
122 views
How can I force the MySQL client to output to stdout or a log file when importing a SQL file?
Let's say I am importing a small SQL file using the MySQL client like so:
mysql < 10k-file.sql
The mysql client does not output anything. How can I force it to show how many rows are affected for ...
1
vote
0answers
861 views
Persistent problems importing CSV files via pgAdmin 4 to PostgreSQL 12 on Mac OS - Failing with Exit Code -6
I've been trying for several days to import CSV files into a PostgreSQL 12 database hosted on Mac OS 10.15.5, using the Import/Export tool in pgAdmin 4. I am consistently getting an error message ...
0
votes
0answers
201 views
Attempted to import .csv into mySQL using workbench, but only imports 7 rows?
To start, I'm still a relative SQL noob so this question could have an obvious answer that I'm just missing. I'm trying to start a big practice project in my spare time using a dataset which has ~...
0
votes
1answer
160 views
MS SQL Server: Import Flat File with auto-increment ID
So I've downloaded a sample database. It originally didn't have an ID column so I inserted one in through Excel. Anyways, I went through DatabaseName > Tasks > Import Flat File and the usual ...
0
votes
1answer
2k views
PostgreSQL: date/time field value out of range
Software:
Linux cjz-eshop1-p 5.4.0-33-generic #37-Ubuntu SMP Thu May 21 12:53:59 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
psql (PostgreSQL) 12.3 (Ubuntu 12.3-1.pgdg18.04+1)
I am getting errors due to ...
2
votes
0answers
133 views
Data-tier .bacpac import keeps failing
Within a container, I have SqlServer running in a docker container. It was created like so:
docker run -e "ACCEPT_EULA=Y" -e "MSSQL_SA_PASSWORD=$1" -p 1433:1433 --name sql1 -v sql1-sqlvolume:/var/opt/...
0
votes
2answers
713 views
How to import multiple CSV files to a postgres table using pgadmin or other method?
I'm looking to import a folder of over 100+ csv files into one table on PostgreSQL using pgadmin. I have the following script but is there a way to change the file path to all csvs?
COPY schema.table ...
0
votes
1answer
60 views
How can I monitor the import progress of a large CSV File in mysql?
I am trying to import an existing CSV file into my database and I want to see the progress. I usually use pipe viewer when I do my sql files but for csv files I cannot figure out how to do it.
I use ...
0
votes
0answers
84 views
cannot create trigger without super privilege even though bin_log is off
I'm trying to import a magento 2 database dump to a MariaDB 10.1 server however it's asking me to provide SUPER privilege in order to finish the import.
It fails with the message
ERROR 1227 (42000) ...
0
votes
2answers
594 views
Data truncation: Incorrect datetime value: '7/21/15' for column 'announced_on' at row 1
I am importing a flat file into a table in DBeaver v7.0.2. When I attempt to import, it's throwing an error for date field formatted as mm/dd/yy.
The date column in the table is defined with ...
0
votes
1answer
363 views
MySQL Workbench: I need to update values in a table based on values from a csv
Newbie Problem, but I've tried creating a new table and importing the csv to that then updating, but I have been having trouble with that, any guidance would be greatly appreciated.
I have a csv file ...
0
votes
1answer
250 views
Can't find any tables after psql dump import from pgexercises.com [closed]
I'm trying to import the database used for the PostgreSQL exercises at pgexercises.com.
I ran the following command as recommended, and it went through without errors and even showing Inserts with ...
0
votes
0answers
91 views
Exporting from Oracle Cloud, importing on local database
I am currently experiemting with oracle databases.
I have a free tier at Oracle Cloud, with a free instance of autonomous database.
As I like to have my backups locally I did an export, basically ...
0
votes
1answer
20 views
How extract cldr timezones from xml file to store in a DB table? [closed]
In our DB, I need each location to be associated with a "timezone".
These timezones are in https://github.com/unicode-org/cldr/blob/release-36-1/common/supplemental/metaZones.xml
I want to make a ...
0
votes
1answer
52 views
Error import postgres database
I have a databse dump db.sql.schema
I import it using psql -U user dbname < ~/db.sql.schema
After import in my DB I see table mytable but not mytable_id_seq.
# \d mytable
Table mytable
...
0
votes
1answer
169 views
Mysql CSV import when using LOAD DATA LOCAL INFILE only imports half of the rows
I am doing an import with below code and it works but only imports every second row (1,3,5,7...) and only imports half the total csv contents at the end.
LOAD DATA LOCAL INFILE "'.$file.'"
INTO TABLE ...
0
votes
2answers
332 views
mysqlimport imports NULL values unwantedly as int 0
I would like to understand how to create a decent back-up file by using mysql and mysqlimport. I know that I can use mysqldump and mysql, but I'm learning to use the combination: mysql and mysqlimport....
0
votes
1answer
28 views
How can I import multiple .xlsx and .xls files into multiple tables in Access?
I have 100 .xslx and .xls files with different formats and I need to import them all separately into Access keeping their original file names intact.
Folder example:
C:\Users\username\Desktop\...
0
votes
1answer
70 views
Filemaker Database. How to import to one table then copy information to a different table and populate realted tables
I'm using filemaker to create a union membership database, the problem i'm having is that you can't import files into related tables. Basically i'm trying to figure out how I could import an excel ...
5
votes
2answers
1k views
Shall I use enum when are too many “categories” with PostgreSQL?
Problem
I plan to load a CSV with more 10 million records into PostgreSQL v12.1, one of its columns has "categorical" values, so creating an enumerated type for it seems to be a good choice, but it ...
2
votes
1answer
131 views
Importing a single large table in Azure
I have an existing DB called MyDb in Azure SQL Server.
I have a bacpac of another DB with several tables in it. I'm interested in importing one single table (that table has no FK, it makes things ...
0
votes
0answers
112 views
How to import db-sample-schemas into Oracle's DB?
I need to import some sample dump file for educational and testing purposes. I've found the next dump file and tried to import it using:
imp testuser/oracle file=/home/oracle/PurchaseOrders.dmp
...
0
votes
2answers
959 views
Importing plain (raw) files into a postgres table (bytea and large objects)
What is a good way to insert/copy plain files into a postgres table, preferrably using the psql command-line?
In my case the files are a bunch of eMails from Maildir archives, so I tried to use COPY: ...
3
votes
0answers
208 views
Extremely long import times from Excel File to SQL Server Management Studio using Import Wizard
I have been importing an excel file with approximately 250,000 rows of data and 40 columns to SSMS on a weekly basis through the Import Wizard. Unfortunately, the import times take around 45 minutes, ...
0
votes
2answers
75 views
Can't see process progress, machine getting slow trying to import 500 million records
Working environment:
PostgreSQL 12.0, Ubuntu 18.10, 4GB memory, i5-3230M CPU @ 2.60GHz × 4, Os 64 bits
I'm trying to import a .csv file with more than 500 million records into a PostgreSQL db table, ...
0
votes
1answer
183 views
Import a large MySQL dump 68GB on RDS instance
I tried to import a large MySQL dump.sql (68GB) on RDS AWS instance MySQL 8.0 (db.t3.2xlarge: 32GB RAM).
The import takes more than six hours:
More than 500 tables
I have 2 large tables: the first ...
0
votes
1answer
402 views
Parse a unix/epoch value as a `TIMESTAMP` in PostgreSQL
PostgreSQL's COPY command is useful to quickly import lots of data, and the data must be in the textual representation for the datatype.
I am importing lots of data, includes a timestamp column, but ...
4
votes
0answers
3k views
mysql to mariadb: unknown collation utf8mb4_0900_ai_ci
I have a mysql 8.0 that I exported using mysqldump. I am trying to import it onto a Mariadb 10.4 database with phpmyadmin, both are the most current versions. Each time I do it though, I get:
Error: ...
4
votes
1answer
843 views
Importing Chinese characters via SSIS
I'm trying to import file that contains Chinese characters into a table. File encoding is Big5 (Traditional).
Here is a sample file like one that I need to import: https://www.pastiebin.com/...
0
votes
0answers
42 views
Import folder with Multiple CSV's into SSMS w/ out SSIS
I am wondering what's the best and most effective way to import csv's stored in a local folder into DB w/ in SSMS.
Folder path- C:\Users\ngutierrez\Desktop\Open_Air_Tables
Folder contains about 30 ...
0
votes
0answers
171 views
MySQL8 crash recovery from IBD files with import tablespace
Our database MySQL8 crashed due to no space left on the data directory. After we arranged more space the database kept crashing with the error
[ERROR] [MY-013183] [InnoDB] Assertion failure: ...
0
votes
1answer
820 views
Import an xlsx file to Oracle SQL Developer and interpret it as a table
I have an xlsx file with content in the form of a database table - first row is column names, and columns contain varchars2, integers etc.
Since VBA and Excel worksheet functions are too slow for it, ...
0
votes
1answer
29 views
Will exporting tables in one db server to another db server release space in server?
Our production db server mount points are 95% full.There are a few tables which are not required. Hence if I export those tables to our test db server and drop those tables, will it release space in ...
0
votes
1answer
2k views
Importing CSV file into a PostgreSQL table
I am using Python with pandas to import a CSV file into a table in Postgres
import pandas as pd
import psycopg2
from sqlalchemy import create_engine
df = pd.read_csv('products.csv', sep=';', ...
1
vote
2answers
697 views
Postgres \copy command into single column without delimiter
I am trying to import big fixed length files into Postgres and I am using the copy command and a staging table following this guide.
The problem is that this files has a lot of different characters ...
