Questions tagged [import]

The import of data is the automated or semi-automated input of data sets between different software applications.

Filter by
Sorted by
Tagged with
1
vote
1answer
1k views

How can I import CSV data stored in a bytea?

I have a CSV file that can be loaded into a table easily with COPY FROM, but the catch is that the file is stored in the database in a bytea field. Is the only way to use COPY on this data to write ...
3
votes
2answers
8k views

Character Conversion Issue Importing From CSV File

After doing a load of CSV files, there are various words that are "written" to the database incorrectly. Some examples: Diã¡ria should be Diária Crã©dito should be Crédito Ligaã§ãµes should be ...
0
votes
1answer
92 views

Is there any scenario where a exported (.sql) database dump could be bigger in size, than the database itself?

I'm a developer in a local company, and I'm currently working on a project which involves migrating a website to my company's server, from some other hosting provider. For some reason this other ...
1
vote
0answers
38 views

Replace oldSchema with newSchema in functions

I exported a database called oldDatabase using pg_dump in directory format. This database contains a schema, tables and functions owned by oldRole. These functions contain SQL statements like ...
0
votes
1answer
336 views

Import database from MSSQL export dump on Ubuntu localhost

I have an export file from an online database server that I need to use to generate the database locally on my system. I'm running MSSQL 2017 on Ubuntu 16.04. The export file has Program(application/...
-1
votes
1answer
687 views

Accelerate MySQL import - trigger execution process

I'm Fairly new to Database administration. Currently I have to resolve the following situation. I have a 256MB dump file from a MySQL InnoDB table (aproximately 3 million records) that I have to load ...
0
votes
1answer
2k views

Import issue: Missing columns values from CSV file

I have a problem with the importing of a CSV file to my table in MySQL. The values (3) of the columns (var1, var2, dates) are not loading, as shown in the image below: First I created the table, ...
1
vote
0answers
4k views

Import Dump: Cannot Locate Master Table

I'm trying to import a dump file with the command below: impdp system/password dumpfile=mw0sd1.dmp keep_master=Y But it returns following error: ORA-39002: invalid operation ORA-39059: dump file ...
5
votes
2answers
3k views

Why is my UTF-8 document raising UTF-8 encoding errors in Azure Data Lake Analytics?

I have a document that was compressed in gunzip from a unknown source system. It was downloaded and decompressed using a 7zip console application. The document is a CSV file that appears to be encoded ...
0
votes
1answer
30 views

How to deal with a large database containing zipped files.

(I'm a PhD student in applied math, I know some programming but admittedly I know very little about databases.) My question is: how do I tackle/handle this database? The problem is as follows. I ...
2
votes
1answer
7k views

Oracle 12c export and import schema with different data tablespace and index tablespace

Suppose that I exported the schema objects from my Oracle 12c database using the original export utility as below: exp userid=<export_schema_name>/<export_schema_password>@<db_string&...
0
votes
1answer
192 views

Debuging import of a large dump file to MySQL

I'm trying to import a 50GB dump file to AWS RDS instance and have an issue. I get the following error: ERROR 2013 (HY000) at line 15850: Lost connection to MySQL server during query In the beaning ...
0
votes
2answers
82 views

How to load textfiles into SQL Server Database? [closed]

Sometimes I have to load csv-files to database. These files might be really huge (> 1TB). I did not export them to this file and I cannot change anything about the format. The files just "fly in". ...
1
vote
3answers
6k views

Need FLOAT datatype with 2 digits after decimal point when importing from a CSV file

I am inporting a CSV file into SQL Server using the import/export wizard. The data in the CSV file looks like this: ...0.00,0.00,0.00,0.00,0.00,0.00,0.00,0.00,0.00,0.00,0.00,0.00,164051.00,... All ...
0
votes
1answer
4k views

Mysql ibdata1 is broken

I was importing an old SQL into existing schema. But the MySQL service was stopped suddenly. Now I'm not able to start the service. It seems that the ibdata1 file is somehow corrupted. Here are the ...
0
votes
1answer
2k views

Import dump file schema not found

I want to import a dump file but I have this error: Import: Release 11.2.0.4.0 - Production on Mar. Nov. 28 10:12:56 2017 Copyright (c) 1982, 2011, Oracle and/or its affiliates. All rights reserved....
0
votes
2answers
115 views

Microsoft access to Sql Server Data Migration [closed]

I need to migrate some old MS Access data to a SQL Server Database. Which tool is easier for a newbie to work with: SQL Server Import/Export or Migration assistant for access(SSMA)
0
votes
2answers
973 views

How to export data from a SQL Server database with hundreds of tables and timestamp columns?

I have a SQL Server database with hundreds of tables and they all have timestamp columns. I don't have access to backups or the server's file system. To use the export data wizard, I have to go into ...
22
votes
4answers
15k views

Why is BULK INSERT Considered Dangerous?

I would like to understand why cyber-security teams in general (more than one organization I've dealt with) is dead set against granting BULK INSERT (e.g. TSQL) rights to applications and database ...
3
votes
1answer
843 views

T-SQL: CSV->table pipeline with custom parsed numeric data, lookup values

Problem Wish to insert thousands of records into a table [Child] from a CSV file (and do this from tens of files into the same table). However, I want to A. substitute a lookup value into the table (...
7
votes
2answers
23k views

Import from Access .accdb file to SQL Server [duplicate]

How to import data from Access .accdb file to SQL Server? What should I choose in SQL Server Import and Export Wizard? Suppose we choose OLE DB Provider for SQL Server Integration Services, then if ...
2
votes
1answer
5k views

Import Oracle .dmp with error 1659, unable to allocate MINEXTENTS beyond 3 in tablespace SYSTEM

I'm trying to importing an Oracle DUMP file (v10.2) into Oracle Express 11.2.0.2.0. I was getting some schema errors and resoled them by following other posts here. Now I'm getting this error and I'm ...
3
votes
1answer
26k views

Import Data from 48 GB csv File to SQL Server

I am importing huge data file of size around 48 gb using SQL Server default Import Tool. It keeps on executing fine for app. 13000000 Row insertions but after it the Task Fails with following error. ...
1
vote
2answers
508 views

Performance issues on large CSV import with before INSERT trigger

I am doing import csv file using load into file. The files are big and contains minimum 500K+ lines of records and table extend day by day. Each line is just a phone number and nothing else. My table ...
-1
votes
1answer
204 views

Navicat: import data from another server without problems

I have a table on another server that is formatted with millions of rows like this. +-------+-----+------+ | Name | Age | Type | +-------+-----+------+ | Adam | 29 | A | | Bob | 18 | B | |...
1
vote
1answer
107 views

Why does my database structure and SELECT operations generate NULLs?

I'm not too experienced with database problems, so please excuse the wall of text, I believe the context is important to understand the problem and goal. I receive a CSV file from another system ...
3
votes
1answer
2k views

Generate DDL Statement from XSD file

I have a database schema exported into XML format. My goal is to create a DDL statement from the XSD files that I can use to import the data into a different platform without manually having to ...
3
votes
2answers
548 views

Merging multple pg_dumps with columns using auto key

I have two unique instances of Postgres using the same database schema but with independent datasets. One of the tables has a column setup for auto increment and it is a primary key. No other tables ...
1
vote
1answer
1k views

Oracle data pump import parallel configuration

I am trying to track down a cause for a difference in oracle impdp processing, and I am not finding anything, so I am wondering if anyone here can explain the cause of the differences. At times I ...
1
vote
0answers
62 views

Protocol for Converting External Unnormalized Data to Normalized Tables

I'm working through the fundamentals of bringing data from Excel (or any single unnormalized form table model) to SQL (MySQL or SQLite). These are the steps I've extrapolated from reading: Import ...
1
vote
1answer
707 views

SSIS - Data Import & export wizard - existing tables

For a project I'm attempting to move data from a view in source to a table in destination. And this will need to be done periodically. The quickest way to do this seems to be a SSIS package (as this ...
0
votes
1answer
703 views

SQL server Import CSV file - 1'st row is also added as s column name

I'm trying to import a CSV file using import export wizard, Im facing an issue. The first row is also added as a column name. Import wizard: The highlighted area is my 1'st row.
2
votes
1answer
758 views

Mysql cannot import from text file

I have a table called person setup like this (person_id SMALLINT UNSIGNED, fname varchar(20), lname varchar(20), gender enum('M','F'), birth_date date, race enum('B','W','A','J'), ethnicity varchar (...
0
votes
2answers
1k views

MySQL Import & Replace via CSV

I have a MySQL database table named items with 10,000+ records. Of these records, I would like to export only records where item_isbn IS NULL. SELECT * FROM Items WHERE item_isbn IS NULL produces a ...
1
vote
1answer
1k views

Oracle 12c Datapump import error

I am importing a database (.dmp) file using the 12c Data Pump import wizard. I created a user for the database and remapped the schema and tablespace. I get the following errors: ORA-39071: Value ...
1
vote
1answer
260 views

RDS import from SQL backup

I'm migrating a SQL 2008 database from a corporate data center to an RDS intance on AWS. So far I have performed a native backup which gave me a .bak file Is it possible to simply upload this to S3 ...
1
vote
1answer
2k views

How can I perform a mongoimport to a host that requires an SSL Certificate?

I am trying to load some sample JSON data into a MongoDB database (hosted on IBM Bluemix). The connection requires SSL, and a SSL Certificate has been provided, but I keep getting an error when I ...
1
vote
1answer
2k views

'LDF' is not a valid database file header. The PageAudit property is incorrect

I 'am trying to import database into sqlserver 2008 using this query EXEC sp_attach_db @dbname = 'LIQ_DEV_V9', @filename1='/home/elsayedawd/DATA/databasedumbs/database9/LIQ_DEV_V9.mdf', @...
0
votes
0answers
500 views

Datapump Import Parallel execution

I have noticed differences in executions between data pump imports lately, and I am trying to determine what is causing the differences. I am using impdp to move data between databases, and remap the ...
2
votes
1answer
2k views

Fast way to import 2GB csv file into SQL Server 2008

I am new to database,I am using SSMS 2008 R2 to import 2GB of data from a .csv file. It is taking around 115mins to import. Can anybody let me know any better way to perform this import.
8
votes
2answers
4k views

SQL Server avoid repeating the collation type multiple times in a query

I have a query which selects rows from a source database (DatabaseA), and inserts them into a target database (Database B). The collation type differs between the databases and they cannot be changed. ...
3
votes
1answer
3k views

Why MySQL ignores foreign keys when importing?

i don't have a big knowledge in database so excuse me if there is bad syntax or bad description but i did my best :) When i importing to child table it ignores foreign key though the parent table is ...
1
vote
1answer
851 views

MySQL: Skip INSERT / UPDATE statement that triggers error but show them in output

I have a million of rows of customers to be imported via SQL dump. Customer data will be inserted into main table customer and child table customer_address The dump contains the following SQL ...
1
vote
0answers
36 views

Importing Archived Records Back to Main Database

I have 2 databases: Current Database & Archive Database. I need to import the archive data back into the main database. There are 174,425,460 records that need to be pushed back to the main ...
2
votes
0answers
6k views

inserting data in temp table with read only database access [closed]

I only have read only access to my company's database (no chance of getting write) and want to import Excel data to a temp table, is this possible? I can create temp tables tied to just my computer, ...
2
votes
1answer
4k views

Failed import of date using COPY

I'm trying to import a CSV file into a table in Postgres, and it's bombing out on the first date field. The dates are in the format dd/mm/yyyy and there isn't a date in the field in question in the ...
-2
votes
1answer
58 views

Manage bulk imports [closed]

How do I set up a rule for my bulk imports, so that if today's import fails, SQL Server will prevent future imports until the issue is resolved? I'm using bulk insert code. The code is calling the ...
4
votes
3answers
3k views

import 100 csv files into postgresql

I have a 100 csv files named sequentially 1,2,3....100.csv I copy the csv files with this script: COPY location FROM 'C:\Program Files\PostgreSQL\9.5\data\´1.csv' DELIMITER ','; I would to ...
3
votes
2answers
1k views

Import poorly formatted CSV/JSON to SQL Server

I am trying to parse Android notification logs into a database. The columns are uneven because different notifications omit certain attributes. Essentially, it is a CSV file of key-value pairs. To put ...
1
vote
1answer
151 views

Processing CSV data on import

I have an externally-produced CSV filled with geographic points and associated data, but I would like to run some functions on the columns before saving them. For example I need to digest longitude/...

1 2
3
4 5
11