Questions tagged [import]

The import of data is the automated or semi-automated input of data sets between different software applications.

Filter by
Sorted by
Tagged with
2
votes
1answer
1k views

Generate DDL Statement from XSD file

I have a database schema exported into XML format. My goal is to create a DDL statement from the XSD files that I can use to import the data into a different platform without manually having to ...
2
votes
2answers
375 views

Merging multple pg_dumps with columns using auto key

I have two unique instances of Postgres using the same database schema but with independent datasets. One of the tables has a column setup for auto increment and it is a primary key. No other tables ...
1
vote
1answer
977 views

Oracle data pump import parallel configuration

I am trying to track down a cause for a difference in oracle impdp processing, and I am not finding anything, so I am wondering if anyone here can explain the cause of the differences. At times I ...
1
vote
0answers
45 views

Protocol for Converting External Unnormalized Data to Normalized Tables

I'm working through the fundamentals of bringing data from Excel (or any single unnormalized form table model) to SQL (MySQL or SQLite). These are the steps I've extrapolated from reading: Import ...
1
vote
1answer
607 views

SSIS - Data Import & export wizard - existing tables

For a project I'm attempting to move data from a view in source to a table in destination. And this will need to be done periodically. The quickest way to do this seems to be a SSIS package (as this ...
0
votes
1answer
600 views

SQL server Import CSV file - 1'st row is also added as s column name

I'm trying to import a CSV file using import export wizard, Im facing an issue. The first row is also added as a column name. Import wizard: The highlighted area is my 1'st row.
2
votes
1answer
606 views

Mysql cannot import from text file

I have a table called person setup like this (person_id SMALLINT UNSIGNED, fname varchar(20), lname varchar(20), gender enum('M','F'), birth_date date, race enum('B','W','A','J'), ethnicity varchar (...
0
votes
2answers
880 views

MySQL Import & Replace via CSV

I have a MySQL database table named items with 10,000+ records. Of these records, I would like to export only records where item_isbn IS NULL. SELECT * FROM Items WHERE item_isbn IS NULL produces a ...
1
vote
1answer
976 views

Oracle 12c Datapump import error

I am importing a database (.dmp) file using the 12c Data Pump import wizard. I created a user for the database and remapped the schema and tablespace. I get the following errors: ORA-39071: Value ...
1
vote
1answer
251 views

RDS import from SQL backup

I'm migrating a SQL 2008 database from a corporate data center to an RDS intance on AWS. So far I have performed a native backup which gave me a .bak file Is it possible to simply upload this to S3 ...
0
votes
1answer
2k views

How can I perform a mongoimport to a host that requires an SSL Certificate?

I am trying to load some sample JSON data into a MongoDB database (hosted on IBM Bluemix). The connection requires SSL, and a SSL Certificate has been provided, but I keep getting an error when I ...
1
vote
1answer
2k views

'LDF' is not a valid database file header. The PageAudit property is incorrect

I 'am trying to import database into sqlserver 2008 using this query EXEC sp_attach_db @dbname = 'LIQ_DEV_V9', @filename1='/home/elsayedawd/DATA/databasedumbs/database9/LIQ_DEV_V9.mdf', @...
0
votes
0answers
455 views

Datapump Import Parallel execution

I have noticed differences in executions between data pump imports lately, and I am trying to determine what is causing the differences. I am using impdp to move data between databases, and remap the ...
2
votes
1answer
1k views

Fast way to import 2GB csv file into SQL Server 2008

I am new to database,I am using SSMS 2008 R2 to import 2GB of data from a .csv file. It is taking around 115mins to import. Can anybody let me know any better way to perform this import.
8
votes
2answers
3k views

SQL Server avoid repeating the collation type multiple times in a query

I have a query which selects rows from a source database (DatabaseA), and inserts them into a target database (Database B). The collation type differs between the databases and they cannot be changed. ...
3
votes
1answer
3k views

Why MySQL ignores foreign keys when importing?

i don't have a big knowledge in database so excuse me if there is bad syntax or bad description but i did my best :) When i importing to child table it ignores foreign key though the parent table is ...
1
vote
1answer
740 views

MySQL: Skip INSERT / UPDATE statement that triggers error but show them in output

I have a million of rows of customers to be imported via SQL dump. Customer data will be inserted into main table customer and child table customer_address The dump contains the following SQL ...
1
vote
0answers
35 views

Importing Archived Records Back to Main Database

I have 2 databases: Current Database & Archive Database. I need to import the archive data back into the main database. There are 174,425,460 records that need to be pushed back to the main ...
2
votes
0answers
5k views

inserting data in temp table with read only database access [closed]

I only have read only access to my company's database (no chance of getting write) and want to import Excel data to a temp table, is this possible? I can create temp tables tied to just my computer, ...
1
vote
1answer
3k views

Failed import of date using COPY

I'm trying to import a CSV file into a table in Postgres, and it's bombing out on the first date field. The dates are in the format dd/mm/yyyy and there isn't a date in the field in question in the ...
-2
votes
1answer
57 views

Manage bulk imports [closed]

How do I set up a rule for my bulk imports, so that if today's import fails, SQL Server will prevent future imports until the issue is resolved? I'm using bulk insert code. The code is calling the ...
4
votes
3answers
3k views

import 100 csv files into postgresql

I have a 100 csv files named sequentially 1,2,3....100.csv I copy the csv files with this script: COPY location FROM 'C:\Program Files\PostgreSQL\9.5\data\´1.csv' DELIMITER ','; I would to ...
3
votes
2answers
929 views

Import poorly formatted CSV/JSON to SQL Server

I am trying to parse Android notification logs into a database. The columns are uneven because different notifications omit certain attributes. Essentially, it is a CSV file of key-value pairs. To put ...
1
vote
1answer
151 views

Processing CSV data on import

I have an externally-produced CSV filled with geographic points and associated data, but I would like to run some functions on the columns before saving them. For example I need to digest longitude/...
1
vote
1answer
825 views

Increasing max server memory to deal with System.OutOfMemoryException on SQL Server

I am not very experienced so please bear with me. I have been attempting to import a 2500 MB and 3800 MB CSV into SQL Server 2016. Unfortunately I keep getting the System.OutOfMemoryException error. ...
1
vote
1answer
130 views

Quickly updating table from large tsv, retaining a timestamp

Consider this tsv file with millions of rows, where uid is a unique identifier of any possible value. 1 audi a3 blue 42 ferrari f60 red 23 porsche 911 green It should be used ...
2
votes
1answer
410 views

SS2012 Export Wizard Access is denied

When a user exports to a flat file she gets an access denied error. The wizard allows her to preview the data so she has access on the db side. From Windows she can create a new file in the target ...
0
votes
1answer
930 views

Set up common database server for vb.net application [closed]

I have developed a school management software in vb.net. I used in-built database management program of Visual Studio. At first my client requirement was single handed use (i.e. the SW works on only ...
0
votes
1answer
641 views

MySQL - How can I speed up a 50+GB fixed width text file import for a 1000+ column table? (Can't remove columns)

I'm using MySQL 5.7.17 to import a ~50GB fixed width text file with over 1000 columns, but after 24 hours it still hasn't finished running. I'm using MyISAM to get around the InnoDB column limit, and ...
0
votes
1answer
47 views

Insert script adds N before each varchar data

I exported results from a query in order to import it into a table on another DB. I chose the xlsx output format and verified that the data had gotten written to the excel file. While trying to import ...
5
votes
2answers
1k views

SQL Server 2016 Temporal Tables

Has anyone tried prepopulating temporal tables with old history data? Before we decide to use temporal tables we need to be able to import our old history into them.
0
votes
1answer
32 views

Building and analyzing trends in a database [closed]

I am quite new to working with databases but have spent a few hours reading about XML and trying to understand the use of CML for building databases and find myself completely at a loss. Here is what ...
1
vote
2answers
663 views

Dumping and importing with backslash

Background I have a MySQL database, from which I run mysqldump for backups. In this database, I have some fields that will contain some backslashes, and when dumping this, it will contain something ...
1
vote
4answers
2k views

Bulk table creation and import of data

I have a around 400 CSV files which have been exported from an old Paradox database, with each CSV representing a table within the old database. Each CSV has a different number of columns and ...
2
votes
3answers
15k views

Easiest way to import access db (.accdb) into SQL Server 2016?

I have a .accfb file from an access 2016 database and am trying to import this database into a SQL Server 2016 developer edition instance. While I found posts online discussing using import/export ...
3
votes
2answers
5k views

Not displaying special characters imported from a file

The scenario is a SQL Server instance, a database which is data fed using BULK INSERT operations mainly, and some of the texts inserted contain special characters like ñ because I am working in a ...
2
votes
1answer
336 views

Postgres 9.6: tune for one time import

I'm using pgloader to perform a one-time migration from MySQL to Postgres. For that purpose, I want to temporarily configure Postgres specifically for that workload. reduce WAL as much as possible: ...
5
votes
3answers
1k views

Azure SQL Warehouse - Data Ingestion - Convert a huge fixed width (with commas) file to delimited

I am not even sure if I am framing this question right, but I will try - I have a bunch of huge text files generated from an Oracle export on a Linux system. Each file is about 30 GB in size, and I ...
2
votes
1answer
3k views

Import .frm and .ibd files into a new instance of MySQL

I have the .frm and .ibd files from an old, non-working MySQL server (on Windows). I took out the hard drive and was able to get the data directory copied to my machine. How would I get them into ...
0
votes
1answer
101 views

Can I lookup my Primary Key in SQL Server from Excel Spreadsheet?

Disclaimer: I'm a database novice teaching myself for a research project. Background: I am querying an electronic medical record (EMR) system for information pertinent to my project and I do not ...
3
votes
1answer
944 views

No data in Azure SQL after importing bacpac file

I've created a bacpac file of my database for transfer to Azure. The file is uploaded and imported successfully but there's no data in the imported database. What did I do wrong? There don't seem to ...
0
votes
1answer
2k views

Field Terminator Problem in Format Files

I have a data file in txt format and I used to load it with Bulk Insert in the following command: Bulk insert [table1] FROM 'data.txt' WITH ( FIELDTERMINATOR ='|', ROWTERMINATOR ='...
7
votes
3answers
11k views

Import in postgres json data in a csv file

I'm trying to import into postgres a csv file containing the data for a table. One of the column of the table has jsonb type. One line of my csv file contains something like 1,{"a":"b"} Suppose the ...
0
votes
2answers
2k views

Commands creating format files to import txt file into sql server

I'm trying to create a format file using bcp utility following the instructions on this page: Using a format file to bulk import data https://technet.microsoft.com/en-us/library/ms178129(v=sql.105)....
-1
votes
1answer
45 views

MsSql secondary database synchronisation to Online Master MsSql database [closed]

I have application that is talking to a Offline (local) database that is a replica of a (Online in-house db). The app is using this (local) database to keep new data that is being inputed when the ...
-1
votes
1answer
30 views

Unable to import the excel data for only 'User' table creation in SQL Server 2012

During import of excel data into SQL Server 2012 Express for User only i am getting the error. The Error is as mention below Msg 156, Level 15, State 1, Line 1 Incorrect syntax near the keyword 'User'...
0
votes
1answer
45 views

I want to import tables from one sql server to another server using SSIS with loop

I want to import table via SSIS, This package will execute like first it'll import first 10 tables once its imported then it'll start to import 10-20 tables, like a loop. Can anyone explain me how ...
1
vote
0answers
124 views

Postgres 9.4 importing csv file causes connection abort

I have very simple database which i would like to import data from a csv file, so far i tested with a file with a few rows, and it worked. So tried to upload the real data to the database, which ...
1
vote
1answer
5k views

Error code 1290 and inability to import data on table

I am running a 5.7.16 version of MySQL on my Windows 8 operating system. I am facing troubles when trying to load datas into a table. I tried with the script LOAD DATA INFILE 'C:\Users\xxx\Dropbox\...
3
votes
1answer
68 views

How to create a custom view (using lookup) from aggregated data

I have data imported into a postgresql database: groups (data import) id | csv_user_ids 1 | 1,2,3 2 | 4,5,6 3 | 3,1,4 ... and a lookup table for user names: users (lookup) id | name 1 | one 2 ...

1 2
3
4 5
10