The bulkcopy tag has no wiki summary.
3
votes
1answer
69 views
BULK INSERT Data from file but ignore the first occurence of field terminator
I have a file that has data arranged in the following style:
1 1 0.5102 0.4898 0.0000 0.0000 0.0000
1 2 0.3114 0.6886 0.0000 0.0000 0.0000
I need to load ...
1
vote
1answer
354 views
Usage of COPY FROM STDIN in postgres
I just started using Postgres and I'm trying to create a sample db to understand its functions, looking around, I found some scripts in pgfoundry.org.
I understand the commands, since I previously ...
0
votes
0answers
40 views
How to Copy Yes/No field data in Sharepoint list to Sharepoint list using SSIS Package?
I am copying sharepoint list data using SSIS package and they are copying perfectly. But the problem is when there is a Choice field or Yes/No field at that time it is copying only default value to ...
1
vote
1answer
75 views
Postgres copy data with \xYY as plain string instead of interpreting as encoded string
I have a log file full of URLs, generated by Bro IDS.
When Bro logs a URL with non-ascii characters in it, it inserts \xYY where YY is the hexadecimal character code. Also, some URLs contain "\x".
...
1
vote
0answers
85 views
Can PostgreSQL's COPY create CSV with Locale-specific number formatting?
I want to create a CSV with PostgreSQL 9.1 COPY that directly opens correctly with a double-click in crazy German Excel 2010. Using ";"-Delimiter is easy.
The encoding is solved, but Excel only ...
3
votes
1answer
105 views
Variable substitution in psql when using \copy
I'm using the psql command \copy and I would like to pass a variable to it from the shell (for table name) like I've done when scripting queries. I've read in the documentation for psql that:
The ...
0
votes
1answer
386 views
Save output from multiple SQL SELECT commands to a file
Within a Postgres function I would like to run a number of SQL SELECT commands and append the output to the same variable. After all the SELECT commands have run this output should be written to a ...
5
votes
1answer
105 views
BCP stops after the last “1000 rows sent to SQL Server. Total sent: …”
I ran SQL Server 2005's bulk copy program BCP like this:
bcp mydb.dbo.mytbl in myfile.blk -c -S mysvr -U mylogin -P mypass
And it ran and produced output like so:
Starting copy...
1000 rows sent ...
2
votes
1answer
891 views
Duplicate primary key in bulk insert after truncate in SQL Server 2008?
I'm using SSIS to dump data from my SQL Server 2008 prod database to flat files and then using bulk insert to load those flat files into the SQL Server 2008 dev database. The SSIS package is running a ...
1
vote
1answer
2k views
Connecting remote MySQL database to local MySQL database?
I want to write PHP code to be embedded in a Drupal7 module.
I want to call a procedure which can copy newly generated data in the local MySQL database to a remote MySQL database.
When data is ...
3
votes
4answers
471 views
What options exist for copying data between servers on a regular basis?
My apologies if this has already been answered. I've searched SO and of course here on DBA, and am surprised to find no close matches. Specifically, I'm looking for a solution which survives schema ...
1
vote
1answer
86 views
using COPY command and wal_buffers
since COPY command runs inside a single transaction, if its WAL data doesn't fit into wal_buffers? for example if we are bulk importing from CSV file.
2
votes
2answers
955 views
Move data from one table to other in batch's
I have a table 18 Million records I need to add append it to another table (with the same structure) I tried the import-export wizard, the problem is that the log gets very very big and eventually it ...
3
votes
2answers
1k views
Copy huge amount from 1 table to other
I have two tables with same structure I need to copy over all tables from table A to table B, the problem is that some records from table A already exist in table B so that made the Import Fail.
So I ...
4
votes
3answers
211 views
Copy 8 Million Records
I have a table in a local MS SQL Server database that has 72 columns and over 8 million records.
Most of the columns are floats except for the primary key which is an INT Identity column.
The table ...
2
votes
2answers
4k views
ORA-01502: index or partition of such index is in usable state problem
I have a table in my Oracle database, where
select pkcol, count(*) from myTable group by pkcol having count(*) > 1;
yields
PKCOL COUNT(*)
------- ----------
1 2
2 ...
1
vote
1answer
864 views
What is the purpose of sqlbulkcopy's useinternaltransaction property?
I'm just testing my PowerShellScript to do bulkcopy of multiple tables between sql-server and oracle Databases.
When the destination is Oracle, than I can monitor the progress by by executing
select ...
