0

My project need to migrate more than 2TB raw data from SybaseIQ to another Database. SybaseIQ using GBK, the target Database using UTF-8, the target database can only load from UTF-8 files.

We use The Extract Options to extract data to GBK files first, then convert data into UTF-8, the converting is very slow because it's single processor only.

Can anyone tell me the efficient way of extract data from SybaseIQ and convert charset and encode to UTF-8?

0

I've promoted about 2X speed by named pipe.

First step:(create a named pipe)

mkfifo p1

Second step:(waiting to convert)

cat p1| iconv -f GBK -t UTF-8 > target.file

Last step:(export to p1, see the sql scripts below)

SET OPTION TEMP_EXTRACT_NAME1 = 'p1';
SELECT * FROM MY_TABLE;
SET OPTION TEMP_EXTRACT_NAME1 = '';

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.