Questions tagged [load]
The load tag has no usage guidance.
53
questions
0
votes
0
answers
18
views
Is there a difference in performance loading different datatypes
Context: loading (COPY) a high volume of data to a warehouse (Redshift specifically however curious about all)
Question: Is there a performance difference in the different datatypes that I am loading? ...
0
votes
1
answer
95
views
Db2 - load LOB data returns error SQL3025N A parameter specifying a filename or path is not valid
I would like to learn how to load LOB data from files. I have a table with two columns:
ID INTEGER
DATA CLOB
I can normaly export data with:
export to c:\data\data.txt of del lobs to c:\data\ ...
- 173
-1
votes
1
answer
53
views
Sometimes, not always, when loading an MSSQL table from Excel a new table suffixed with a $ is created by MSSQL. Why?
We are loading MSSQL tables via Microsoft Management Studio Import. Sometimes, not always, a new identical table is created in the load process with a $ at the end of the name. Why does this happen? ...
1
vote
1
answer
46
views
Meaning of "Total work" for build indexes during load
I don't think I ever reflected about it, but I'm currently loading a table from a cursor and list utilities show:
Phase Number = 3
Description = BUILD
Total Work ...
- 22.6k
0
votes
0
answers
15
views
How to Track The Server Usage by The PID?
MySql is taking too much resource in one of my client's server. They are running a website developed in php. I have attached the screenshot below. Single process only taking too much resource.
I want ...
- 1
0
votes
1
answer
915
views
How to identify row change timestamp columns in Db2 Table
I need to copy some Db2 tables programmatically (java 11 using the standard Db2 jdbc driver). The tables in question lie on a Db2 for z/OS database (v12) and on a Db2 LUW database (v11.1). The target ...
- 131
2
votes
1
answer
307
views
Load text column to postgres
I use the following to load data into postgres
\copy tab FROM /tmp/file DELIMITER E'\t' QUOTE E'\b' NULL AS '\N' CSV
Usually I select the data from a source db
echo "select * from tab" | ...
- 473
1
vote
1
answer
2k
views
How can I get LOAD DATA LOCAL INFILE to work for MySQL 8.0.21 on a Windows machine? [closed]
I've created a file: 'C:\fff.txt' which contains data for my database table.
Then I'm trying to load data from that file like this:
LOAD DATA LOCAL INFILE 'C:\\fff.txt' INTO TABLE fff
LINES TERMINATED ...
- 141
0
votes
2
answers
49
views
Near identical MySQL deployments behaving very different - High CPU Usage problem
So I have five identical websites, running on five machines provisioned in the same way. The only thing that differs between these installations are the language files and the languages of the text ...
- 343
0
votes
2
answers
285
views
MySql LOAD DATA with subquery performance issue
I'm migrating data into a MySql (5.7.26) database (32GB ram), running as a managed service on AWS. While importing the data, I need to map one of the columns of the CSV being imported to another value ...
- 3
1
vote
1
answer
586
views
MySQL Error: Data Too Long For Column CHAR(5) - MariaDB 10.3.10 [closed]
When inserting data from CSV to MariaDB 10.3, the following error is generated while trying to insert value '00010' into NCHAR(5) column
ERROR 1406 (22001): Data too long for column '...
0
votes
0
answers
50
views
oracle load estimates
Our 11g RAC cluster has two nodes, each with 8 CPU cores and a memory target of 16GB. System RAM is 64GB (don't ask me why the memory target is just 16GB, I wasn't there when that choice was made). ...
- 43
0
votes
1
answer
65
views
How to restrict mySQL queries to not affect server and take it down?
There are times that some heavy queries increase server load and after sometime both CPU and Memory reaches 100%.
This is my.cnf configuration file:
[mysqld]
expire_logs_days= 2
pid-file = /...
- 3,586
0
votes
1
answer
6k
views
REINDEX or REBUILD the indexes of a table after truncating it and then repopulating it?
Is it necessary to REINDEX or REBUILD the indexes of a table after truncating it and then repopulating it?
I have a table with approximately 3.5 million rows in Oracle. Every week new data is ...
- 125
1
vote
1
answer
334
views
What is the load impact of the Zabbix DB size query?
I am in the process of implementing Zabbix monitoring on multiple servers at an organization. I have recently run into some resistance from an Oracle / MySQL DBA. He claims that the following query ...
- 133
2
votes
1
answer
11k
views
MySQL: Load csv file to mysql
I'm having problems when loading a csv file into MySQL 5.7 with MySQL Workbench.
Example Data
ESH13 1/2/2013 10:04:35 1451 1
ESH13 1/2/2013 10:04:35 1451.25 2
ESH13 1/2/2013 ...
- 33
2
votes
1
answer
264
views
Shedding database server load from a web application: how to measure?
I work on a dotnet / WebForms web application that's load balanced over a number of web servers. The web servers connect to a SQL Server 2016 instance.
This web application includes several ways for ...
- 511
1
vote
1
answer
2k
views
mysql load data local infile is skipping the 1st column of the 1st row
We have a PHP script that has been running from the command line on a WAMP server for a few years. I am now converting it to run on Linux (AWS EC2 AMI instance). The script basically loads data from a ...
- 244
2
votes
1
answer
2k
views
MySQL Load Data Infile extremely slow
I have searched in Google, in StackOverflow, I have tested many methods, but I really don't understand why the query is extremely slow.
I have a CSV file with this structure with 94K rows:
name;...
- 21
2
votes
0
answers
132
views
Architecture to scale Postgres read capacity for a limited time each day?
We run a postgreSQL (9.4) server to store data for a web application. Our next feature will require a very data intensive processing on the server requiring a lot of db queries and computation over ...
- 121
0
votes
1
answer
1k
views
Db2 timestampformat for load statement
I've got a file with timestamps like 20130807183000000. I'm trying to load using timestampformat="YYYYMMDDHHMMSSUUU" and I'm getting the error
SQL0181N The string representation of a datetime ...
- 3
1
vote
1
answer
467
views
View created using Join Queries taking too much to load
I have written a query to create a view which i can use as a flat table in my application, which is having more than 30 inner join conditions across 25 tables.
Now the problem is every time i am ...
- 183
1
vote
1
answer
75
views
I need to import into mysql data from report exported by infobip
I want to import this csv sample data:
��SendDateTime;ExternalMessageId;SMSCount;Account Name;Country;Country Prefix;Network;Destination Address;Sender;Price Per Message;Credits Per Message;Parent ...
- 667
3
votes
1
answer
861
views
DB2 Dynamic Load from cursor
We have to load a number of huge tables using Load From cursor. The query formed for the same is a dynamic query as the column names are to be specified. we do the same using the below code in a ...
- 184
1
vote
1
answer
1k
views
DB2 : Load from cursor Dynamic query
We need to move multiple tables using Load from cursor. But the number columns in the source and destination tables are not the same.
Also the tables structures can change so we need the same to ...
- 184
1
vote
2
answers
807
views
Which service to use for unoptimized, slow mysql database ?
This will sound strange, but long story short.
I have client running two CS Cart web shops one one dedicated server. Cs Cart is version 3.0.2 and each shop has around 2000 products.
Website opens ...
- 11
2
votes
2
answers
8k
views
Load csv file to mysql using load data local infile
I need a simple way to load a csv file from my computer to the database (which is on a remote server).
I'm trying to load the file using a php page that executes this code:
$file = $_FILES['csv']['...
1
vote
2
answers
653
views
300 inserts per minute, 6 million rows per month
I have a Django application using Postgresql 9.3 that is about to grow in load to about 300 inserts per minute (peak load) and about 6 million rows per month in one table. Also there should be a lot ...
- 119
2
votes
2
answers
3k
views
Pitfalls of renaming tables in sql server
I've thought of an approach for a process that builds a fairly large table (2million rows), now I'm canvassing opinion for it. What's going to bite me with this renaming approach to a making a table '...
- 23
0
votes
1
answer
1k
views
How to load 100k + Records into progres database from a CSV file?
Our project needs to load 100k+ rows into a Postgres table. We have a huge .CSV file with all these 100K+ rows and we need to load this data into a table effectively and quicker (may be in the form of ...
- 1
-1
votes
1
answer
8k
views
what else to enable to make LOAD DATA INFILE work?
Anyone got an idea what to enable to make the LOAD DATA INFILE working? I have the global variable 'local_infile' set to ON, the database is answering queries just normaly, but LOAD DATA INFILE ...
- 11
1
vote
2
answers
2k
views
Unexpectively slow data loading into Oracle
Big amount (4.000.000+) of files (1-4Mb each) are loading into Oracle 10g for about several days.
Table is allocated in big tablespace, which was created on special volume (labeled BIG_VOL) over ...
- 173
3
votes
0
answers
1k
views
Galera cluster consume many CPU percent and CPU high load
I have implemented a cluster include three nodes: two stored nodes and one garbd (also haproxy - load balancer).
Some information about servers:
SSD 480G Raid1
Memory 32G
Swap 16G
2xCPU, number of ...
- 699
6
votes
1
answer
14k
views
How can I load csv data into mongodb and choose the types I'd like to have created for each column?
I'm looking for a method to load csv data in mongodb and specify the types that I'd like to have created for each column?
I've been using mongoimport but I find it quite painful because there doesn't ...
- 161
0
votes
1
answer
58
views
Determining which database instance makes biggest IO
Assuming that I have a dedicated server on which I am running multiple instances of mysql and postresql servers. How without iotop determine which instance in particular time (proc/pid/io shows data ...
user2008937
1
vote
1
answer
3k
views
DB2 LOAD: Poor performance while loading table with large BLOBs
I need help regarding LOAD-command with BLOBs.
I notice very poor performance while loading a table which contains large BLOBs.
While tracing the OS, I only have about 15MB/sec I/O-speed.
But in ...
- 11
0
votes
1
answer
3k
views
MySQL warnings while loading integer data into table (SOLVED)
For some reason, after loading a large amount of data into the following table (from a single file), all of the values register as 0.
CREATE TABLE secondTable
(
freq int NULL,
w1 int NULL,
w2 int ...
- 23
2
votes
1
answer
4k
views
Syntax error in load data infile
I don't know why I am getting a syntax error. I have checked my query carefully many times and read up on mysql reference for load data infile and everything seems fine. Here is my query:
LOAD DATA ...
- 573
0
votes
2
answers
1k
views
Database is slow once in a while
I am executing a web service for 100 times. The average response time of this service is 1.5 seconds. But when I look at the response time of each execution individually, there are a few executions (...
- 133
1
vote
1
answer
1k
views
My queries are slow under load
I am performing a load test for my application. All my SQL queries which are fired from my application, individually look better and perform fast.
The same SQL are becoming bottleneck when they are ...
- 133
0
votes
1
answer
14k
views
High average load due to the High mysql cpu usage
i've got 2 warnings about my average load being high in the past week and apparently it has to do something with the mysql
my daily visit has been increased about 10-20 thousand (total of 180-150 ...
- 145
0
votes
1
answer
1k
views
MySQL Replace function throwing error
I am trying to update ^G (Ctrl G) in a table, below is scenario-
CREATE TABLET TEST(COLA INT,DESCRIPTION VARCHAR(20));
I have crtl G in my data for description field, so to replace it with a \,I am ...
- 497
3
votes
2
answers
17k
views
What is the difference between NULL and \N while loading data from a csv using load data local infile
I have a table which has four fields
create table test_hc1(cola int,colb int,colc varchar(20),cold int);
Now, I am trying to load following data
1,2,\N,4
and the third field in table is coming ...
- 497
5
votes
2
answers
25k
views
ESCAPED BY clause in LOAD DATA INFILE
Can somebody please help me understand what is ESCAPED BY clause means in LOAD DATA LOCAL INFILE statement MySQL 5.5. I am a newbie to MySQL so please bear with me.
- 497
4
votes
1
answer
6k
views
mongostat causing CPU 100%
On a 64Bit Debian 6 OS with 4 CPU cores and 8GB RAM, I can reproduce an issue with mongostat.
Whenever I create an index, reIndex or even index in background, according to top, the CPU load is 40-60% ...
- 695
2
votes
1
answer
4k
views
DB2 Load Failure due to timestampformat
I'm trying to load a file into DB2 database table using DB2 Load. I'm able to load the file, using the following statement from the unix prompt.
db2 +p -x load from BOM_Sales_20130326.txt of DEL ...
- 21
1
vote
2
answers
6k
views
High Mysql Load , over 700% CPU
I had high mysql load on server linux 64 bit , 24 G.B ram , Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz ,
Alot of quiers in sending data mode
Here is mysql status
+------+--------------+------...
- 163
0
votes
1
answer
2k
views
Integer comparison in MySQL. does it cause lots of overhead?
I have an 8 digit number in my db. I want to do a select on the table in MySql (Innodb) and get the list of all numbers that are equal or smaller than my number. Then I sort them from larger to ...
- 3
1
vote
1
answer
1k
views
Is SET INTEGRITY of any use after IMPORT statements, or just after LOAD statements?
I'm getting the feeling, both from documentation and empirically, that you can only put SET INTEGRITY to good use after a LOAD, not after an IMPORT. LOAD is mentioned for SET INTEGRITY, but not IMPORT....
4
votes
1
answer
2k
views
Named pipes connection closed when subjected to load
We're hosting a service where we have a messaging service. When a message arrives, it checks which subscribers it should be sent to by connecting to the database, and querying the subscriptions table....
- 141