Questions tagged [load]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
-1 votes
1 answer
42 views

Sometimes, not always, when loading an MSSQL table from Excel a new table suffixed with a $ is created by MSSQL. Why?

We are loading MSSQL tables via Microsoft Management Studio Import. Sometimes, not always, a new identical table is created in the load process with a $ at the end of the name. Why does this happen? ...
user avatar
1 vote
1 answer
36 views

Meaning of "Total work" for build indexes during load

I don't think I ever reflected about it, but I'm currently loading a table from a cursor and list utilities show: Phase Number = 3 Description = BUILD Total Work ...
user avatar
  • 21.3k
0 votes
0 answers
15 views

How to Track The Server Usage by The PID?

MySql is taking too much resource in one of my client's server. They are running a website developed in php. I have attached the screenshot below. Single process only taking too much resource. I want ...
user avatar
  • 1
0 votes
1 answer
503 views

How to identify row change timestamp columns in Db2 Table

I need to copy some Db2 tables programmatically (java 11 using the standard Db2 jdbc driver). The tables in question lie on a Db2 for z/OS database (v12) and on a Db2 LUW database (v11.1). The target ...
user avatar
2 votes
1 answer
195 views

Load text column to postgres

I use the following to load data into postgres \copy tab FROM /tmp/file DELIMITER E'\t' QUOTE E'\b' NULL AS '\N' CSV Usually I select the data from a source db echo "select * from tab" | ...
user avatar
  • 393
1 vote
1 answer
1k views

How can I get LOAD DATA LOCAL INFILE to work for MySQL 8.0.21 on a Windows machine? [closed]

I've created a file: 'C:\fff.txt' which contains data for my database table. Then I'm trying to load data from that file like this: LOAD DATA LOCAL INFILE 'C:\\fff.txt' INTO TABLE fff LINES TERMINATED ...
user avatar
0 votes
2 answers
42 views

Near identical MySQL deployments behaving very different - High CPU Usage problem

So I have five identical websites, running on five machines provisioned in the same way. The only thing that differs between these installations are the language files and the languages of the text ...
user avatar
  • 333
0 votes
2 answers
225 views

MySql LOAD DATA with subquery performance issue

I'm migrating data into a MySql (5.7.26) database (32GB ram), running as a managed service on AWS. While importing the data, I need to map one of the columns of the CSV being imported to another value ...
user avatar
  • 3
1 vote
1 answer
491 views

MySQL Error: Data Too Long For Column CHAR(5) - MariaDB 10.3.10 [closed]

When inserting data from CSV to MariaDB 10.3, the following error is generated while trying to insert value '00010' into NCHAR(5) column ERROR 1406 (22001): Data too long for column '...
user avatar
0 votes
0 answers
50 views

oracle load estimates

Our 11g RAC cluster has two nodes, each with 8 CPU cores and a memory target of 16GB. System RAM is 64GB (don't ask me why the memory target is just 16GB, I wasn't there when that choice was made). ...
user avatar
  • 23
0 votes
1 answer
65 views

How to restrict mySQL queries to not affect server and take it down?

There are times that some heavy queries increase server load and after sometime both CPU and Memory reaches 100%. This is my.cnf configuration file: [mysqld] expire_logs_days= 2 pid-file = /...
user avatar
  • 3,546
0 votes
1 answer
5k views

REINDEX or REBUILD the indexes of a table after truncating it and then repopulating it?

Is it necessary to REINDEX or REBUILD the indexes of a table after truncating it and then repopulating it? I have a table with approximately 3.5 million rows in Oracle. Every week new data is ...
user avatar
1 vote
1 answer
324 views

What is the load impact of the Zabbix DB size query?

I am in the process of implementing Zabbix monitoring on multiple servers at an organization. I have recently run into some resistance from an Oracle / MySQL DBA. He claims that the following query ...
user avatar
2 votes
1 answer
10k views

MySQL: Load csv file to mysql

I'm having problems when loading a csv file into MySQL 5.7 with MySQL Workbench. Example Data ESH13 1/2/2013 10:04:35 1451 1 ESH13 1/2/2013 10:04:35 1451.25 2 ESH13 1/2/2013 ...
user avatar
1 vote
1 answer
222 views

Shedding database server load from a web application: how to measure?

I work on a dotnet / WebForms web application that's load balanced over a number of web servers. The web servers connect to a SQL Server 2016 instance. This web application includes several ways for ...
user avatar
  • 489
1 vote
1 answer
1k views

mysql load data local infile is skipping the 1st column of the 1st row

We have a PHP script that has been running from the command line on a WAMP server for a few years. I am now converting it to run on Linux (AWS EC2 AMI instance). The script basically loads data from a ...
user avatar
  • 234
2 votes
1 answer
2k views

MySQL Load Data Infile extremely slow

I have searched in Google, in StackOverflow, I have tested many methods, but I really don't understand why the query is extremely slow. I have a CSV file with this structure with 94K rows: name;...
user avatar
  • 21
2 votes
0 answers
127 views

Architecture to scale Postgres read capacity for a limited time each day?

We run a postgreSQL (9.4) server to store data for a web application. Our next feature will require a very data intensive processing on the server requiring a lot of db queries and computation over ...
user avatar
  • 21
0 votes
1 answer
1k views

Db2 timestampformat for load statement

I've got a file with timestamps like 20130807183000000. I'm trying to load using timestampformat="YYYYMMDDHHMMSSUUU" and I'm getting the error SQL0181N The string representation of a datetime ...
user avatar
  • 3
1 vote
1 answer
401 views

View created using Join Queries taking too much to load

I have written a query to create a view which i can use as a flat table in my application, which is having more than 30 inner join conditions across 25 tables. Now the problem is every time i am ...
user avatar
1 vote
1 answer
72 views

I need to import into mysql data from report exported by infobip

I want to import this csv sample data: ��SendDateTime;ExternalMessageId;SMSCount;Account Name;Country;Country Prefix;Network;Destination Address;Sender;Price Per Message;Credits Per Message;Parent ...
user avatar
  • 637
3 votes
1 answer
804 views

DB2 Dynamic Load from cursor

We have to load a number of huge tables using Load From cursor. The query formed for the same is a dynamic query as the column names are to be specified. we do the same using the below code in a ...
user avatar
  • 184
1 vote
1 answer
1k views

DB2 : Load from cursor Dynamic query

We need to move multiple tables using Load from cursor. But the number columns in the source and destination tables are not the same. Also the tables structures can change so we need the same to ...
user avatar
  • 184
1 vote
2 answers
758 views

Which service to use for unoptimized, slow mysql database ?

This will sound strange, but long story short. I have client running two CS Cart web shops one one dedicated server. Cs Cart is version 3.0.2 and each shop has around 2000 products. Website opens ...
user avatar
1 vote
2 answers
8k views

Load csv file to mysql using load data local infile

I need a simple way to load a csv file from my computer to the database (which is on a remote server). I'm trying to load the file using a php page that executes this code: $file = $_FILES['csv']['...
user avatar
1 vote
2 answers
520 views

300 inserts per minute, 6 million rows per month

I have a Django application using Postgresql 9.3 that is about to grow in load to about 300 inserts per minute (peak load) and about 6 million rows per month in one table. Also there should be a lot ...
user avatar
  • 119
2 votes
2 answers
2k views

Pitfalls of renaming tables in sql server

I've thought of an approach for a process that builds a fairly large table (2million rows), now I'm canvassing opinion for it. What's going to bite me with this renaming approach to a making a table '...
user avatar
0 votes
1 answer
1k views

How to load 100k + Records into progres database from a CSV file?

Our project needs to load 100k+ rows into a Postgres table. We have a huge .CSV file with all these 100K+ rows and we need to load this data into a table effectively and quicker (may be in the form of ...
user avatar
  • 1
-1 votes
1 answer
7k views

what else to enable to make LOAD DATA INFILE work?

Anyone got an idea what to enable to make the LOAD DATA INFILE working? I have the global variable 'local_infile' set to ON, the database is answering queries just normaly, but LOAD DATA INFILE ...
user avatar
  • 11
1 vote
2 answers
2k views

Unexpectively slow data loading into Oracle

Big amount (4.000.000+) of files (1-4Mb each) are loading into Oracle 10g for about several days. Table is allocated in big tablespace, which was created on special volume (labeled BIG_VOL) over ...
user avatar
  • 173
3 votes
0 answers
1k views

Galera cluster consume many CPU percent and CPU high load

I have implemented a cluster include three nodes: two stored nodes and one garbd (also haproxy - load balancer). Some information about servers: SSD 480G Raid1 Memory 32G Swap 16G 2xCPU, number of ...
user avatar
6 votes
1 answer
14k views

How can I load csv data into mongodb and choose the types I'd like to have created for each column?

I'm looking for a method to load csv data in mongodb and specify the types that I'd like to have created for each column? I've been using mongoimport but I find it quite painful because there doesn't ...
user avatar
  • 161
0 votes
1 answer
58 views

Determining which database instance makes biggest IO

Assuming that I have a dedicated server on which I am running multiple instances of mysql and postresql servers. How without iotop determine which instance in particular time (proc/pid/io shows data ...
user avatar
1 vote
1 answer
3k views

DB2 LOAD: Poor performance while loading table with large BLOBs

I need help regarding LOAD-command with BLOBs. I notice very poor performance while loading a table which contains large BLOBs. While tracing the OS, I only have about 15MB/sec I/O-speed. But in ...
user avatar
  • 11
0 votes
1 answer
2k views

MySQL warnings while loading integer data into table (SOLVED)

For some reason, after loading a large amount of data into the following table (from a single file), all of the values register as 0. CREATE TABLE secondTable ( freq int NULL, w1 int NULL, w2 int ...
user avatar
  • 23
2 votes
1 answer
4k views

Syntax error in load data infile

I don't know why I am getting a syntax error. I have checked my query carefully many times and read up on mysql reference for load data infile and everything seems fine. Here is my query: LOAD DATA ...
user avatar
  • 523
0 votes
2 answers
1k views

Database is slow once in a while

I am executing a web service for 100 times. The average response time of this service is 1.5 seconds. But when I look at the response time of each execution individually, there are a few executions (...
user avatar
1 vote
1 answer
1k views

My queries are slow under load

I am performing a load test for my application. All my SQL queries which are fired from my application, individually look better and perform fast. The same SQL are becoming bottleneck when they are ...
user avatar
0 votes
1 answer
14k views

High average load due to the High mysql cpu usage

i've got 2 warnings about my average load being high in the past week and apparently it has to do something with the mysql my daily visit has been increased about 10-20 thousand (total of 180-150 ...
user avatar
  • 145
0 votes
1 answer
1k views

MySQL Replace function throwing error

I am trying to update ^G (Ctrl G) in a table, below is scenario- CREATE TABLET TEST(COLA INT,DESCRIPTION VARCHAR(20)); I have crtl G in my data for description field, so to replace it with a \,I am ...
user avatar
3 votes
2 answers
17k views

What is the difference between NULL and \N while loading data from a csv using load data local infile

I have a table which has four fields create table test_hc1(cola int,colb int,colc varchar(20),cold int); Now, I am trying to load following data 1,2,\N,4 and the third field in table is coming ...
user avatar
5 votes
2 answers
23k views

ESCAPED BY clause in LOAD DATA INFILE

Can somebody please help me understand what is ESCAPED BY clause means in LOAD DATA LOCAL INFILE statement MySQL 5.5. I am a newbie to MySQL so please bear with me.
user avatar
4 votes
1 answer
6k views

mongostat causing CPU 100%

On a 64Bit Debian 6 OS with 4 CPU cores and 8GB RAM, I can reproduce an issue with mongostat. Whenever I create an index, reIndex or even index in background, according to top, the CPU load is 40-60% ...
user avatar
  • 695
2 votes
1 answer
4k views

DB2 Load Failure due to timestampformat

I'm trying to load a file into DB2 database table using DB2 Load. I'm able to load the file, using the following statement from the unix prompt. db2 +p -x load from BOM_Sales_20130326.txt of DEL ...
user avatar
1 vote
2 answers
6k views

High Mysql Load , over 700% CPU

I had high mysql load on server linux 64 bit , 24 G.B ram , Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz , Alot of quiers in sending data mode Here is mysql status +------+--------------+------...
user avatar
0 votes
1 answer
2k views

Integer comparison in MySQL. does it cause lots of overhead?

I have an 8 digit number in my db. I want to do a select on the table in MySql (Innodb) and get the list of all numbers that are equal or smaller than my number. Then I sort them from larger to ...
user avatar
  • 3
1 vote
1 answer
1k views

Is SET INTEGRITY of any use after IMPORT statements, or just after LOAD statements?

I'm getting the feeling, both from documentation and empirically, that you can only put SET INTEGRITY to good use after a LOAD, not after an IMPORT. LOAD is mentioned for SET INTEGRITY, but not IMPORT....
user avatar
4 votes
1 answer
2k views

Named pipes connection closed when subjected to load

We're hosting a service where we have a messaging service. When a message arrives, it checks which subscribers it should be sent to by connecting to the database, and querying the subscriptions table....
user avatar
  • 141
2 votes
1 answer
2k views

Do database servers need load balancing?

I am trying to build a 1TB database on MySQL which will need strong read performance. I intend to replicate my database to prevent downtime. Do my database servers need load balancing to improve ...
user avatar
2 votes
2 answers
4k views

How do I import a specific line from a text file into MySQL

I'm building an app to import data from a text file to a database. I want to import only specific lines from the text file. With Navicat I found that we could limit number of line when importing ...
user avatar