Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [load]

The tag has no usage guidance.

0
votes
0answers
42 views

oracle load estimates

Our 11g RAC cluster has two nodes, each with 8 CPU cores and a memory target of 16GB. System RAM is 64GB (don't ask me why the memory target is just 16GB, I wasn't there when that choice was made). ...
0
votes
1answer
44 views

How to restrict mySQL queries to not affect server and take it down?

There are times that some heavy queries increase server load and after sometime both CPU and Memory reaches 100%. This is my.cnf configuration file: [mysqld] expire_logs_days= 2 pid-file = /...
0
votes
1answer
207 views

REINDEX or REBUILD the indexes of a table after truncating it and then repopulating it?

Is it necessary to REINDEX or REBUILD the indexes of a table after truncating it and then repopulating it? I have a table with approximately 3.5 million rows in Oracle. Every week new data is ...
1
vote
1answer
171 views

What is the load impact of the Zabbix DB size query?

I am in the process of implementing Zabbix monitoring on multiple servers at an organization. I have recently run into some resistance from an Oracle / MySQL DBA. He claims that the following query ...
1
vote
1answer
3k views

MySQL: Load csv file to mysql

I'm having problems when loading a csv file into MySQL 5.7 with MySQL Workbench. Example Data ESH13 1/2/2013 10:04:35 1451 1 ESH13 1/2/2013 10:04:35 1451.25 2 ESH13 1/2/2013 ...
1
vote
1answer
129 views

Shedding database server load from a web application: how to measure?

I work on a dotnet / WebForms web application that's load balanced over a number of web servers. The web servers connect to a SQL Server 2016 instance. This web application includes several ways for ...
1
vote
1answer
365 views

mysql load data local infile is skipping the 1st column of the 1st row

We have a PHP script that has been running from the command line on a WAMP server for a few years. I am now converting it to run on Linux (AWS EC2 AMI instance). The script basically loads data from a ...
1
vote
1answer
712 views

MySQL Load Data Infile extremely slow

I have searched in Google, in StackOverflow, I have tested many methods, but I really don't understand why the query is extremely slow. I have a CSV file with this structure with 94K rows: name;...
2
votes
0answers
99 views

Architecture to scale Postgres read capacity for a limited time each day?

We run a postgreSQL (9.4) server to store data for a web application. Our next feature will require a very data intensive processing on the server requiring a lot of db queries and computation over ...
0
votes
1answer
589 views

Db2 timestampformat for load statement

I've got a file with timestamps like 20130807183000000. I'm trying to load using timestampformat="YYYYMMDDHHMMSSUUU" and I'm getting the error SQL0181N The string representation of a datetime ...
1
vote
1answer
248 views

View created using Join Queries taking too much to load

I have written a query to create a view which i can use as a flat table in my application, which is having more than 30 inner join conditions across 25 tables. Now the problem is every time i am ...
1
vote
1answer
67 views

I need to import into mysql data from report exported by infobip

I want to import this csv sample data: ��SendDateTime;ExternalMessageId;SMSCount;Account Name;Country;Country Prefix;Network;Destination Address;Sender;Price Per Message;Credits Per Message;Parent ...
3
votes
1answer
451 views

DB2 Dynamic Load from cursor

We have to load a number of huge tables using Load From cursor. The query formed for the same is a dynamic query as the column names are to be specified. we do the same using the below code in a ...
1
vote
1answer
703 views

DB2 : Load from cursor Dynamic query

We need to move multiple tables using Load from cursor. But the number columns in the source and destination tables are not the same. Also the tables structures can change so we need the same to ...
1
vote
2answers
550 views

Which service to use for unoptimized, slow mysql database ?

This will sound strange, but long story short. I have client running two CS Cart web shops one one dedicated server. Cs Cart is version 3.0.2 and each shop has around 2000 products. Website opens ...
1
vote
2answers
6k views

Load csv file to mysql using load data local infile

I need a simple way to load a csv file from my computer to the database (which is on a remote server). I'm trying to load the file using a php page that executes this code: $file = $_FILES['csv']['...
1
vote
2answers
414 views

300 inserts per minute, 6 million rows per month

I have a Django application using Postgresql 9.3 that is about to grow in load to about 300 inserts per minute (peak load) and about 6 million rows per month in one table. Also there should be a lot ...
2
votes
2answers
988 views

Pitfalls of renaming tables in sql server

I've thought of an approach for a process that builds a fairly large table (2million rows), now I'm canvassing opinion for it. What's going to bite me with this renaming approach to a making a table '...
0
votes
1answer
752 views

How to load 100k + Records into progres database from a CSV file?

Our project needs to load 100k+ rows into a Postgres table. We have a huge .CSV file with all these 100K+ rows and we need to load this data into a table effectively and quicker (may be in the form of ...
-2
votes
1answer
2k views

what else to enable to make LOAD DATA INFILE work?

Anyone got an idea what to enable to make the LOAD DATA INFILE working? I have the global variable 'local_infile' set to ON, the database is answering queries just normaly, but LOAD DATA INFILE ...
1
vote
2answers
2k views

Unexpectively slow data loading into Oracle

Big amount (4.000.000+) of files (1-4Mb each) are loading into Oracle 10g for about several days. Table is allocated in big tablespace, which was created on special volume (labeled BIG_VOL) over ...
3
votes
0answers
850 views

Galera cluster consume many CPU percent and CPU high load

I have implemented a cluster include three nodes: two stored nodes and one garbd (also haproxy - load balancer). Some information about servers: SSD 480G Raid1 Memory 32G Swap 16G 2xCPU, number of ...
5
votes
1answer
9k views

How can I load csv data into mongodb and choose the types I'd like to have created for each column?

I'm looking for a method to load csv data in mongodb and specify the types that I'd like to have created for each column? I've been using mongoimport but I find it quite painful because there doesn't ...
0
votes
1answer
40 views

Determining which database instance makes biggest IO

Assuming that I have a dedicated server on which I am running multiple instances of mysql and postresql servers. How without iotop determine which instance in particular time (proc/pid/io shows data ...
1
vote
1answer
2k views

DB2 LOAD: Poor performance while loading table with large BLOBs

I need help regarding LOAD-command with BLOBs. I notice very poor performance while loading a table which contains large BLOBs. While tracing the OS, I only have about 15MB/sec I/O-speed. But in ...
0
votes
1answer
1k views

MySQL warnings while loading integer data into table (SOLVED)

For some reason, after loading a large amount of data into the following table (from a single file), all of the values register as 0. CREATE TABLE secondTable ( freq int NULL, w1 int NULL, w2 int ...
2
votes
1answer
3k views

Syntax error in load data infile

I don't know why I am getting a syntax error. I have checked my query carefully many times and read up on mysql reference for load data infile and everything seems fine. Here is my query: LOAD DATA ...
0
votes
2answers
1k views

Database is slow once in a while

I am executing a web service for 100 times. The average response time of this service is 1.5 seconds. But when I look at the response time of each execution individually, there are a few executions (...
1
vote
1answer
929 views

My queries are slow under load

I am performing a load test for my application. All my SQL queries which are fired from my application, individually look better and perform fast. The same SQL are becoming bottleneck when they are ...
0
votes
1answer
13k views

High average load due to the High mysql cpu usage

i've got 2 warnings about my average load being high in the past week and apparently it has to do something with the mysql my daily visit has been increased about 10-20 thousand (total of 180-150 ...
0
votes
1answer
894 views

MySQL Replace function throwing error

I am trying to update ^G (Ctrl G) in a table, below is scenario- CREATE TABLET TEST(COLA INT,DESCRIPTION VARCHAR(20)); I have crtl G in my data for description field, so to replace it with a \,I am ...
3
votes
2answers
12k views

What is the difference between NULL and \N while loading data from a csv using load data local infile

I have a table which has four fields create table test_hc1(cola int,colb int,colc varchar(20),cold int); Now, I am trying to load following data 1,2,\N,4 and the third field in table is coming ...
3
votes
2answers
15k views

ESCAPED BY clause in LOAD DATA INFILE

Can somebody please help me understand what is ESCAPED BY clause means in LOAD DATA LOCAL INFILE statement MySQL 5.5. I am a newbie to MySQL so please bear with me.
4
votes
1answer
5k views

mongostat causing CPU 100%

On a 64Bit Debian 6 OS with 4 CPU cores and 8GB RAM, I can reproduce an issue with mongostat. Whenever I create an index, reIndex or even index in background, according to top, the CPU load is 40-60% ...
2
votes
1answer
3k views

DB2 Load Failure due to timestampformat

I'm trying to load a file into DB2 database table using DB2 Load. I'm able to load the file, using the following statement from the unix prompt. db2 +p -x load from BOM_Sales_20130326.txt of DEL ...
1
vote
2answers
5k views

High Mysql Load , over 700% CPU

I had high mysql load on server linux 64 bit , 24 G.B ram , Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz , Alot of quiers in sending data mode Here is mysql status +------+--------------+------...
0
votes
1answer
1k views

Integer comparison in MySQL. does it cause lots of overhead?

I have an 8 digit number in my db. I want to do a select on the table in MySql (Innodb) and get the list of all numbers that are equal or smaller than my number. Then I sort them from larger to ...
1
vote
1answer
935 views

Is SET INTEGRITY of any use after IMPORT statements, or just after LOAD statements?

I'm getting the feeling, both from documentation and empirically, that you can only put SET INTEGRITY to good use after a LOAD, not after an IMPORT. LOAD is mentioned for SET INTEGRITY, but not IMPORT....
3
votes
1answer
1k views

Named pipes connection closed when subjected to load

We're hosting a service where we have a messaging service. When a message arrives, it checks which subscribers it should be sent to by connecting to the database, and querying the subscriptions table....
2
votes
1answer
2k views

Do database servers need load balancing?

I am trying to build a 1TB database on MySQL which will need strong read performance. I intend to replicate my database to prevent downtime. Do my database servers need load balancing to improve ...
2
votes
2answers
3k views

How do I import a specific line from a text file into MySQL

I'm building an app to import data from a text file to a database. I want to import only specific lines from the text file. With Navicat I found that we could limit number of line when importing ...
2
votes
3answers
7k views

DB2 LOAD data into table - Interpreting the error messages

I encountered some constraint issues when loading data from file into table ** SQL3109N The utility is beginning to load data from file "xag". SQL3500W The utility is beginning the "LOAD" phase at ...