154 reputation
5
bio website
location
age
visits member for 7 months
seen Apr 9 at 7:37
stats profile views 8

1d
awarded  Popular Question
Mar
18
accepted LOAD DATA INFILE on a MyISAM table blocks user read-queries, can we get around this?
Mar
18
comment LOAD DATA INFILE on a MyISAM table blocks user read-queries, can we get around this?
What does "no free blocks in the middle" mean?
Mar
18
asked LOAD DATA INFILE on a MyISAM table blocks user read-queries, can we get around this?
Mar
18
comment Can I use mysql to serve 100's of millions of small image files?
MongoDB is a great answer, looking through it's feature list, it's pretty spot on, you guys are both right. That was a good pointer. Scary to try to add yet-another puzzle piece to the mix, but it seems necessary.
Mar
17
accepted MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine
Mar
17
answered MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine
Mar
17
revised Can I use mysql to serve 100's of millions of small image files?
added 8 characters in body
Mar
17
accepted MySQL: To use MYISAM or INNODB engine? (plot twist enclosed)
Mar
17
asked Can I use mysql to serve 100's of millions of small image files?
Jan
12
accepted What does 'system lock' mean in mysql profiling a LOAD DATA INFILE statement?
Jan
12
asked What does 'system lock' mean in mysql profiling a LOAD DATA INFILE statement?
Jan
12
comment MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine
The first file loaded in 54s, 2nd in 3m39s, 3rd in 3m9s, 4m7s, 5m21s, and so on. all files aprox the same size.
Jan
12
awarded  Editor
Jan
12
revised MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine
added 511 characters in body
Jan
12
comment MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine
Not seeing any difference here, pretty quickly I see the speed drop from 11MB/sec expansion of the DB file to 6MB (after about 2GB) of data and it's continuing to drop. I'm loading all the files in a for loop, separate mysql calls.
Jan
12
comment MySQL: To use MYISAM or INNODB engine? (plot twist enclosed)
I've sent about 3 days on trying to get innodb to take down 100GB reference table, but I'm not having any success. I'm feeling like the only useable option is myisam, not sure I can avoid the joins with myisam, the whole point of the reference table is to support typical join operations. But the data is read only, no need for transactions at least.
Jan
12
comment MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine
My files are already in 500MB chunks, I was piping them all through a single named pipe to make the load easier, but I'll try this approach now.
Jan
12
comment MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine
The first 2 observations were things I tried to add on to fix the problem after I first noticed it, my first attempt was naturally to leave innodb alone (just turn off bin logging). On the 3rd observation, my data size is highly variable in length, I assume this will be a problem? I'm feeling like I just need to keep this table myisam.
Jan
11
asked MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine