| bio | website | |
|---|---|---|
| location | ||
| age | ||
| visits | member for | 7 months |
| seen | Apr 9 at 7:37 | |
| stats | profile views | 8 |
|
1d |
awarded | Popular Question |
|
Mar 18 |
accepted | LOAD DATA INFILE on a MyISAM table blocks user read-queries, can we get around this? |
|
Mar 18 |
comment |
LOAD DATA INFILE on a MyISAM table blocks user read-queries, can we get around this? What does "no free blocks in the middle" mean? |
|
Mar 18 |
asked | LOAD DATA INFILE on a MyISAM table blocks user read-queries, can we get around this? |
|
Mar 18 |
comment |
Can I use mysql to serve 100's of millions of small image files? MongoDB is a great answer, looking through it's feature list, it's pretty spot on, you guys are both right. That was a good pointer. Scary to try to add yet-another puzzle piece to the mix, but it seems necessary. |
|
Mar 17 |
accepted | MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine |
|
Mar 17 |
answered | MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine |
|
Mar 17 |
revised |
Can I use mysql to serve 100's of millions of small image files? added 8 characters in body |
|
Mar 17 |
accepted | MySQL: To use MYISAM or INNODB engine? (plot twist enclosed) |
|
Mar 17 |
asked | Can I use mysql to serve 100's of millions of small image files? |
|
Jan 12 |
accepted | What does 'system lock' mean in mysql profiling a LOAD DATA INFILE statement? |
|
Jan 12 |
asked | What does 'system lock' mean in mysql profiling a LOAD DATA INFILE statement? |
|
Jan 12 |
comment |
MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine The first file loaded in 54s, 2nd in 3m39s, 3rd in 3m9s, 4m7s, 5m21s, and so on. all files aprox the same size. |
|
Jan 12 |
awarded | Editor |
|
Jan 12 |
revised |
MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine added 511 characters in body |
|
Jan 12 |
comment |
MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine Not seeing any difference here, pretty quickly I see the speed drop from 11MB/sec expansion of the DB file to 6MB (after about 2GB) of data and it's continuing to drop. I'm loading all the files in a for loop, separate mysql calls. |
|
Jan 12 |
comment |
MySQL: To use MYISAM or INNODB engine? (plot twist enclosed) I've sent about 3 days on trying to get innodb to take down 100GB reference table, but I'm not having any success. I'm feeling like the only useable option is myisam, not sure I can avoid the joins with myisam, the whole point of the reference table is to support typical join operations. But the data is read only, no need for transactions at least. |
|
Jan 12 |
comment |
MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine My files are already in 500MB chunks, I was piping them all through a single named pipe to make the load easier, but I'll try this approach now. |
|
Jan 12 |
comment |
MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine The first 2 observations were things I tried to add on to fix the problem after I first noticed it, my first attempt was naturally to leave innodb alone (just turn off bin logging). On the 3rd observation, my data size is highly variable in length, I assume this will be a problem? I'm feeling like I just need to keep this table myisam. |
|
Jan 11 |
asked | MySQL LOAD DATA INFILE slows by 80% after a few gigs of input with InnoDB engine |