Take the 2-minute tour ×
Database Administrators Stack Exchange is a question and answer site for database professionals who wish to improve their database skills and learn from others in the community. It's 100% free, no registration required.

I need to do a serious migration of data from MySQL to MongoDB. I have dumped the actual database from its server to the Amazon AWS box. I set up a powerful Amazon AWS Ubuntu EC2 12.04.3 type c3.4xlarge instance in order to achieve that faster. I have installed Percona Server on it and copied my-huge.cnf as my.cnf in the /etc/mysql/.

I have set max_allowed_packet to 1024M in [mysqld] and 2048 in the [mysqldump]thread_concurency to 32 (I have 16 virtual CPUs).

I have set ulimit to:

core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 240176
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 64000
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 240176
virtual memory          (kbytes, -v) unlimited file locks (-x) unlimited

I am trying to restore 5 GB or dump file with the command mysql -uroot -p dbname < dump_file.sql, and it's taking forever.

The server is using at most 1 GB out of 30 GB, and occasionally four CPUs burst to at most 20%, and the other 12 are sitting idle.

I need to make the process faster and actually use the whole box capacity. What am I doing wrong?

share|improve this question

migrated from stackoverflow.com Nov 25 '13 at 18:01

This question came from our site for professional and enthusiast programmers.

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.