I need to do a serious migration of data from MySQL to MongoDB. I have dumped the actual database from its server to the Amazon AWS box. I set up a powerful Amazon AWS Ubuntu EC2 12.04.3 type c3.4xlarge instance in order to achieve that faster. I have installed Percona Server on it and copied
my.cnf in the
I have set
1024M in [mysqld] and
2048 in the [mysqldump]thread_concurency to 32 (I have 16 virtual CPUs).
I have set ulimit to:
core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 240176 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 64000 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 240176 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
I am trying to restore 5 GB or dump file with the command
mysql -uroot -p dbname < dump_file.sql, and it's taking forever.
The server is using at most 1 GB out of 30 GB, and occasionally four CPUs burst to at most 20%, and the other 12 are sitting idle.
I need to make the process faster and actually use the whole box capacity. What am I doing wrong?