I want to performance test (aka bake-off) MySQL server rpm against some other forks such as Percona server, MariaDB, and possibly some others. I'm hoping that by asking this question I can better understand the methodology behind setting up a proper performance test. I planned on using sysbench to run my actual test, but I'm open to anything.
- What steps should I be taking to ensure that the test results in a apples-to-apples comparison and that only the RDBMS is the variant?
- Where do I get started?
- How do I evaluate results?
- What advice can you give me?