NDB Cluster : MySQL's Distributed MultiMaster Storage Engine

learn more… | top users | synonyms

9
votes
2answers
5k views

MySQL Sharding vs MySQL Cluster

Considering performance only, can a MySQL Cluster beat a custom data sharding MySQL solution? sharding = horizontal partitioning When I refer to sharding, I'm considering sharding made in the ...
8
votes
2answers
3k views

What are the benefits of using MySQL Cluster?

I have never dipped my hands in MySQL Cluster and want to know how it can benefit me. When is it best to use it, and does it have performance benefits?
7
votes
4answers
3k views

MySQL Cluster RAM requirement

From MySQL 5.1, the data doesn't need to be entirely in memory anymore. I've read that the indexed columns (I think the entire index structure) must still be in memory (MySQL High Availability, 2010, ...
4
votes
2answers
287 views

fast bulk incrementing in MySQL

I have one big table foobar describing a many-to-many-relation and containing millions of foo's, millions of bar's and every bar having several hundereds of foo's -> billions of rows. CREATE TABLE ...
4
votes
2answers
385 views

Is MySQL Clustering a viable option for a DB expecting 5TB of data in 5 years?

We plan to implement MySQL Clustering.The database should support 5 years of data and expected data/year is 1TB. When we created a test enviornment with the DB size as 200GB, NDB Cluster took more ...
3
votes
1answer
288 views

Slow-running query on clustered MySQL environment

I've got a very simple query, directly equivalent to SELECT * FROM sometable t WHERE somecol = 'somevalue' ORDER BY createdon DESC LIMIT 0,20000; When I run this query on my non-clustered ...
3
votes
1answer
836 views

mysql, changing tables from myisam to ndb

Gents, Converting a table from myisam to ndb via: ALTER TABLE piwik_log_profiling ENGINE NDBCLUSTER; This will fail with: BLOB column 'query' can't be used in key specification with the used ...
3
votes
1answer
220 views

How do I configure a MySQL Cluster with a redundant mysqld host?

this is my first post here, so go easy on me. I'm trying to rebuild my data architecture (which is currently a set of one primary MySQL server and a redundant fallback; the tables are primarily ...
3
votes
2answers
779 views

How much data is needed to show MySQL Cluster's performance scaling vs. InnoDB

I am evaluating MySQL Cluster as a possible replacement for an InnoDB schema. So far, I have tested it with 10s of MB of data, and found MySQL Cluster slower than InnoDB; however, I have been told ...
2
votes
3answers
2k views

What's the difference between master and slave nodes in MySQL Cluster?

I use MySQL Cluster 7.1.15a. I have 2 nodes, ndb_mgm -e shows: [ndbd(NDB)] 2 node(s) id=3 @X (mysql-5.1.56 ndb-7.1.15, starting, Nodegroup: 0, Master) id=4 @Y (mysql-5.1.56 ndb-7.1.15, ...
2
votes
3answers
589 views

Need help configuring Memcached to store values in MySQL Cluster

I am working on a Memcached implementation with MySQL Cluster 7.2. I have installed and configured memcached with following parameters: PORT="11211" USER="mysql" MAXCONN="1024" CACHESIZE="1024" ...
2
votes
1answer
215 views

How to solve the error “Error 'Got error 0 'No error' from NDBCLUSTER' on query”?

I'm currently working with a large network of MySQL 5.1 DBs (using MyISAM tables) and I'm evaluating a move to MySQL Cluster. I would like to have the MySQL Cluster replicate off of one of the ...
2
votes
2answers
468 views

Using all the CPU cores by NDBD and MySQL

We are running MariaDB which is a fork of MySQL with NDB cluster engine. The cluster includes one mysql node and two ndb data nodes. While benchmarking the cluster, we are trying to make a bottleneck ...
2
votes
1answer
140 views

MySQL cluster DataMemory and DiskPageBufferMemory parameters

I want to setup a MySQL cluster. The amount of data is more than double the amount of RAM. I have 3 Data Nodes each with 8GB RAM. QUESTIONS What is a good rule for the DataMemory and ...
2
votes
2answers
2k views

MySQL Cluster: Problem Connecting the SQL node

In a MySQL cluster I have three hosts, one with a manager node, and the other two are each both a data node and sql node. Connecting to the manager is possible, however only as [ndbd] and not ...
2
votes
1answer
290 views

Redesigning a multi-instance MySQL server for performance and resiliency

I've got a single MySQL server which currently runs N separate MySQL instances on, which are rapidly growing beyond the capabilities of that box. Is it possible to have an active-active MySQL ...
2
votes
1answer
476 views

Dual management node for mysql clustering

I currently have mysql cluster setup and running. Here is my current setup: 1 - management node 2 - data nodes 2 - mysql nodes I wish to incorporate a failover for the management node. The ...
2
votes
1answer
1k views

Does mysqld --ndb-cluster need to be run on MySQL Cluster data nodes?

I have my management node and sql node on the same server, and 2 data nodes (3 machines in total). Do I need to run ./mysqld --ndb-cluster (or /etc/init.d/mysql-server start) on 1) the data nodes, or ...
2
votes
1answer
278 views

Alter mysql database engine doesn't work from cluster to other

I got into this issue when I tried to alter my database table engine to InnoDB from ndbcluster, It did not work. But When I changed engine from InnoDB to ndbcluster it worked. It did not throw any ...
2
votes
0answers
611 views

MySQL Cluster LOAD DATA too slow

mysql-5.5.22 ndb-7.2.6 cluster 64bit running on Centos 6 with each node installed on the same Citrix Xen Server communicating via a virtual private network. Each node has 4GB of RAM, 4 vCPUs and 10GB ...
2
votes
0answers
90 views

Can't connect to MySQL Cluster Storage (data) nodes

I've deployed a MySQL Cluster with a few nodes, and I want to access the storage nodes directly from another machine using NDBAPI. When I tried to connect from the same host it worked, but when I try ...
1
vote
1answer
114 views

Data usage increases initially when reorganize partition mysql cluster

In my MySQL cluster, the data usage of 4 data nodes is approximately 77%. I added a new data node online, and attempted to reorganize partition to redistribute data among all data nodes. But before ...
1
vote
2answers
310 views

MySQL statement in Project Voldemort site

I've just entered Project Voldemort (a NoSQL key-value datastore) site, and saw something interesting: "Unlike MySQL replication, both reads and writes scale horizontally" Well, seems like ...
1
vote
1answer
45 views

MySQL Cluster ndb_desc and parttions

I have mysql cluster with two datanodes and noofreplicas=2. According to documentation there must be 1 nodegroup, 2 partitions and 4 parts at all (2 primary and 2 backup). I have a table with 1000000 ...
1
vote
1answer
146 views

MySQL Cluster Steps To Recover Data If Catstrophic Failure Occurs

I want to know if a catstrophic failure occurs (like a power outage), and all nodes in MySQL Cluster are shutdown in cluster then data will be lost even though a backup was taken? Or it possible that ...
1
vote
1answer
179 views

MySQL row length is almost the triple of what I expect

I shamelessly took title and content from this question and adapted it to my similar yet different problem: This is the table I have: CREATE TABLE `test` ( `field1` MEDIUMINT(8) UNSIGNED NOT ...
1
vote
1answer
446 views

Unable to connect to MySQL cluster database

I am unable to connect to mysql cluster database after starting my management node, data node, mysql node. I made the necessary changes by adding the loadbalance in the dbURL. But I am not able to ...
1
vote
1answer
207 views

MySql cluster data node replication

What I'd like to do is to replicate data nodes within a cluster not only for backup/failover purposes but also for scale-out reasons. Is this possible? If not: why? If yes: how do I do it? Actually, ...
1
vote
2answers
353 views

Mysql cluster fast inserts but slow selects

I have a mysql cluster with 3 Data Nodes and one SQL node. Curently I have 1million 1kb records. The inserts are very fast, takes only a few ms. But the selects are very slow >20s. All machines are ...
1
vote
2answers
104 views

What is a mysqld process in a MySQL cluster?

As I know, a mysqld process is a kind of a router of a MySQl cluster. It directs requests to the right ndbd node. Assuming I have 3 ndbd nodes on 3 different machines and I don't use replication. How ...
1
vote
0answers
202 views

Delete operation mysql cluster

I am trying to delete some entries from table on a cluster and I get this error ERROR 1297 (HY000): Got temporary error 233 'Out of operation records in transaction coordinator (increase ...
1
vote
2answers
515 views

Which one to use? InnoDB Replication or MySQL Cluster?

I am building a url shortener and I use InnoDB as the storage engine for link data. I will start with a single VPS containing both application instance and MySQL database instance on the same Virtual ...
1
vote
0answers
128 views

Error in alter table reorganize partition for MySQL Cluster

My cluster contains 48 million rows and cluster contains 4 storage nodes . After that I add online storage node and executed alter table 'customer_tbl' reorganize partition. Some parameters of ...
1
vote
0answers
477 views

MySQL cluster stuck in start phase 4, how to proceed?

Over the weekend our cluster we set up for evaluation had one of its data nodes lose network connectivity briefly. This was while another data node was in the middle of a restart (which had been going ...
1
vote
1answer
316 views

How to removing or reduce the size of redo logs in MySQL cluster

Can anybody tell me that how can we reduce the redo log file size or can we remove the redo log file size in MySQL Cluster and also what will be the impact of it on performance of cluster.Also can we ...
1
vote
0answers
121 views

MySQL Cluster — Storing table data on data nodes [duplicate]

Possible Duplicate: MySQL Cluster — Storing table data on data nodes I have setup MySQL Cluster with the MySQL server node and the Management node on a single server, and 2 data nodes ...
1
vote
1answer
86 views

MySQL cluster concurrency

I have a little application that executes select queries against a MySQL cluster. By using 1 thread to read a record the latency is x. By using 2 threads to read records concurrently the avg latency ...
0
votes
1answer
189 views

Redo Logs Mysql Cluster

The mysql cluster has 4 directories namely D8 D9 D10 D11 for redo logfiles. But while inserting into table only one redo directory is used. I ran following command to get redo information "all dump ...
0
votes
2answers
1k views

Backup plan for MySQL NDB cluster databse not innoDB

I have a Database which will grow more than 250GB all data is in NDB engine(2 datanodes) and no other mysql engine used for data store. What are the best approaches or plans for MySQL Cluster NDB ...
0
votes
2answers
943 views

MySQL Cluster - Table is full [Error 1114] while still creating tables

I am trying to forward engineer a MySQL Workbench model with about 100 tables to a development single-node cluster and, while creating the 51th table, I end up getting a "1114 table is full" error, ...
0
votes
2answers
1k views

MySQL how to release memory used up by SELECT

I executed an INSERT IGNORE combined with SELECT from large table. The SELECT took up 16GB of memory and went into SWAP before I terminated it with CTRL+C. INSERT IGNORE INTO sid(sid) SELECT sid ...
0
votes
1answer
388 views

Better diagnostics when starting ndb nodes?

I have an ubuntu linux server that uses mysql cluster 7.2.5 x64. Whenever I start an ndb node and check with ndb_mgm -e show, it stays in "starting" state for a long time. When I use top to check the ...
0
votes
1answer
111 views

Problem with MySQL Cluster in practice

I am researching MySQL cluster. For the purpose, I do a demo with 4 virtual machines. I have some problems in practice. Topology My topology contains four nodes Node 1: management node, ip address ...
0
votes
0answers
35 views

High CPU usage for in-memory NDBCLUSTER

I have a few NDBCLUSTER tables in a MySQL cluster setup. Each table has less than 25,000 rows. All tables in question are set up to be fully in-memory for both indexes and data. The tables are ...
0
votes
1answer
59 views

getting “table is full” error even if the table size is much smaller than tablespace

Currently I am using MySQL NDBCluster 7.3.5. I have created one UNDOFILE hhme.dat with INITIAL_SIZE=200m. Also one tablespace hhmefep_tbs with DATAFILE hhmefep_tbs.dat having INITIAL_SIZE=500M ...
0
votes
0answers
46 views

Not getting satisfactory performance improvement with NDB Cluster

Since last few days, I am trying to improve performance of MySQL NDB Cluster but can't figure out what I am missing/being mistaken in defining/tuning parameters. I have these configurations running ...
0
votes
0answers
1k views

getting SQL Error (1452): Cannot add or update a child row: a foreign key constraint fails (Unknown error code)

I am getting error with MySQL NDB Cluster 7.3.5 as described below: I have two tables: -User Profiles -User Services User services is a child table which contains foreign key constraint ...
0
votes
0answers
89 views

MySQL Cluster management node does not start (node has different checksum)

Please help me to start data management node. I have installed cluster with autoinstaller and it was working. Now i'm trying to change config (i want to change amount of DataMemory) and run cluster. I ...
0
votes
1answer
288 views

mysql cluster table full error

I installed a new mysql cluster on windows (for evaluation). I created a table using command below. After I insert just over 1 million records into the table it gives me the "table datadump is full" ...
0
votes
0answers
47 views

Why so much traffic between SQL Node and Data Node?

For a MySQL cluster I use one SQL Node and two DataNodes. On one Data Node I have started the linux command tcpdump and have observed the communication between the SQL and Data Node while I have ...