NDB Cluster : MySQL's Distributed MultiMaster Storage Engine

learn more… | top users | synonyms

11
votes
2answers
6k views

MySQL Sharding vs MySQL Cluster

Considering performance only, can a MySQL Cluster beat a custom data sharding MySQL solution? sharding = horizontal partitioning When I refer to sharding, I'm considering sharding made in the ...
9
votes
2answers
4k views

What are the benefits of using MySQL Cluster?

I have never dipped my hands in MySQL Cluster and want to know how it can benefit me. When is it best to use it, and does it have performance benefits?
7
votes
4answers
4k views

MySQL Cluster RAM requirement

From MySQL 5.1, the data doesn't need to be entirely in memory anymore. I've read that the indexed columns (I think the entire index structure) must still be in memory (MySQL High Availability, 2010, ...
4
votes
2answers
394 views

fast bulk incrementing in MySQL

I have one big table foobar describing a many-to-many-relation and containing millions of foo's, millions of bar's and every bar having several hundereds of foo's -> billions of rows. CREATE TABLE ...
4
votes
2answers
508 views

Is MySQL Clustering a viable option for a DB expecting 5TB of data in 5 years?

We plan to implement MySQL Clustering.The database should support 5 years of data and expected data/year is 1TB. When we created a test enviornment with the DB size as 200GB, NDB Cluster took more ...
4
votes
1answer
580 views

How to removing or reduce the size of redo logs in MySQL cluster

Can anybody tell me that how can we reduce the redo log file size or can we remove the redo log file size in MySQL Cluster and also what will be the impact of it on performance of cluster.Also can we ...
3
votes
3answers
688 views

Need help configuring Memcached to store values in MySQL Cluster

I am working on a Memcached implementation with MySQL Cluster 7.2. I have installed and configured memcached with following parameters: PORT="11211" USER="mysql" MAXCONN="1024" CACHESIZE="1024" ...
3
votes
2answers
533 views

Using all the CPU cores by NDBD and MySQL

We are running MariaDB which is a fork of MySQL with NDB cluster engine. The cluster includes one mysql node and two ndb data nodes. While benchmarking the cluster, we are trying to make a bottleneck ...
3
votes
1answer
322 views

Slow-running query on clustered MySQL environment

I've got a very simple query, directly equivalent to SELECT * FROM sometable t WHERE somecol = 'somevalue' ORDER BY createdon DESC LIMIT 0,20000; When I run this query on my non-clustered ...
3
votes
1answer
540 views

Alter mysql database engine doesn't work from cluster to other

I got into this issue when I tried to alter my database table engine to InnoDB from ndbcluster, It did not work. But When I changed engine from InnoDB to ndbcluster it worked. It did not throw any ...
3
votes
1answer
1k views

mysql, changing tables from myisam to ndb

Gents, Converting a table from myisam to ndb via: ALTER TABLE piwik_log_profiling ENGINE NDBCLUSTER; This will fail with: BLOB column 'query' can't be used in key specification with the used ...
3
votes
1answer
229 views

How do I configure a MySQL Cluster with a redundant mysqld host?

this is my first post here, so go easy on me. I'm trying to rebuild my data architecture (which is currently a set of one primary MySQL server and a redundant fallback; the tables are primarily ...
3
votes
2answers
1k views

How much data is needed to show MySQL Cluster's performance scaling vs. InnoDB

I am evaluating MySQL Cluster as a possible replacement for an InnoDB schema. So far, I have tested it with 10s of MB of data, and found MySQL Cluster slower than InnoDB; however, I have been told ...
2
votes
3answers
3k views

What's the difference between master and slave nodes in MySQL Cluster?

I use MySQL Cluster 7.1.15a. I have 2 nodes, ndb_mgm -e shows: [ndbd(NDB)] 2 node(s) id=3 @X (mysql-5.1.56 ndb-7.1.15, starting, Nodegroup: 0, Master) id=4 @Y (mysql-5.1.56 ndb-7.1.15, ...
2
votes
1answer
314 views

How to solve the error “Error 'Got error 0 'No error' from NDBCLUSTER' on query”?

I'm currently working with a large network of MySQL 5.1 DBs (using MyISAM tables) and I'm evaluating a move to MySQL Cluster. I would like to have the MySQL Cluster replicate off of one of the ...
2
votes
1answer
309 views

MySQL cluster DataMemory and DiskPageBufferMemory parameters

I want to setup a MySQL cluster. The amount of data is more than double the amount of RAM. I have 3 Data Nodes each with 8GB RAM. QUESTIONS What is a good rule for the DataMemory and ...
2
votes
2answers
3k views

MySQL Cluster: Problem Connecting the SQL node

In a MySQL cluster I have three hosts, one with a manager node, and the other two are each both a data node and sql node. Connecting to the manager is possible, however only as [ndbd] and not ...
2
votes
1answer
335 views

Redesigning a multi-instance MySQL server for performance and resiliency

I've got a single MySQL server which currently runs N separate MySQL instances on, which are rapidly growing beyond the capabilities of that box. Is it possible to have an active-active MySQL ...
2
votes
1answer
675 views

Dual management node for mysql clustering

I currently have mysql cluster setup and running. Here is my current setup: 1 - management node 2 - data nodes 2 - mysql nodes I wish to incorporate a failover for the management node. The ...
2
votes
1answer
1k views

Does mysqld --ndb-cluster need to be run on MySQL Cluster data nodes?

I have my management node and sql node on the same server, and 2 data nodes (3 machines in total). Do I need to run ./mysqld --ndb-cluster (or /etc/init.d/mysql-server start) on 1) the data nodes, or ...
2
votes
0answers
867 views

MySQL Cluster LOAD DATA too slow

mysql-5.5.22 ndb-7.2.6 cluster 64bit running on Centos 6 with each node installed on the same Citrix Xen Server communicating via a virtual private network. Each node has 4GB of RAM, 4 vCPUs and 10GB ...
2
votes
0answers
101 views

Can't connect to MySQL Cluster Storage (data) nodes

I've deployed a MySQL Cluster with a few nodes, and I want to access the storage nodes directly from another machine using NDBAPI. When I tried to connect from the same host it worked, but when I try ...
1
vote
1answer
170 views

Data usage increases initially when reorganize partition mysql cluster

In my MySQL cluster, the data usage of 4 data nodes is approximately 77%. I added a new data node online, and attempted to reorganize partition to redistribute data among all data nodes. But before ...
1
vote
2answers
341 views

MySQL statement in Project Voldemort site

I've just entered Project Voldemort (a NoSQL key-value datastore) site, and saw something interesting: "Unlike MySQL replication, both reads and writes scale horizontally" Well, seems like ...
1
vote
1answer
174 views

MySQL Cluster ndb_desc and parttions

I have mysql cluster with two datanodes and noofreplicas=2. According to documentation there must be 1 nodegroup, 2 partitions and 4 parts at all (2 primary and 2 backup). I have a table with 1000000 ...
1
vote
2answers
903 views

Mysql cluster fast inserts but slow selects

I have a mysql cluster with 3 Data Nodes and one SQL node. Curently I have 1million 1kb records. The inserts are very fast, takes only a few ms. But the selects are very slow >20s. All machines are ...
1
vote
1answer
198 views

MySQL Cluster Steps To Recover Data If Catstrophic Failure Occurs

I want to know if a catstrophic failure occurs (like a power outage), and all nodes in MySQL Cluster are shutdown in cluster then data will be lost even though a backup was taken? Or it possible that ...
1
vote
1answer
220 views

MySQL row length is almost the triple of what I expect

I shamelessly took title and content from this question and adapted it to my similar yet different problem: This is the table I have: CREATE TABLE `test` ( `field1` MEDIUMINT(8) UNSIGNED NOT ...
1
vote
1answer
600 views

Unable to connect to MySQL cluster database

I am unable to connect to mysql cluster database after starting my management node, data node, mysql node. I made the necessary changes by adding the loadbalance in the dbURL. But I am not able to ...
1
vote
1answer
237 views

MySql cluster data node replication

What I'd like to do is to replicate data nodes within a cluster not only for backup/failover purposes but also for scale-out reasons. Is this possible? If not: why? If yes: how do I do it? Actually, ...
1
vote
2answers
156 views

What is a mysqld process in a MySQL cluster?

As I know, a mysqld process is a kind of a router of a MySQl cluster. It directs requests to the right ndbd node. Assuming I have 3 ndbd nodes on 3 different machines and I don't use replication. How ...
1
vote
0answers
473 views

Delete operation mysql cluster

I am trying to delete some entries from table on a cluster and I get this error ERROR 1297 (HY000): Got temporary error 233 'Out of operation records in transaction coordinator (increase ...
1
vote
2answers
2k views

Which one to use? InnoDB Replication or MySQL Cluster?

I am building a url shortener and I use InnoDB as the storage engine for link data. I will start with a single VPS containing both application instance and MySQL database instance on the same Virtual ...
1
vote
0answers
191 views

Error in alter table reorganize partition for MySQL Cluster

My cluster contains 48 million rows and cluster contains 4 storage nodes . After that I add online storage node and executed alter table 'customer_tbl' reorganize partition. Some parameters of ...
1
vote
0answers
692 views

MySQL cluster stuck in start phase 4, how to proceed?

Over the weekend our cluster we set up for evaluation had one of its data nodes lose network connectivity briefly. This was while another data node was in the middle of a restart (which had been going ...
1
vote
0answers
123 views

MySQL Cluster — Storing table data on data nodes [duplicate]

Possible Duplicate: MySQL Cluster — Storing table data on data nodes I have setup MySQL Cluster with the MySQL server node and the Management node on a single server, and 2 data nodes ...
1
vote
1answer
150 views

MySQL cluster concurrency

I have a little application that executes select queries against a MySQL cluster. By using 1 thread to read a record the latency is x. By using 2 threads to read records concurrently the avg latency ...
0
votes
1answer
423 views

Redo Logs Mysql Cluster

The mysql cluster has 4 directories namely D8 D9 D10 D11 for redo logfiles. But while inserting into table only one redo directory is used. I ran following command to get redo information "all dump ...
0
votes
2answers
2k views

Backup plan for MySQL NDB cluster databse not innoDB

I have a Database which will grow more than 250GB all data is in NDB engine(2 datanodes) and no other mysql engine used for data store. What are the best approaches or plans for MySQL Cluster NDB ...
0
votes
2answers
2k views

MySQL Cluster - Table is full [Error 1114] while still creating tables

I am trying to forward engineer a MySQL Workbench model with about 100 tables to a development single-node cluster and, while creating the 51th table, I end up getting a "1114 table is full" error, ...
0
votes
2answers
2k views

MySQL how to release memory used up by SELECT

I executed an INSERT IGNORE combined with SELECT from large table. The SELECT took up 16GB of memory and went into SWAP before I terminated it with CTRL+C. INSERT IGNORE INTO sid(sid) SELECT sid ...
0
votes
1answer
702 views

Better diagnostics when starting ndb nodes?

I have an ubuntu linux server that uses mysql cluster 7.2.5 x64. Whenever I start an ndb node and check with ndb_mgm -e show, it stays in "starting" state for a long time. When I use top to check the ...
0
votes
0answers
8 views

Mysql Cluster Data Node Hangs on Phase 5 While Starting

I have an mysql cluster which have 4 api nodes, 2 management nodes and 4 data nodes. Today one of data nodes has gone offline due missing heartbeat. After i tried to restart, it hangs on phase 5. I ...
0
votes
0answers
21 views

Mysql Cluster Exceeding MaxBufferedEpochs

I have an mysql cluster which have 4 api nodes, 2 management nodes and 4 data nodes. Today, I was having problems while trying to connect database and all queries was hanging at "Opening tables" ...
0
votes
1answer
105 views

Lock wait timeout exceeded; try restarting transaction in NDB

I encountered an error while using an opensource product with a mysql cluster. The error stacktrace is shown below. Caused by: java.sql.SQLException: Lock wait timeout exceeded; try restarting ...
0
votes
1answer
12 views

MySQL NDBcluster 7.3 limitation on Table Joining in a single SQL statement

I am a novice user of Mysql database and recently my company is evaluating MySQL Cluster for its shared nothing architecture and synchronised replication. However my colleagues informed me that the ...
0
votes
1answer
86 views

Mysql Cluster Ndb Restore Foreign key constraint violated

I am trying to restore mysql cluster backup on slave cluster. When i run ndb_restore command it gives me following error: $ /usr/local/mysql/bin/ndb_restore -n 6 -b 15 -r ./6 Opening file ...
0
votes
1answer
139 views

ndbcluster: Error: 1114, The table is full, when using table

I have searched for a while about this error. I have a MySQL cluster running with 2 data nodes. The cluster houses a few other databases. I have a dump of a database in --tab format from another ...
0
votes
0answers
79 views

Temporary table not supported in MySQL Cluster

I am new to MySQL Cluster and as I don't have opportunity to try it now I am interested in one thing. In the official pages of MySQL Cluster, there is a statement about temporary tables for NDB ...
0
votes
1answer
246 views

NDB Cluster seems to ignore foreign_key_checks=OFF

According to MySQL documentation on the local foreign_key_checks variable Beginning with MySQL Cluster NDB 7.3.2, setting this variable has the same effect on NDB tables as it does for InnoDB ...