Questions tagged [ndbcluster]
NDB Cluster : MySQL's Distributed MultiMaster Storage Engine
113
questions
0
votes
2
answers
29
views
MySql NDB cluster large transaction
I know that with NDB you can not do large transactions, if you do data nodes can restart into read-only mode and corrupt table.
I need to copy records into a new table but the thing is this table ...
- 47
0
votes
0
answers
16
views
mysql ndb-cluster error unknown variable 'ndb_connectstring=172.17.0.27'
I have a working ndb-cluster 8.0.27 community edition in one docker, it works fine. now setting up one in another server docker I get an error [ERROR] [MY-000067] [Server] unknown variable '...
- 47
0
votes
1
answer
662
views
MySQL cluster Replication and Failover via docker-compose
I am using docker-compose to create MySQL cluster (NDB). After cluster gets created. This is my cluster configuration:
ndb_mgm> show
Connected to Management Server at: mysql-manager-1:1186
Cluster ...
- 3
-1
votes
1
answer
75
views
binlog not recording DML statement in mysqlcluster
I have created a MySQL NDB Cluster consisting of 2 data node, 1 mgm node and 1 mysqld for testing. Also i have created a slave for NDB to INNODB replication. My binlog are not recording DML statement ...
0
votes
1
answer
240
views
mysql 8 ndbcluster distributed privileges
I've setup a mysql 8 ndbcluster but cannot get the distributed privileges working.
following how to setup distributed privileges using NDB_STORED_USER (https://dev.mysql.com/doc/refman/8.0/en/mysql-...
1
vote
0
answers
45
views
mysql data node not connecting to node manager on AWS EC2
I am trying to setup mySql manager + data node + sql server (Server A) and another data node cluster on (Server B). Both running on Ubuntu 16.04 amd_64
Server A
/etc/hosts also on Server B
Both ...
0
votes
0
answers
169
views
ProxySQL and MySQL cluster
This article describes the set-up of MySQL cluster with one cluster node, two data nodes and one MySQL server. This article describes the configuration of ProxySQL where, MySQL servers are added into ...
- 145
0
votes
1
answer
184
views
MySQL CLustering Options
I have two MySQL Database Servers i.e.
One is Active Server --> Master and second is Passive Server --> Slave.
And as we know we have 3-4 MySQL HR,DR Solutions / Clustering options.For example
01 : ...
1
vote
0
answers
136
views
MariaDB Galera slave thinks it's replicating, but it isn't
I have a MariaDB 10.3 Galera slave node with general logging turned on. It's consuming binlogs generated by a MySQL 5.5 NDB cluster. The binlog format is row-based in both databases.
SHOW ALL ...
- 111
0
votes
1
answer
695
views
MySQL Cluster - SQL node fail to connect Management Nodes
I am trying to deploy a 2 machines MySQL NDB Cluster with the following architecture:
192.168.1.12 – management node
192.168.1.12 – SQL node
192.168.1.12 – data node
192.168.1.13 – SQL node
192.168....
0
votes
1
answer
333
views
config file and parameters for ndb_desc
I'm trying to execute ndb_desc from API client. The config and parameters are as below:
my.cnf in mysqld:
[mysql_cluster]
ndb-connectstring=192.168.1.1,192.168.1.2
server-id=5
log-bin=mysql-bin
...
- 13
0
votes
2
answers
312
views
Max DATAFILE size in NDB engine
My database setup is using NDB cluster with 2-3 nodes, on CentOS. While trying to test out the performance, i tried to store ~7mil records (around 2GB size) into one of the table. at around ~200k, it ...
- 13
0
votes
1
answer
199
views
partition in ndbcluster
My environment will use 2-3 cluster nodes. The db schema at first was designed without knowing the limitation/rules with NDBCLUSTER on (BIG mistake! I know). Some things I notice and want to ...
- 13
0
votes
1
answer
64
views
Ndb cluster change variable for heartbeat and disconnect
I search for a variable that I can increase in the server that I don't get any more this error:
Node 2 missed heartbeat 2
Node 3 Disconnected
Node 2 Disconnected
I don't find anything.
Regards,
- 137
0
votes
1
answer
72
views
What steps to take to resize an existing MYSQL NDB Cluster?
I have an existing NDB Cluster. It's grown larger than I expected and I need to make it bigger. When I ask the management console for the ALL REPORT MEMORY, it looks like the datamemory is 65% full. ...
- 103
1
vote
1
answer
31
views
Mysql cluster configuration help
I am new to mysql cluster I was reading around the web how to set it up. I came up with 2 different set up not sure which one is better fail safe vs cost efficient. Our new site have clients in USA ...
- 21
0
votes
1
answer
193
views
MySQL clusters - sync a table [closed]
I've been developing a software that runs on hardware and now I need to synchronise DB on them, but only partly - several tables using MySQL Clusters(don't matter which style), each of hardware can ...
- 113
-1
votes
1
answer
317
views
MySQL Cluster - Data Node Restarting when database corrupt
I initially Have MySQL cluster with 2 Management and 2 Datanode. I added 2 Data node online and redistribute its data. So my current cluster setup is 4 Management Node + SQL and 4 Data node.
There ...
- 99
1
vote
1
answer
202
views
What does SPJ stand for in MySQL parlance?
MySQL has a lot of references to SPJ in MySQL including in official Oracle slides but I can't find what it actually stands for. I see it show up in a few blogs too.
I looked in the source and found ...
- 55.7k
2
votes
1
answer
542
views
Can't connect to MySQL NDB manager using ndb_desc
I've got a basic MySQL NDB cluster running - it works well. Manager, data and SQL nodes are all OK. 1 manager, 2 SQL nodes, 4 data nodes. 2 of the data nodes are from the initial creation, 2 are ...
1
vote
0
answers
86
views
MySQL NDB Installer won't start (webserver already running)
I have encountered an odd error where I accidentally closed the shell that was running the python script that launched the installer for NDB cluster. The site stopped working, however, when I try to ...
- 121
0
votes
2
answers
643
views
How to migrate MySQL Cluster (NDB) backup to a different ndb cluster?
I have two MySQL Clusters (NDB), Prod and Dev. Each cluster contains SQL nodes, Management nodes and Data nodes. Backups are done on one cluster using the article below:
https://dev.mysql.com/doc/...
- 3
0
votes
1
answer
645
views
Excessive RAM consumption in MySQL Cluster
at this moment I have configured a cluster that has 5 nodes:
2 data nodes
2 SQL nodes
1 node manager
My file.config.ini is the following:
[ndbd default]
NoOfReplicas = 2 # Number of replicas
...
0
votes
1
answer
111
views
Scaling MySQL Cluster
I have an NDB cluster which consists of 4 data nodes. Some of the configuration parameters and system resources as :
CPU: 32
RAM: 128GB
Replication factor: 2
Data memory: 70GB
Index memory: 10GB
I ...
- 63
0
votes
1
answer
131
views
Adding Memcached plugin to Mysql Cluster Fails to start
I was able to setup a new mysql cluster, with total 6 VMs. New requirement is to add memcache plugin to mysql cluster, memcache failing to start with this error message WARNING -- Failed to allocate ...
- 1
1
vote
1
answer
2k
views
MySQL Cluster 7.3 - NDB engine - Could not connect to storage engine
Setup
I have installed three Oracle Linux 7.3. 2 for data nodes, 1 for management and SQL API node. The machines can ping each other, SSH working, "etc/hosts" files are properly filled:
127.0.0.1 ...
- 11
0
votes
1
answer
385
views
MySQL Cluster Only Sync Partially [closed]
I am new to MySQL, but I have to solve this problem quickly.
I installed FileRun (which is a file share service) on two nodes, those two nodes have MySQL Cluster backend.
In Filerun GUI, I created a ...
- 103
1
vote
0
answers
20
views
How do I control the data that goes into each data node in NDBCLUSTER
I am currently working with NDBCLUSTER.
I have the following table(a dummy example, since I cannot disclose details about actual application, but the structure is similar):
create table student(
...
- 11
1
vote
0
answers
255
views
Why ndb data memory is 94% if i m using disk storage cluster
I have following structure
2 data node
1 management node
2 sql node
i have create one log file of initial size 200M
then created table space and added 3 data file
data1.dat (initial size: 10GB)
...
1
vote
0
answers
28
views
Unexpectedly long query time NDBCluster
I'm having an issue where some queries take an abnormal execution time, meaning 3 to 5 seconds.
This part of the schema is 2 tables A and B, where A has many to one relation to table B.
Table A:
...
- 11
0
votes
1
answer
257
views
Geographical replication zones in MySQL Cluster?
In a default installation, data is shared indiscriminately across all data nodes.
Is it possible to specify that certain tables can only be replicated across a specific group of data nodes?
If so, ...
- 103
0
votes
1
answer
115
views
Deleted config.ini in MySQL cluster by mistake
I was trying to delete cache file of MySQL cluster for rolling restart, but by mistake I deleted the directory /var/lib/mysql-cluster from both the nodes.
I have ndb_1_config.bin.1 file, but how can ...
1
vote
0
answers
52
views
MySQL cluster and big database?
I hava a big mysql database(Innodb) about 50G, how can i import to mysql cluster.
What is the best solution to translate db, save on disk or get a amount memory?
- 11
1
vote
0
answers
25
views
Mysqlcluster data nodes synchronization rate
mysql cluster version: MySQL-Cluster-gpl-7.4.12-1.el6.x86_64
num of datanodes: 2
num of sqlnodes: 2
num of mgmt nodes: 2
Recently one on my datanode server was down(node4) due to power outage. ...
- 155
-1
votes
1
answer
328
views
How do stored procedures work with NDB Mysql Cluster?
We are considering to use Mysql Cluster for sharding. However I can't find how it works with stored procedures.
Is there a way to dispatch procedure invocation on particular shard, based on sharding ...
- 101
0
votes
1
answer
4k
views
MySQL Node not Connecting to Management Nodes in NDB Cluster
I am trying to deploy a 8 machine MySQL NDB Cluster with 2 Management Nodes, 2 SQL Nodes and 4 Data Nodes. The base operating system is Ubuntu 16.04 and the MySQL Cluster software version is 7.5.4. ...
- 3
1
vote
1
answer
252
views
Creating MySQL NDB cluster on Hyper-V
I want to create a MySQL NDB cluster on Hyper-V for testing so I have some questions in this regard.
Can I use Windows XP 32 bit? (because I already have a VM) If not then can I use Windows 7 or 10?
...
- 441
0
votes
1
answer
344
views
mysql cluster with innodb utilizing high memory
I have implemented MySQL cluster with two data, sql and management node respectively.
On one of the sql node I have ndb as well innodb engine for the huge tables which I can not able to convert into ...
2
votes
1
answer
525
views
MySQL NDB Cluster architecture?
I am looking for information that I am not able to find about MySQL cluster.
I have to justify if it is possible to install in a production environment the three types of nodes (MySQL node + Data ...
0
votes
2
answers
213
views
MySQL NDB Cluster settings to prefer data node on localhost than remote
My current MySQL NDB Cluster configuration:
Server 1 - management node
Server 2 - huge machine running both ndbd and mysqld
Server 3 - huge machine running both ndbd and mysqld
NoOfReplicas = 1
So ...
- 149
2
votes
1
answer
1k
views
Poor usage of timestamp index
with a small table (about 2 M of rows, 5 classic columns, id, description, title, created_at, coordinates (point)) doing a WHERE created_at BETWEEN ... AND ... ORDER BY created_at LIMIT 50 is very ...
- 61
2
votes
0
answers
67
views
Mysql Cluster distribute data only one node..why?
here are following setup
ndb_mgm -e show
Connected to Management Server at: us-srv1.site.vrack:1186
Cluster Configuration
---------------------
[ndbd(NDB)] 2 node(s)
id=3 @192.168.0.2 (mysql-...
- 133
1
vote
2
answers
1k
views
Out of operation records in local data manager (increase MaxNoOfLocalOperations) from NDBCLUSTER
MaxNoOfConcurrentOperations=150000
MaxNoOfConcurrentTransactions=150000
MaxNoOfLocalOperations=150000
I have above parameters in config.ini, when i try to delete rows in a table i get below error
...
- 155
0
votes
1
answer
96
views
How mysqlcluster can be durable and consistent?
I'm little noob and learning on how to use mysqlcluster,i have 1 management 2 datanode and 2 sqlnodes.According to a book "mysql cookbook" -alex davies and localcheckpoints and globalcheckpoints
By ...
- 155
1
vote
0
answers
271
views
Can I fix Lost arbitrator node errors in MySQL Cluster / NDB?
I have a cluster of eight MySQL Cluster nodes running NDB. At seemingly random intervals (around 1.5 weeks on average, but they seem to come in spurts when they show up), I see a pair of messages like ...
- 121
1
vote
1
answer
637
views
three-table JOIN query on a MySQL Cluster has become unusably slow
I have a select query called by a script to our MySQL Cluster that has gone from running in a second or two to taking well over a minute per query (and it has to run this query 24000 times). Nothing ...
- 13
2
votes
1
answer
1k
views
All queries are so slow on mysql NDB cluster
Here is my situation:
I got over 10G of web logs (around 30 million rows) and I mainly search it with various conditions.
e.g.:
select * from tbl
where ip = '123.123.12.3'
and agent = '...
- 23
2
votes
1
answer
532
views
MySQL NDB cluster maximum data size
According to the limitations outlined at http://dev.mysql.com/doc/refman/5.7/en/mysql-cluster-limitations.html, there can only be 48 data nodes.
Does that mean, with number of replicas 2, I can ...
- 121
2
votes
0
answers
166
views
Add index to mysql table with ndbcluster engine
I'm having trouble while adding index on mysql table with ndbcluster storage engine below is the error . [mysqlcluster ver. 7.4 GA]
mysql> alter table `sks_staff_office` add index `pid_index` (pid)...
- 155
2
votes
1
answer
2k
views
MySQL Cluster: API node won't start successfully
I am working on setting up a MySQL NDB cluster in a test environment. I have 1 management node, 2 SQL nodes and 4 NDB nodes. The management nodes and NDB nodes all start successfully. They are ...
- 93