Questions tagged [ndbcluster]
NDB Cluster : MySQL's Distributed MultiMaster Storage Engine
115
questions
0
votes
1
answer
62
views
MySQL NDB Cluster Community - High memory utilization by mysqld only on source/replica nodes
I have two MySQL NDB community clusters 8.0.30, each with 3 VMs
Cluster#1_VM1: mysqld + ndb_mgmd
Cluster#1_VM2: mysqld + ndb
Cluster#1_VM3: mysqld + ndb
Cluster#2_VM1: mysqld + ndb_mgmd
Cluster#2_VM2: ...
0
votes
2
answers
159
views
Can't drop an NDB database because the storage engine is unavailable
I tried to set up a MySQL cluster and failed. I finally got it switched back to standard MySQL, but now I have an ndbinfo database that I cannot drop. It causes my automysqlbackup cron job to report ...
- 103
0
votes
0
answers
28
views
Is having a backup database system ready for when my database cluster fails a good idea?
We have a MySQL database cluster using NDB with four nodes, two in each datacenter.
The database uptime is very important, it must be up 24x7 and we cannot affort downtime.
Is the following a good ...
- 101
0
votes
1
answer
52
views
NDB Cluster Read and Write Process multiple Access
When using the MySQL NDB Cluster distributed database, the following general problem has arisen: To insert a new Record / Row, the last row in the database should be read, see if it is compatible with ...
0
votes
2
answers
159
views
MySql NDB cluster large transaction
I know that with NDB you can not do large transactions, if you do data nodes can restart into read-only mode and corrupt table.
I need to copy records into a new table but the thing is this table ...
- 47
0
votes
1
answer
1k
views
MySQL cluster Replication and Failover via docker-compose
I am using docker-compose to create MySQL cluster (NDB). After cluster gets created. This is my cluster configuration:
ndb_mgm> show
Connected to Management Server at: mysql-manager-1:1186
Cluster ...
- 3
-1
votes
1
answer
135
views
binlog not recording DML statement in mysqlcluster
I have created a MySQL NDB Cluster consisting of 2 data node, 1 mgm node and 1 mysqld for testing. Also i have created a slave for NDB to INNODB replication. My binlog are not recording DML statement ...
0
votes
1
answer
354
views
mysql 8 ndbcluster distributed privileges
I've setup a mysql 8 ndbcluster but cannot get the distributed privileges working.
following how to setup distributed privileges using NDB_STORED_USER (https://dev.mysql.com/doc/refman/8.0/en/mysql-...
1
vote
1
answer
169
views
mysql data node not connecting to node manager on AWS EC2
I am trying to setup mySql manager + data node + sql server (Server A) and another data node cluster on (Server B). Both running on Ubuntu 16.04 amd_64
Server A
/etc/hosts also on Server B
Both ...
0
votes
0
answers
265
views
ProxySQL and MySQL cluster
This article describes the set-up of MySQL cluster with one cluster node, two data nodes and one MySQL server. This article describes the configuration of ProxySQL where, MySQL servers are added into ...
- 145
0
votes
1
answer
227
views
MySQL CLustering Options
I have two MySQL Database Servers i.e.
One is Active Server --> Master and second is Passive Server --> Slave.
And as we know we have 3-4 MySQL HR,DR Solutions / Clustering options.For example
01 : ...
1
vote
0
answers
201
views
MariaDB Galera slave thinks it's replicating, but it isn't
I have a MariaDB 10.3 Galera slave node with general logging turned on. It's consuming binlogs generated by a MySQL 5.5 NDB cluster. The binlog format is row-based in both databases.
SHOW ALL ...
- 111
0
votes
1
answer
1k
views
MySQL Cluster - SQL node fail to connect Management Nodes
I am trying to deploy a 2 machines MySQL NDB Cluster with the following architecture:
192.168.1.12 – management node
192.168.1.12 – SQL node
192.168.1.12 – data node
192.168.1.13 – SQL node
192.168....
0
votes
1
answer
464
views
config file and parameters for ndb_desc
I'm trying to execute ndb_desc from API client. The config and parameters are as below:
my.cnf in mysqld:
[mysql_cluster]
ndb-connectstring=192.168.1.1,192.168.1.2
server-id=5
log-bin=mysql-bin
...
- 13
0
votes
2
answers
406
views
Max DATAFILE size in NDB engine
My database setup is using NDB cluster with 2-3 nodes, on CentOS. While trying to test out the performance, i tried to store ~7mil records (around 2GB size) into one of the table. at around ~200k, it ...
- 13
0
votes
1
answer
248
views
partition in ndbcluster
My environment will use 2-3 cluster nodes. The db schema at first was designed without knowing the limitation/rules with NDBCLUSTER on (BIG mistake! I know). Some things I notice and want to ...
- 13
0
votes
1
answer
118
views
Ndb cluster change variable for heartbeat and disconnect
I search for a variable that I can increase in the server that I don't get any more this error:
Node 2 missed heartbeat 2
Node 3 Disconnected
Node 2 Disconnected
I don't find anything.
Regards,
- 137
0
votes
1
answer
116
views
What steps to take to resize an existing MYSQL NDB Cluster?
I have an existing NDB Cluster. It's grown larger than I expected and I need to make it bigger. When I ask the management console for the ALL REPORT MEMORY, it looks like the datamemory is 65% full. ...
- 103
1
vote
1
answer
34
views
Mysql cluster configuration help
I am new to mysql cluster I was reading around the web how to set it up. I came up with 2 different set up not sure which one is better fail safe vs cost efficient. Our new site have clients in USA ...
- 21
0
votes
1
answer
248
views
MySQL clusters - sync a table [closed]
I've been developing a software that runs on hardware and now I need to synchronise DB on them, but only partly - several tables using MySQL Clusters(don't matter which style), each of hardware can ...
- 123
-1
votes
1
answer
350
views
MySQL Cluster - Data Node Restarting when database corrupt
I initially Have MySQL cluster with 2 Management and 2 Datanode. I added 2 Data node online and redistribute its data. So my current cluster setup is 4 Management Node + SQL and 4 Data node.
There ...
- 99
1
vote
1
answer
443
views
What does SPJ stand for in MySQL parlance?
MySQL has a lot of references to SPJ in MySQL including in official Oracle slides but I can't find what it actually stands for. I see it show up in a few blogs too.
I looked in the source and found ...
- 62.1k
2
votes
1
answer
683
views
Can't connect to MySQL NDB manager using ndb_desc
I've got a basic MySQL NDB cluster running - it works well. Manager, data and SQL nodes are all OK. 1 manager, 2 SQL nodes, 4 data nodes. 2 of the data nodes are from the initial creation, 2 are ...
user146053
1
vote
0
answers
88
views
MySQL NDB Installer won't start (webserver already running)
I have encountered an odd error where I accidentally closed the shell that was running the python script that launched the installer for NDB cluster. The site stopped working, however, when I try to ...
- 121
0
votes
2
answers
849
views
How to migrate MySQL Cluster (NDB) backup to a different ndb cluster?
I have two MySQL Clusters (NDB), Prod and Dev. Each cluster contains SQL nodes, Management nodes and Data nodes. Backups are done on one cluster using the article below:
https://dev.mysql.com/doc/...
- 3
1
vote
1
answer
727
views
Excessive RAM consumption in MySQL Cluster
at this moment I have configured a cluster that has 5 nodes:
2 data nodes
2 SQL nodes
1 node manager
My file.config.ini is the following:
[ndbd default]
NoOfReplicas = 2 # Number of replicas
...
0
votes
1
answer
122
views
Scaling MySQL Cluster
I have an NDB cluster which consists of 4 data nodes. Some of the configuration parameters and system resources as :
CPU: 32
RAM: 128GB
Replication factor: 2
Data memory: 70GB
Index memory: 10GB
I ...
- 73
0
votes
1
answer
149
views
Adding Memcached plugin to Mysql Cluster Fails to start
I was able to setup a new mysql cluster, with total 6 VMs. New requirement is to add memcache plugin to mysql cluster, memcache failing to start with this error message WARNING -- Failed to allocate ...
- 1
1
vote
1
answer
2k
views
MySQL Cluster 7.3 - NDB engine - Could not connect to storage engine
Setup
I have installed three Oracle Linux 7.3. 2 for data nodes, 1 for management and SQL API node. The machines can ping each other, SSH working, "etc/hosts" files are properly filled:
127.0.0.1 ...
- 11
0
votes
1
answer
444
views
MySQL Cluster Only Sync Partially [closed]
I am new to MySQL, but I have to solve this problem quickly.
I installed FileRun (which is a file share service) on two nodes, those two nodes have MySQL Cluster backend.
In Filerun GUI, I created a ...
- 103
1
vote
0
answers
21
views
How do I control the data that goes into each data node in NDBCLUSTER
I am currently working with NDBCLUSTER.
I have the following table(a dummy example, since I cannot disclose details about actual application, but the structure is similar):
create table student(
...
- 11
1
vote
0
answers
326
views
Why ndb data memory is 94% if i m using disk storage cluster
I have following structure
2 data node
1 management node
2 sql node
i have create one log file of initial size 200M
then created table space and added 3 data file
data1.dat (initial size: 10GB)
...
1
vote
0
answers
33
views
Unexpectedly long query time NDBCluster
I'm having an issue where some queries take an abnormal execution time, meaning 3 to 5 seconds.
This part of the schema is 2 tables A and B, where A has many to one relation to table B.
Table A:
...
- 11
0
votes
1
answer
289
views
Geographical replication zones in MySQL Cluster?
In a default installation, data is shared indiscriminately across all data nodes.
Is it possible to specify that certain tables can only be replicated across a specific group of data nodes?
If so, ...
- 103
0
votes
1
answer
128
views
Deleted config.ini in MySQL cluster by mistake
I was trying to delete cache file of MySQL cluster for rolling restart, but by mistake I deleted the directory /var/lib/mysql-cluster from both the nodes.
I have ndb_1_config.bin.1 file, but how can ...
1
vote
0
answers
57
views
MySQL cluster and big database?
I hava a big mysql database(Innodb) about 50G, how can i import to mysql cluster.
What is the best solution to translate db, save on disk or get a amount memory?
- 11
1
vote
0
answers
30
views
Mysqlcluster data nodes synchronization rate
mysql cluster version: MySQL-Cluster-gpl-7.4.12-1.el6.x86_64
num of datanodes: 2
num of sqlnodes: 2
num of mgmt nodes: 2
Recently one on my datanode server was down(node4) due to power outage. ...
- 155
-1
votes
1
answer
369
views
How do stored procedures work with NDB Mysql Cluster?
We are considering to use Mysql Cluster for sharding. However I can't find how it works with stored procedures.
Is there a way to dispatch procedure invocation on particular shard, based on sharding ...
- 101
0
votes
1
answer
5k
views
MySQL Node not Connecting to Management Nodes in NDB Cluster
I am trying to deploy a 8 machine MySQL NDB Cluster with 2 Management Nodes, 2 SQL Nodes and 4 Data Nodes. The base operating system is Ubuntu 16.04 and the MySQL Cluster software version is 7.5.4. ...
- 3
1
vote
1
answer
342
views
Creating MySQL NDB cluster on Hyper-V
I want to create a MySQL NDB cluster on Hyper-V for testing so I have some questions in this regard.
Can I use Windows XP 32 bit? (because I already have a VM) If not then can I use Windows 7 or 10?
...
- 441
0
votes
1
answer
454
views
mysql cluster with innodb utilizing high memory
I have implemented MySQL cluster with two data, sql and management node respectively.
On one of the sql node I have ndb as well innodb engine for the huge tables which I can not able to convert into ...
2
votes
1
answer
610
views
MySQL NDB Cluster architecture?
I am looking for information that I am not able to find about MySQL cluster.
I have to justify if it is possible to install in a production environment the three types of nodes (MySQL node + Data ...
0
votes
2
answers
246
views
MySQL NDB Cluster settings to prefer data node on localhost than remote
My current MySQL NDB Cluster configuration:
Server 1 - management node
Server 2 - huge machine running both ndbd and mysqld
Server 3 - huge machine running both ndbd and mysqld
NoOfReplicas = 1
So ...
- 149
2
votes
1
answer
2k
views
Poor usage of timestamp index
with a small table (about 2 M of rows, 5 classic columns, id, description, title, created_at, coordinates (point)) doing a WHERE created_at BETWEEN ... AND ... ORDER BY created_at LIMIT 50 is very ...
- 61
2
votes
0
answers
69
views
Mysql Cluster distribute data only one node..why?
here are following setup
ndb_mgm -e show
Connected to Management Server at: us-srv1.site.vrack:1186
Cluster Configuration
---------------------
[ndbd(NDB)] 2 node(s)
id=3 @192.168.0.2 (mysql-...
- 133
1
vote
2
answers
2k
views
Out of operation records in local data manager (increase MaxNoOfLocalOperations) from NDBCLUSTER
MaxNoOfConcurrentOperations=150000
MaxNoOfConcurrentTransactions=150000
MaxNoOfLocalOperations=150000
I have above parameters in config.ini, when i try to delete rows in a table i get below error
...
- 155
0
votes
1
answer
102
views
How mysqlcluster can be durable and consistent?
I'm little noob and learning on how to use mysqlcluster,i have 1 management 2 datanode and 2 sqlnodes.According to a book "mysql cookbook" -alex davies and localcheckpoints and globalcheckpoints
By ...
- 155
1
vote
0
answers
323
views
Can I fix Lost arbitrator node errors in MySQL Cluster / NDB?
I have a cluster of eight MySQL Cluster nodes running NDB. At seemingly random intervals (around 1.5 weeks on average, but they seem to come in spurts when they show up), I see a pair of messages like ...
- 121
1
vote
1
answer
716
views
three-table JOIN query on a MySQL Cluster has become unusably slow
I have a select query called by a script to our MySQL Cluster that has gone from running in a second or two to taking well over a minute per query (and it has to run this query 24000 times). Nothing ...
- 13
2
votes
1
answer
2k
views
All queries are so slow on mysql NDB cluster
Here is my situation:
I got over 10G of web logs (around 30 million rows) and I mainly search it with various conditions.
e.g.:
select * from tbl
where ip = '123.123.12.3'
and agent = '...
- 23