The tag has no wiki summary.

learn more… | top users | synonyms

0
votes
2answers
43 views

SUM() the result of a stored procedure

I use the Pl/Proxy extension in order to shard a table. It works like a charm, except for this : I have a stored procedure which runs on 4 shards. It looks like this : CREATE OR REPLACE FUNCTION ...
0
votes
3answers
40 views

Redesign basic Mysql storage architecture

We are a small Internet provider and we are storing all our clients traffic data in a MySQL database (MyISAM). We insert data every few minutes in three tables like this: capture_table ---------- ...
1
vote
1answer
27 views

Should all machines which run mongo instances (mongod or mongos) in a Mongo DB cluster have unique hostnames (also at OS level)?

I have been using Mongo DB Cluster for some data analysis (Mongo DB version 2.4.5) and while inserting some data into the cluster, I found an error which is the same as mentioned in the bug : ...
0
votes
1answer
35 views

Updating mongo sharded cluster without down time for mongod

I am trying to update my mongo sharded version from 2.4 to 2.6.3. I have some queries on steps to update this. When I will run one mongos with the --upgrade option, will it update all the config ...
0
votes
1answer
44 views

Mongo large chunks will not split

I had a 3 shard set up, and ran out of capacity, so I added 3 more shards. (Each shard is a replica set). But the data isn't spread across the cluster evenly. I have my chunkSize set to the standard ...
1
vote
1answer
44 views

Mongo sharding issue with chunk split and Data transfer

I am getting this error in my primary shard warning: moveChunk failed to engage TO-shard in the data transfer: still waiting for a previous migrates data to get cleaned, can't accept new chunks, num ...
1
vote
0answers
43 views

MongoDB index strategy

I'm developing a system to back-up computers and store the files / data with retention for a while. The actual files are stored in an object store, while I'm planning to keep the metadata of the files ...
0
votes
1answer
23 views

How to confirm that chunk transfer is completed on a DB

I have one case where i create db for Daily data. I have some collections in this db which are sharded. My requirement is as follows: Create every day DB If There is a DB which is more than 7 days old ...
1
vote
0answers
58 views

Error to connect mongos when trying to create replicated sharded cluster

I'm trying to create an replicated sharded cluster in mongodb. Initially I've created two shards and there are a replica set with three members in each shard. And all the shards and replicasets run in ...
0
votes
0answers
24 views

Sharding TPC-C Benchmark with MySQL Fabric

Currently I have a setup of 5 mysql database nodes (db01 ~ db05). MySQL Fabric and backstore have been installed and running in db01. I configured one global_group (i.e. group_02) with db02 and three ...
1
vote
1answer
45 views

MongoDB Shard - Disable Cursor timeout

I'm using an sharded-cluster(Mongo version 2.4.1) with a java application. After a specific time (10 minutes or more) I got the following exception: com.mongodb.MongoException$Network: Read operation ...
-1
votes
1answer
51 views

how to split the chunks in sharding

I have edited the question. I was trying to run the sh.splitAt mongos> sh.splitAt("test.zp",{"city": "1"})it worked. But the problem is at sharding chunks. when i have run the command ...
2
votes
0answers
61 views

Mariadb sharding?

I'm trying to implement a mariadb sharding for learning purpose. I have looked into database sharding in general and found mariadb spider storage engine support sharding. I do not want spider storage ...
0
votes
0answers
20 views

Would an INNER JOIN query in a sharded relational database hit the same shard when using a compound primary key?

In this question I have asked about modulus calculation in sharded tables, this design is used: CREATE TABLE Orders (order_id INT PRIMARY KEY, ...); CREATE TABLE LineItems (order_id INT, lineitem_id ...
0
votes
0answers
12 views

Modulus calculation for compound primary keys in MySQL Cluster (and other sharded databases)

In MySQL Cluster, and generally in sharded databases, how is a compound primary key's modulus calculated? Say, for example, there are two tables that have primary keys like so: CREATE TABLE Orders ...
0
votes
1answer
56 views

MongoDB - temporarily turn shard to standalone for local user creation

Following question Mongodb sharded cluster backup user issue I have a sharded mongodb cluster, with 4 shards, and I'm required to stop the mongod service on each shard, and start it not as a part of ...
3
votes
1answer
58 views

MongoDB presplitting chunks for compound shard key

In my mongodb setup I have a compound shard key {"region" : 1, "foo" : 1, "bar" : 1} and I know the values region can be and that each region should be on one chunk. Therefore I'd like to pre-split ...
1
vote
1answer
42 views

Mongodb sharded cluster backup user issue

We're using a simple python script to backup our mongodb cluster. the script connects to each mongod instance via ssh, and performs mongodump, all without requiring user/pass ever since we started ...
0
votes
1answer
53 views

MongoDB: The collections metadata lock is taken

Running a mongodb 2.6 cluster on localhost with four shards and four replication sets. Using a for loop with 100 iterations that pre-splits chunks among the existing shards. I am getting the error ...
0
votes
1answer
38 views

MongoDB only three of four shards being used

Using MongoDB 2.6, I've setup four replication sets: a, b, c & d: >rs.conf() a:PRIMARY> rs.conf() { "_id" : "name_of_replset", "version" : 1, "members" : [ { ...
0
votes
1answer
64 views

Mongodb: slow shard balancing

I've decided to shard a collection with 500M+ documents into 24 shards. All shards are on the same machine without replicas as was advised in this title (core sharding). The shard key is {"_id":1}. I ...
0
votes
1answer
61 views

Oracle DB - Is it possible to distribute data of a table onto multiple servers?

BigTable[1]-like systems (HBase[2] for instance) allows a table to be distributed transparently accross multiple servers. This works as follows: Each server perform the read/writes operations on ...
0
votes
1answer
57 views

MongoDB - sharding

I have a sharded cluster with 4 shards, 3 config databases. My problem is when I do my inserts only one shard gets filled. Can anyone please explain to me why this is happening. My first thought was ...
2
votes
1answer
77 views

Scaling out SQL Server and syncing data across multiple machines

I don't have expertise in architecting databases, and I've been teaching myself new stuff every day. I'd like to make an Internet-scale application using SQL Server as the data store. I haven't found ...
0
votes
1answer
81 views

Split Vector is taking too much time in mongo shard

I am using mongo shard distribution system. This system performs slow as the data size increases. I checked with profiler and saw split vector is taking to much time while running. It happened after ...
0
votes
0answers
41 views

PostgreSQL manual way of sharding like behaviour

I've a main server with low space available and good internet connection that has a postgres database in production for a zabbix system. Also, I've another secundary server plenty of space but with ...
0
votes
0answers
14 views

Index table for horizontal shard

Lets assume we have a vary amount of clients, which could manage some stuff on our site. Each client has his own table, which is used to store data. For instance: client_1, client_2, ..., client_N. ...
0
votes
1answer
75 views

Removing Database from sharded cluster in Mongo DB

I Have a mongo shard db system with two shards and and three mongos servers.My application creates DB on daily basis as per our business requirements. We have some sharded collection in each day DB. ...
0
votes
0answers
229 views

Mongodb: Waited too long for lock balancer to unlock

Mongo Version: 2.4.5 OS: Windows Server 2008 R2 Standard (Service Pack 1) We have a balancer idling for a day doing nothing (no recent records in changelog), holding a lock state 2. Tried to stop ...
0
votes
1answer
31 views

MongoDb Sharding between replica and standalone server

So i got a replica set with three servers and a standalone server . I have enabled sharding between them. I inserted more data on replica primary server using "rockmongo". But the chunks are not ...
0
votes
2answers
69 views

MongoDB Synchronizing multiple Shards

I've got the following layout Picture Cluster RZ West is my first data center A and RZ Ost my second data center B. As you can see one secondary database of each cluster is available in the other ...
0
votes
0answers
112 views

MongoDB Sharding and Replica Set Allocation

I am going to setup MongoDB cluster: 3 config servers, 3 routing servers, 2 shards (replica set per shard). A replica set is just simply 1 primary, 1 secondary and 1 arbiter. Therefore, in my ...
1
vote
0answers
316 views

Sharding Postgres Database

I have a Postgres database that has grown to the size where it is no longer feasible to store everything on a single database node. There is a Customer table in my schema where each row represents a ...
0
votes
2answers
97 views

Mongodb ubuntu - config server and shard together

I have the following services on a single shard server: sudo mongod --dbpath /data/db/ --port 31001 sudo mongod --configsvr --dbpath /data/configdb/ --port 21001 The same server is using for shard ...
3
votes
1answer
64 views

What inefficiency does sharding & partitioning attempt to address? [closed]

I have never implemented sharding or partitioning, but from what I understand, multiple servers are used to distribute large amounts of data. Is this because of a limited hardware budget or to ...
1
vote
1answer
86 views

Mongo db and sharding / replica sets concept questions

I have few questions about sharding and replica sets: I am planning to write important logs to a sharded environment. about 100 million rows in a day, If I will connect to a single MONGOS process , ...
1
vote
0answers
68 views

Data replication vs parallel shard query

I'm not a DBA, and I'm wondering how a SQL Server database can scale to fit the needs of a social network. I'm not interested in NOSQL, and I understand that caching plays an important role in ...
1
vote
0answers
75 views

Meta Database for a multi-tenant multi-shard environment

I’ve spent quite a bit of time researching sharding of a multi-tenant database (for a SAAS application). I wasn’t able to find much information on handling the Meta Database, containing connections ...
0
votes
1answer
137 views

Where to insert data after sharding?

Actual database in localhost:30000 ------------- I used this as Shard1 another mongod in localhost:30001 ------------- Shard2 another mongod in localhost:30002 ------------- Shard3 ...
1
vote
1answer
47 views

Shard key selection for both write scaling and query isolation?

From the mongod documentation, I know that when choosing shard keys the key should always have high cardinality, so write operations are distributed to different shards (a kind of write scaling). But ...
2
votes
1answer
349 views

verify that mongos server is connected to config servers

I've been writing a backup script for sharded replica-sets and it's almost done, except that I can't seem to get it to successfully start the balancer back up after everything's all said and done. ...
0
votes
0answers
30 views

how to start sharding in mongodb

I am trying to learn sharding in MongoDb and here is my plan: I'm trying to shard the database S001 into 2 different machines. 192.xx.xx.60>mongod -configsvr --dbpath S001 ..Now running in ...
1
vote
1answer
159 views

Shard keys must all be ascending?

I have a collection that I've been trying to shard, but I can't get it to shard with the index that I gave it. The collection in question uses a hashed index, which I created using: ...
3
votes
2answers
632 views

How to Determine Chunk Distribution (data and number of docs) in a Sharded MongoDB Cluster?

Having done all the right things - picked an appropriate shard key, scaled horizontally, distributed my data across several shards, I find I now have no real way to determine how well balanced the ...