Determining what database product best fits the requirements and limitations in a specific situation. This is advice that generally requires much more insight into requirements than can easily be gleaned on a Q&A forum such as StackExchange.

learn more… | top users | synonyms

62
votes
6answers
29k views

What are the differences between NoSQL and a traditional RDBMS?

What are the differences between NoSQL and a traditional RDBMS? Over the last few months, NoSQL has been frequently mentioned in the technical news. What are its most significant features relative to ...
0
votes
2answers
398 views

how store billions of rows with no relation in a NoSQL one [closed]

I'm going to receive a large group of CSV files daily. Additionally I have 1 billion records of data (from those CSV files) but its not a fixed number (1b records daily). They're going to be growing ...
-2
votes
1answer
70 views

Password protected Database Engine with Server features and stored procedure [closed]

I like MS Access password protect feature but it does not useful for server based software like as SQLite which has password protect but not useful for server. SQL Server is one of the best DB engine ...
2
votes
1answer
2k views

Mirror / replicate only 1 table of a database

I need a good way to replicate a single table in SQL Server 2012 between different servers and different databases. I tried replica which works just fine, but there might be a much better / easier way ...
16
votes
7answers
4k views

Is polling the only way for updating app's data from a database?

An application needs to have data as more freshly updated from a database as possible. In such a case, is there any other way for getting the data, besides of a timer based requesting (polling) the ...
0
votes
2answers
820 views

How to build a table for a private messaging system that supports replies?

I'm writing a private messaging web application in PHP, the application allows replies such that when you view a message, you also get to see to what was that a reply to, and to what was that a reply ...
0
votes
0answers
220 views

MySQL along with Firebase for data sync

I'm currently working on a mobile app powered by a web platform, and the mobile app will have some offline capabilities. The application has a small amount of DB entities, and only about 3 of them ...
2
votes
1answer
100 views

Difference beetween mysql 5.5 and 5.6

I have a big performance problem beetwen my local mysql instance and the server. I have this request : DELETE a FROM a LEFT OUTER JOIN ( SELECT MAX(id) as id, `v_id`, `v_statut`, `c_controle`, ...
0
votes
1answer
3k views

Storing multidimensional array in MongoDB

I am attempting to convert a large MySQL database of product information (dimensions, specifications, etc) to MongoDB for flexibility and to move away from the restriction of a column based table. I ...
10
votes
2answers
4k views

Ready-to-Use Database models example

Where can I find ready-to-use database models ? I don't need a database with data in it, but only schemas (UML diagrams). Perhaps something like the data models at this link, but much more complex ...
3
votes
3answers
2k views

Relational vs Non-Relational Database for Events Database

I'm trying to find out whether an SQL or no-SQL solution would be better for creating an events database. I'm creating a ticketing system, similar to ticket master. I know that for either ...
1
vote
0answers
13 views

Database Design for Multi-Level Ownership

I'm trying to figure out what sort of database and what sort of database structure would make sense for representing ownership of different assets by different constituencies. Say a group of 5 ...
0
votes
0answers
6 views

pattern matching on row attributes

I have the following: there are dozens of millions of records on the following format a1 a2 a3 ..... a10 where ai are float values of some attributes. I would like to store these records in a db ...
1
vote
1answer
35 views

Database Design help

I am building an application for comparing two or more songs. We have millions of songs. Currently we have access to raw data files (form a company like soundcloud) consisting of 1) Daily Users.csv ...
0
votes
1answer
33 views

To use tpc-h benchmark its really necessary create primary and foreign keys?

Im doing some tests with tpc-h benchmark. And Im with a doubt, and I didnt find any answer. The tpch-h benchmark simulates a data warehouse environment. And the most important here are the queries ...
4
votes
1answer
422 views

Database design for a car dealers website

I am creating a new website for all the car dealers in my region to show their cars on and i need your opinion on the database I have created because I have some doubts. For instance, is it best to ...
1
vote
1answer
80 views

Data structure design for supporting arbitrary number of columns in table or database [closed]

I am currently working on a sort-of a meta-modeler to build a free web service so that people can input data and run several models on that data. The task I am currently struggling is: user needs to ...
3
votes
5answers
979 views

Database: One table or many

I am working on a project of classified ads site. I have 12 main categories, and their items are 142, Like vehicles have cars, scooters, bikes, etc. Mobiles Phones have mobiles, tablets, accessories. ...
29
votes
6answers
12k views

What problems will I get creating a database per customer?

I remember from the stackoverflow podcasts that Fog Creek use a database per customer for Fogbugz. I assume that means the Fogbugz On Demand servers have 10s of thousands of databases. We are just ...
5
votes
2answers
676 views

Searching 500 million records of binary data

I will inserting into a database the signatures of 500,000,000 pictures. The signatures will be generated using libpuzzle. Each signature is 338 bytes. (so 160 GB) plus a table for searching (read ...
0
votes
0answers
33 views

Dealing with multiple user types, modules and requirements

I have the following database schema. Basically, it all comes down to this: - users can have multiple user types - some user types come with specific requirements for a complete profile - there are ...
0
votes
0answers
27 views

Help creating database schema to build database off

not sure if this is the right area for a question such as this but I am looking to create a database for an IS warehouse who deliver laptops, desktops, monitors and other peripherals to different ...
0
votes
2answers
68 views

Database design for millions of posts

I have this issue. I have three types of posts a user can generate (some users can generate all some can only generate one type). I have the following types: main, employee and admin posts. I ...
1
vote
0answers
56 views

Alternative to EAV to store data with an unknown structure

For my bachelor thesis I have to build a reseach database which has to meet the requirement of provenance. In the present case it means that among other things I have to store the results of my ...
0
votes
1answer
33 views

Machine learning database Big data

Which databases can I use for storing object features for machine learning use case, in case of Big data? To explain a bit more - object features basically represent an object in a form of an array ...
2
votes
1answer
68 views

Which AWS database services are designed for storing logging records like log4j or log4perl?

I have been using the file system for log4j and log4perl records and want to start using a database to store the information, especially to lookup records organized by pid. We are using MySQL RDS for ...
1
vote
1answer
558 views

CRM Address table and it relation

Hi I want to ask about I have this DBD for my CRM I am trying to have the addresss in one table(customer and Employee Address) and both customerID and Employee ID are guid I have in address table FK ...
0
votes
0answers
33 views

Sql or NoSql design for nested data

In our data model we have classes with one to many relations to eachother TestRun (HasMany) => TestData (HasMany) => AnalyzeRun (HasMany) => Output parameters. We have to query this data in multiple ...
4
votes
1answer
236 views

Re-designing a Database cost and advice [closed]

The web application I am working with has a huge Database that is a real mess, no foreign keys, no constraints, no indexes, no optimization, no normalization, nothing. Until now, the logic has been: ...
1
vote
3answers
389 views

secure way to connect with remote Mysql database

I created my application using MySQL and it relies completely on the database I have around 190 tables, and I'm afraid of security breaches and another problem is for remote access I have to add the ...
0
votes
2answers
232 views

Daily snapshot fact table

I have a list of products per costumer. Costumers can delete or add products to their list. I want to know in each day what is the list of products (and count) by costumer. My first approach is to ...
4
votes
2answers
131 views

How to design SQL schema that treats historical data as first-class citizen?

I'm currently designing a SQL Server database schema for an application that consists of highly structured "tree" data. So, a table might look like this: id parentId (references id in same table) ...
2
votes
1answer
2k views

Can I copy a collection in mongoDB from one database to another by copying the db files directly?

I tried using cloneCollection http://docs.mongodb.org/manual/reference/command/cloneCollection/ , but clonecollection takes a lot of time in case of big collection because it starts indexing the data. ...
-1
votes
2answers
85 views

DBA responsibilities: should they include suggesting a database engine for a new project? [closed]

I need your opinion on a subject. I have been working as DBA for a short time and I have been asked by the Project Manager which database engine I recommend for a new critical project. The options ...
4
votes
1answer
165 views

Best database design for website ranking

I am working on a project in which I need to rank websites in two way - Global rank and their rank in a particular country. There are various factors based on which both are calculated. There are ~200 ...
4
votes
6answers
3k views

Best database to store and retrieve Word and Excel documents

My current project is to create a barcode system (for lack of a better word) that is linked to a database (was not given more information or directions). My task is to have a barcode scanner ...
1
vote
1answer
66 views

What kind of database should I use?

I'm designing a new system and I'm wondering what kind of DB should I use for my needs. I have a tree structure of nodes, where each node has historic values. For each historic value it should hold 2 ...
5
votes
1answer
215 views

Managing and speeding up queries on PostgreSQL table with over 3 trillion rows

I have time series data which spans over 10 years and has over 3 trillion rows and 10 columns. At the moment I use a PCIe SSD with 128GB of RAM and I am finding that querying takes a significant ...
3
votes
1answer
41 views

Confused about what to use to create the data

I want to create a database for myself. The data has complex grouping. I don't know which system to use to create my database. The data is in groups and sub-group forms, it almost has 5-6 layers of ...
0
votes
0answers
26 views

Which database is suitable for simple querying/filtering/paging and ability to expire the data?

From what I read, i have to maintain index if I were to use redis. I can set EXPIRE of an object but then I have to update index set myself which is something I rather not do. mongodb has this ...
1
vote
0answers
53 views

Which database technologies to use? [closed]

We are a small construction company that currently has a very old, outdated database system that has been written over the past 20 years in Visual FoxPro. I have now been designated with the task of ...
2
votes
0answers
52 views

How to implement search for world-wide Wikipedia/OSM places with alternative-names

I would like to implement a search-backend which returns a location-aware search results of all Wikipedia / OSM place names, while recognising place names in all languages. Thus, if you search for ...
2
votes
2answers
43 views

How to set-up a distributed data storage system for The Real Junkfood Project

Context The Real Junkfood Project consists of a network of pay as you feel (PAYF) cafes. We need to log the data from each of ~100 cafes, generating perhaps 50 rows each par day. I estimate that this ...
2
votes
1answer
187 views

What is a suitable,stable, high performing database for Large Financial Time Series Data? [closed]

I realise this question may have be answered in some form but I would like to gather the thoughts and opinions of actual users with experience in this field of Database design and development. I have ...
1
vote
4answers
433 views

Database/Storage engine suggestion for a project involving heavy inserts?

I am looking into a project which involves large number of inserts daily.I will have a list of user's (for example a user set of 500k ) , for which I need to monitor daily certain activities ...
2
votes
1answer
158 views

Easiest method to retrieve the content of BLOBs from a Sybase databse

I would like know the easiest way (no coding) to extract the content of the blobs of a database. For example, I have a table which contains a column whose format is BLOB. The result I would like to ...
1
vote
0answers
38 views

Dealing with joins in persistent key-value stores

One promising emerging category of NoSQL databases is key-value stores. These include Redis (disk-backed), Riak, Aerospike and others. The problem I struggle with the most is the lack of joins. ...
2
votes
1answer
376 views

Design advice regarding a users/groups/tasks database scheme

Here are my requirements: one user can have many tasks one group can have many task one group can have many users only invited user by a user can be added into a group Does this db design appear ...
0
votes
1answer
151 views

Two types of data, so two type of databases?

For a social network site, I need to propose a DB. The application is written in Java & will be hosted on VPS(s) initially. Broadly classified there is two type of data to be stored at backend: ...
12
votes
4answers
13k views

Is there a tool to check if my database is normalized to the third normal form?

I learned about normalization recently, and understand how important it is when implementing a new schema. How can I check if my database is 2NF or 3NF compliant ? Manual review is a sure option, ...