Questions tagged [database-recommendation]
Determining what database product best fits the requirements and limitations in a specific situation. This is advice that generally requires much more insight into requirements than can easily be gleaned on a Q&A forum such as StackExchange.
327
questions
0
votes
3
answers
910
views
Overwriting MySQL database to only store 1 month of data
We are logging data on hardware with only small memory (short on disk storage) only 4GB.
We only require the data to be stored for 1 month and then be over written in a way that it overrides older ...
CommunityBot
- 1
1
vote
1
answer
972
views
Sql Server - Best Practices for Growing Large Database Files
I know this kind of question has been asked previously but I don't get the answer that I'm looking for.
I'm reconsidering setting up Autogrowth for DB Primary & Data files for Log(partitioned ...
CommunityBot
- 1
3
votes
2
answers
2k
views
Choosing the right database for stock price history
The model is [(stock_id, period, ts), open, high, low, close, last, volume]
We write new prices for all stocks (120,000) each minute and delete old once when they go out of retention time. It doesn't ...
CommunityBot
- 1
0
votes
2
answers
214
views
What database to store 20~ billions rows
I plan on archiving messages, and I'm not sure which I should use.
It should be able to hold a maximum of 20 billions rows (that's what I expect the total number to tend to)
Each row will have three ...
- 84.2k
256
votes
6
answers
456k
views
How large should be mysql innodb_buffer_pool_size?
I have a busy database with solely InnoDB tables which is about 5GB in size. The database runs on a Debian server using SSD disks and I've set max connections = 800 which sometimes saturate and grind ...
-2
votes
1
answer
62
views
Is there any database uses lzma?
according to this article, lzma has a great performance on compression ratio. I think lzma database is a good choice if I don't care about compression speed, so is there any database that uses it?
- 797
1
vote
0
answers
95
views
Are there any databases that properly support sum types/tagged unions?
I want to model various different events. Every event happens at a specific time, but other than that, each event needs to have different associated data, depending on the type of event. In Rust, I ...
4
votes
3
answers
1k
views
Choosing relational DB for a small virtual server with 1Gb RAM
I am trying to find a decent relational database that would run on a small server, would be easy to administer and have much community love.
I need a lightweight relational database for my personal ...
- 84.2k
0
votes
1
answer
136
views
Best database solution for highly interconnected entities?
I'm building a service (or rather a set of microservices) to serve as the backend for a social-network-like website. In short that means the following for my data:
millions of entities
with dozens of ...
- 84.2k
0
votes
2
answers
109
views
What database product would support 8000 columns, unlimited row size and no character limit on text fields?
Imagine a spreadsheet that's as wide in column count as it is long in row count - say 10,000 rows x 10,000 columns. That's what I'm trying to find an equivalent DB product to achieve. The column ...
- 1,564
-1
votes
1
answer
31
views
Database recommendation storing a growing set of recordings
Suppose I have a large volume of recordings coming in from various sources. Encoded as JSON-lines, they might look like this:
{ "metric": "temperatureRange", "values": [ &...
- 37.5k
3
votes
3
answers
2k
views
Recommendation for storage of series of time series
Just a few words describing the data:
In my application, there are acceleration measurements (for example at 25kHz) for the exemplary duration of one second. These measurements get repeated in not ...
- 111
-3
votes
2
answers
104
views
Best database for array like collections
I'm going to build a Go application that will check id(s) in a list of ids. Structure will be something like this for database:
Company A
List 1 -> 100.000 ids
List 2 -> 250.000 ids
Company B
...
- 84.2k
11
votes
5
answers
12k
views
Which major database platforms support TTL?
I need to store some data in a database that will be hosted on Amazon Web Services, and I have complete freedom over choosing which database platform to install, based on what I think will best suit ...
- 111
26
votes
4
answers
16k
views
Whether or not to create separate tables for different product types?
I'm in the process of designing a database and I'm having second thoughts about my initial design decisions...
Product types are as follows... Models, parts, replacement part kits and options.
...
2
votes
1
answer
167
views
Method to keep track of large number of sets with high cardinality
We're building an analytics service. One of our needs is to maintain ~100MM sets each with anywhere between one member to 1MM members, with each member represented as a long. We need to be able to ...
- 2,201
0
votes
2
answers
295
views
DBMS recommandation for C# applications with provides triggers, procedures and if possible free [closed]
I'm here because I need somme advices about the best DBMS to use in my case. Indeed, I've only studied the theory about the databases. So I don't know a lot about the pratice.
I'm searching after a ...
- 2,201
29
votes
2
answers
23k
views
Ready-to-Use Database models example
Where can I find ready-to-use database models ?
I don't need a database with data in it, but only schemas (UML diagrams). Perhaps something like the data models at this link, but much more complex and ...
- 107
1
vote
1
answer
3k
views
Best database for storing and retrieving articles / blog posts / forum posts etc [closed]
I am trying to create a database to store articles, posts etc. They will usually contain a header column, content and some meta data like author or date time stamp, I assume each of these will be a ...
- 84.2k
4
votes
3
answers
16k
views
How to build a table for a private messaging system that supports replies?
I'm writing a private messaging web application in PHP, the application allows replies such that when you view a message, you also get to see to what was that a reply to, and to what was that a reply ...
- 63.2k
0
votes
2
answers
3k
views
I am using Amazon REDSHIIFT and want to make my table data case insensitive?
How can I change my Tables data stored in REDSHIFT case insensitive?
For example: Bell, BELL, bell in a column should return all the rows when queried.
- 101
2
votes
2
answers
154
views
Are relational databases even viable for large eCommerce platforms? [closed]
I've been assigned to an eCommerce platform that has huge quantities of data ( hundreds of thousands of products, sellers, etc ) and I've been trying to choose the proper tools and approaches required ...
- 43k
1
vote
2
answers
195
views
How do I resolve having a M:N relationship in my Crow's Foot Model? Am I on the right track?
I am very much a beginner and taking a class on databases. My assignment involves using Crow's Foot notation to represent the following tables:
This is my design for it so far. I am nowhere near done ...
- 11
2
votes
0
answers
2k
views
How to do automated archiving for a SQL Server database based on interpretation of database metadata?
I am looking for a solution giving me automated archiving of SQL Server databases based on a smart interpretation of table relationships that is able to archive records from related tables minimizing (...
- 2,201
0
votes
1
answer
854
views
Best Database for range queries on a single column [closed]
here's my usecase: I have these fields: id(int), frequency(int), created(timestamp).
I need a database that can optimize range queries on created field. Specifically for queries like: SELECT * FROM ...
- 37.5k
-1
votes
1
answer
66
views
Best Database to be shipped with my application? [closed]
I have a .NET core application using a database. I need to create an installer using NSIS where I will be packaging my application along with a database, so that the client can easily install my ...
- 1,760
8
votes
2
answers
38k
views
MySql recommended hardware
Our company servers are currently hosted on a VPS and we've decided to move into dedicated servers.
When choosing the best hardware for a DB server, what should we invest more resources:
better CPU (...
- 183k
0
votes
1
answer
135
views
Many-to-many database [closed]
I am thinking about making a music database. Something where you can search by
artist, album or song. This seems to be a Many-to-many model, as an album can
have multiple songs, and the same song can ...
- 1
3
votes
2
answers
345
views
Implementating user notifications list using Aerospike
I need to choose the right DB for a notifications system that needs to handle billions of notifications. The record structure is as follows:
[user_id, item_type, item_id, created_at, other_data]
The ...
- 135
0
votes
1
answer
500
views
Storing timeseries data with dynamic number of columns and rows to a suitable database
I have a timeseries pandas dataframe which dynamically increases the columns every minute as well as adds a new row:
Initial:
timestamp 100 200 300
2020-11-01 12:00:00 4 ...
- 37.5k
-3
votes
2
answers
161
views
Python - Best database for exponentially growing database? [closed]
So I am making a Discord (social media) Bot in Python using discord.py-rewrite, and I need to save informations of lots of servers and users (such as how much money they have, what items thay have…). ...
- 70k
0
votes
2
answers
61
views
Advice for database implementation [closed]
We need to configure a database for our NGO. We have to save information about the children and several pictures and documents for each of them.
A friend is currently saving the data of over 70 kids ...
- 84.2k
0
votes
1
answer
4k
views
Do we have any File Table / File Stream like support in any other database than MS SQL Server?
I am looking for an alternative to Microsoft SQL Server's File Tables / File Stream feature. The reason is because I really wanted to use SQL Server File Tables but I am on Linux and using docker.
...
- 84.2k
0
votes
1
answer
554
views
Multi-master (NoSQL) database solutions with cloud and no-premise option [closed]
We are currently investigating database options for distributed database (possibly globally distributed) where the data in general is stored in "cloud" (this would not be a special requirement). The ...
CommunityBot
- 1
0
votes
1
answer
58
views
Which database should be using for my specific goal [closed]
Introduction:
I am trying to figure out what kind of database I should use for my project to get the best speed possible.
Background:
I am not sure if MySQL is the best solution, but I will use MySQL ...
CommunityBot
- 1
-1
votes
2
answers
357
views
Which database to use when you have a 6 billion of rows inside and need to query rows with from list of IDs? [closed]
We are currently researching our case of storing the road distances between cities. Right now we have 6 billion of those distances.
Our structure right now in SQL Server is that we have a float which ...
CommunityBot
- 1
0
votes
1
answer
48
views
Creating big shared database
I wish to create DB in Firestore. My program will have multiple user and each user will have calendar and can create an event. The user can share this event with any other user (Similar to Google ...
- 560
1
vote
2
answers
2k
views
Geo Route - Best way/db to store route path
We are developing an app in that UI need to show a path where a truck driver drives the truck.
Driver mobile will continuously send (example every 10 seconds) their live location.
Which database is ...
- 1,510
1
vote
1
answer
79
views
Database software solution [closed]
Our company has user data (name, email, phone number, systems of access, AD username) in a large Excel workbook. The Excel workbook is becoming very slow because of the 1000s of entries in it, and we'...
- 24.8k
2
votes
3
answers
7k
views
Database design for attendance feature
My app has a requirement wherin we need to capture attendance details of a class. A class typically has 50-60 students and there will be records with attendance/absense status of each student for a ...
-2
votes
2
answers
250
views
MySql : Does it worth to convert a column with type DATETIME to DATE?
At the start of a project, a DATETIME column made sense. But now, 5 years after, requierments changed the time part have never be used.
My table has about 100k lines and grows with about 500 lines ...
- 19.9k
20
votes
3
answers
16k
views
PostGIS vs. SQL Server for GIS data
So I'm recently starting at a new company and have a lot of ArcGIS users who seem really keen on going forwards with a PostGIS instance to serve some data to our customers. While I don't have an issue ...
- 197
1
vote
3
answers
2k
views
How to store real-time data to database [closed]
Here is my situation:
I have a WebSocket connection that feeds me data real-time
I have an async callback function that gets the data and inserts into a queue
I have another thread that reads from ...
- 16.1k
0
votes
1
answer
41
views
Is there a type of database that can directly recall an element given a pointer in O(1) time?
I'm currently using levelDb, which is a key->value store database. The only data being inserted are small binary blobs (that represent nodes for a large merkle tree). When I put a value in the db, I ...
- 84.2k
3
votes
0
answers
3k
views
MySQL along with Firebase for data sync
I'm currently working on a mobile app powered by a web platform, and the mobile app will have some offline capabilities. The application has a small amount of DB entities, and only about 3 of them ...
9
votes
1
answer
45k
views
What are the advantages and disadvantages of Firebase for a database?
I am currently developing a site to track credits gained from exams, and how these stack up against the user's goal credits.
I am looking for a database system that will store all the possible exams ...
- 24.8k
0
votes
1
answer
131
views
Optional oneToOne relations and criteria field
Introduction:
Visitors can fill reports on my website.
Those report can either be filled by a legalPerson or a naturalPerson.
Constraint: I don't like empty fields and I would like to normalize as ...
CommunityBot
- 1
4
votes
0
answers
112
views
How to set up a solid MySQL/MariaDB Server for +3000 active connections? [closed]
Background.
I have an App connecting to an RDS instance on Amazon (r3.Large) and it's working smoothly. However, the boss does not like to spend ~ $1,000 bucks a month on it so we are moving In-house....
CommunityBot
- 1
4
votes
1
answer
940
views
How do database operations (write, update, alter) on particular cell in a table are written to disk without overwriting entire file?
When I want to write to or alter particular cell of an excel file/table using python I'll use pandas read_csv then alter value in particular cell and write back to file with to_csv. But writing back ...
- 84.2k
7
votes
4
answers
4k
views
How do I model data from arbitrary CSV's in a database?
I am setting up a web interface for data management. Users upload CSV or similarly structured files, and I want to store these in the database so they can do manipulations on them -- filtering, ...
- 101