Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [database-recommendation]

Determining what database product best fits the requirements and limitations in a specific situation. This is advice that generally requires much more insight into requirements than can easily be gleaned on a Q&A forum such as StackExchange.

Filter by
Sorted by
Tagged with
0 votes
0 answers
26 views

Data management pattern for temporarily storing/retrieving excessive quantities of data

I have been tasked with creating an application to ingest raw binary data from a software-defined radio (SDR) and display it in a web frontend. One of the purposes of this app is to allow a user to ...
moltarze's user avatar
  • 101
0 votes
0 answers
21 views

Standalone single binary database for time series data

I am looking for a database that ticks the following boxes: Single binary, or portable version that can be executed without installation, available for Windows and Linux Library for at least Python ...
jonas's user avatar
  • 101
0 votes
2 answers
287 views

What database to store 20~ billions rows

I plan on archiving messages, and I'm not sure which I should use. It should be able to hold a maximum of 20 billions rows (that's what I expect the total number to tend to) Each row will have three ...
lyeaf's user avatar
  • 177
1 vote
1 answer
1k views

Sql Server - Best Practices for Growing Large Database Files

I know this kind of question has been asked previously but I don't get the answer that I'm looking for. I'm reconsidering setting up Autogrowth for DB Primary & Data files for Log(partitioned ...
Hakoo Desai's user avatar
-2 votes
1 answer
67 views

Is there any database uses lzma?

according to this article, lzma has a great performance on compression ratio. I think lzma database is a good choice if I don't care about compression speed, so is there any database that uses it?
destination's user avatar
1 vote
0 answers
103 views

Are there any databases that properly support sum types/tagged unions?

I want to model various different events. Every event happens at a specific time, but other than that, each event needs to have different associated data, depending on the type of event. In Rust, I ...
Victor Nordam Suadicani's user avatar
4 votes
3 answers
1k views

Choosing relational DB for a small virtual server with 1Gb RAM

I am trying to find a decent relational database that would run on a small server, would be easy to administer and have much community love. I need a lightweight relational database for my personal ...
Artem Sevos's user avatar
0 votes
1 answer
151 views

Best database solution for highly interconnected entities?

I'm building a service (or rather a set of microservices) to serve as the backend for a social-network-like website. In short that means the following for my data: millions of entities with dozens of ...
Babszem's user avatar
0 votes
2 answers
116 views

What database product would support 8000 columns, unlimited row size and no character limit on text fields?

Imagine a spreadsheet that's as wide in column count as it is long in row count - say 10,000 rows x 10,000 columns. That's what I'm trying to find an equivalent DB product to achieve. The column ...
sixestwentyeight's user avatar
-1 votes
1 answer
31 views

Database recommendation storing a growing set of recordings

Suppose I have a large volume of recordings coming in from various sources. Encoded as JSON-lines, they might look like this: { "metric": "temperatureRange", "values": [ &...
sdgfsdh's user avatar
  • 99
-3 votes
2 answers
117 views

Best database for array like collections

I'm going to build a Go application that will check id(s) in a list of ids. Structure will be something like this for database: Company A List 1 -> 100.000 ids List 2 -> 250.000 ids Company B ...
Wowocado's user avatar
3 votes
2 answers
2k views

Choosing the right database for stock price history

The model is [(stock_id, period, ts), open, high, low, close, last, volume] We write new prices for all stocks (120,000) each minute and delete old once when they go out of retention time. It doesn't ...
Kaplan Ilya's user avatar
1 vote
1 answer
3k views

Best database for storing and retrieving articles / blog posts / forum posts etc [closed]

I am trying to create a database to store articles, posts etc. They will usually contain a header column, content and some meta data like author or date time stamp, I assume each of these will be a ...
anarchy's user avatar
  • 121
2 votes
2 answers
156 views

Are relational databases even viable for large eCommerce platforms? [closed]

I've been assigned to an eCommerce platform that has huge quantities of data ( hundreds of thousands of products, sellers, etc ) and I've been trying to choose the proper tools and approaches required ...
Johansson's user avatar
  • 121
1 vote
2 answers
203 views

How do I resolve having a M:N relationship in my Crow's Foot Model? Am I on the right track?

I am very much a beginner and taking a class on databases. My assignment involves using Crow's Foot notation to represent the following tables: This is my design for it so far. I am nowhere near done ...
RagingCalm's user avatar
0 votes
1 answer
911 views

Best Database for range queries on a single column [closed]

here's my usecase: I have these fields: id(int), frequency(int), created(timestamp). I need a database that can optimize range queries on created field. Specifically for queries like: SELECT * FROM ...
MaC's user avatar
  • 1
-1 votes
1 answer
73 views

Best Database to be shipped with my application? [closed]

I have a .NET core application using a database. I need to create an installer using NSIS where I will be packaging my application along with a database, so that the client can easily install my ...
Dragon's user avatar
  • 99
0 votes
1 answer
135 views

Many-to-many database [closed]

I am thinking about making a music database. Something where you can search by artist, album or song. This seems to be a Many-to-many model, as an album can have multiple songs, and the same song can ...
Zombo's user avatar
  • 1
3 votes
2 answers
347 views

Implementating user notifications list using Aerospike

I need to choose the right DB for a notifications system that needs to handle billions of notifications. The record structure is as follows: [user_id, item_type, item_id, created_at, other_data] The ...
Kaplan Ilya's user avatar
0 votes
1 answer
510 views

Storing timeseries data with dynamic number of columns and rows to a suitable database

I have a timeseries pandas dataframe which dynamically increases the columns every minute as well as adds a new row: Initial: timestamp 100 200 300 2020-11-01 12:00:00 4 ...
Pavneet Singh's user avatar
0 votes
2 answers
61 views

Advice for database implementation [closed]

We need to configure a database for our NGO. We have to save information about the children and several pictures and documents for each of them. A friend is currently saving the data of over 70 kids ...
starryn1ght's user avatar
0 votes
1 answer
4k views

Do we have any File Table / File Stream like support in any other database than MS SQL Server?

I am looking for an alternative to Microsoft SQL Server's File Tables / File Stream feature. The reason is because I really wanted to use SQL Server File Tables but I am on Linux and using docker. ...
Imran Faruqi's user avatar
0 votes
1 answer
59 views

Which database should be using for my specific goal [closed]

Introduction: I am trying to figure out what kind of database I should use for my project to get the best speed possible. Background: I am not sure if MySQL is the best solution, but I will use MySQL ...
oshirowanen's user avatar
-1 votes
2 answers
360 views

Which database to use when you have a 6 billion of rows inside and need to query rows with from list of IDs? [closed]

We are currently researching our case of storing the road distances between cities. Right now we have 6 billion of those distances. Our structure right now in SQL Server is that we have a float which ...
Artem Biryukov's user avatar
0 votes
1 answer
48 views

Creating big shared database

I wish to create DB in Firestore. My program will have multiple user and each user will have calendar and can create an event. The user can share this event with any other user (Similar to Google ...
Dim's user avatar
  • 103
1 vote
2 answers
2k views

Geo Route - Best way/db to store route path

We are developing an app in that UI need to show a path where a truck driver drives the truck. Driver mobile will continuously send (example every 10 seconds) their live location. Which database is ...
Ankur Loriya's user avatar
1 vote
1 answer
80 views

Database software solution [closed]

Our company has user data (name, email, phone number, systems of access, AD username) in a large Excel workbook. The Excel workbook is becoming very slow because of the 1000s of entries in it, and we'...
rocky's user avatar
  • 21
-2 votes
2 answers
251 views

MySql : Does it worth to convert a column with type DATETIME to DATE?

At the start of a project, a DATETIME column made sense. But now, 5 years after, requierments changed the time part have never be used. My table has about 100k lines and grows with about 500 lines ...
sdespont's user avatar
  • 111
0 votes
1 answer
41 views

Is there a type of database that can directly recall an element given a pointer in O(1) time?

I'm currently using levelDb, which is a key->value store database. The only data being inserted are small binary blobs (that represent nodes for a large merkle tree). When I put a value in the db, I ...
ZMitton's user avatar
  • 101
1 vote
3 answers
2k views

How to store real-time data to database [closed]

Here is my situation: I have a WebSocket connection that feeds me data real-time I have an async callback function that gets the data and inserts into a queue I have another thread that reads from ...
MoneyBall's user avatar
  • 111
0 votes
3 answers
943 views

Overwriting MySQL database to only store 1 month of data

We are logging data on hardware with only small memory (short on disk storage) only 4GB. We only require the data to be stored for 1 month and then be over written in a way that it overrides older ...
Phil 's user avatar
-3 votes
2 answers
164 views

Python - Best database for exponentially growing database? [closed]

So I am making a Discord (social media) Bot in Python using discord.py-rewrite, and I need to save informations of lots of servers and users (such as how much money they have, what items thay have…). ...
BluePigeon's user avatar
4 votes
0 answers
113 views

How to set up a solid MySQL/MariaDB Server for +3000 active connections? [closed]

Background. I have an App connecting to an RDS instance on Amazon (r3.Large) and it's working smoothly. However, the boss does not like to spend ~ $1,000 bucks a month on it so we are moving In-house....
Neoz Memphisto's user avatar
1 vote
0 answers
17 views

Database/cloud solution for very wide time series data (i.e. spectra with up to 8196 columns)?

I'm dealing with data from a science project which comes from a multi-channel analyzer: once per minute I get 2048 integer values from one device and 8192 integer values from another device. Both ...
MrFu's user avatar
  • 111
4 votes
0 answers
100 views

What DBMS to choose for my production environment? [closed]

This is my very first question on the StackExchange/StackOverflow community. I originally am an electrical engineer so I hope you bear with me. I need to set up a database whose purpose is to be ...
ryancooper73's user avatar
0 votes
2 answers
305 views

Database which can be setup without admin user [closed]

I'm looking for a database (relational would be preferred, but NoSQL is also okay) which can be run without an admin user. I want to setup the database with an admin user, but then delete the admin ...
Niklay's user avatar
  • 1
0 votes
1 answer
827 views

View images as query results [closed]

I've done lots of research on the topic but I'm drawing a blank. Are their any database engines that can return rendered images in the query response? For example: Select images from fruit where ...
Matt D's user avatar
  • 55
0 votes
1 answer
560 views

Multi-master (NoSQL) database solutions with cloud and no-premise option [closed]

We are currently investigating database options for distributed database (possibly globally distributed) where the data in general is stored in "cloud" (this would not be a special requirement). The ...
zopyx's user avatar
  • 1
4 votes
1 answer
946 views

How do database operations (write, update, alter) on particular cell in a table are written to disk without overwriting entire file?

When I want to write to or alter particular cell of an excel file/table using python I'll use pandas read_csv then alter value in particular cell and write back to file with to_csv. But writing back ...
Optic_Ray's user avatar
-4 votes
1 answer
89 views

which is the appropriate database for my use case [closed]

I have a set of n sentences (n >= 100k). I want to perform queries of the sort where given a set of n_i sentences i return a set of m_i words that is present in one subset of n_i sentences and not ...
arrhhh's user avatar
  • 1
1 vote
0 answers
67 views

How to design a database for production volume and loses control? [closed]

I must develop a database for inputting information of the produced volume (hourly), quality and technical issues during this production. As the input of the production volume is made manually, the ...
Vinícius Ollitta's user avatar
1 vote
2 answers
984 views

Are there alternatives to Microsoft Access? [closed]

In my office, we often use MS Access for many applications (eg creating reports, data analysis and data processing) because it is convenient to use (easy data import, fast query building, easy ...
Rico's user avatar
  • 19
1 vote
1 answer
41 views

Different categories of missings

Most database systems can represent missing values, typically as "Null" or something similar. But what if I want to represent different categories of missing data? For categorical data, this is ...
user3120868's user avatar
3 votes
2 answers
337 views

Structured .TXT Data To A Proper DBMS [closed]

I'm presented with multiple .txt documents (each with its own set of columns) containing rows separated by some type of delimiter (which is different across the files). Each .txt file has different ...
apple212's user avatar
0 votes
1 answer
327 views

database and table design for billions of rows of data

basically i got 2 tables: header, details tables. CREATE TABLE `header` ( `ID` int(11) NOT NULL AUTO_INCREMENT, `RECORD_DATE` datetime DEFAULT NULL, `TICKER_ID` int(11) DEFAULT NULL, `...
user2285201's user avatar
0 votes
3 answers
562 views

Zero Maintenance self-hosted off-line databases?

I'm looking for a "Zero Maintenance" database engine that can be installed on Windows. We have a lot of customers that want our software installed on their local computers. Although we have a cloud ...
kismert's user avatar
  • 133
3 votes
1 answer
55 views

Storage solution to run IoT analytics [closed]

I have several hundred IoT devices pushing data to my server every minute. The data is structured and it has following columns: Site ID (String) Event Start time (Date Time) Event End Time (Date Time)...
Ibn-e-Batuta's user avatar
-1 votes
1 answer
214 views

Suggestions for type of DB to use (Elasticsearch vs MongoDB vs Hadoop)

I am hoping some of you highly skilled DBAs can provide some insight as to the best DB to use for this dataset. This is a relatively simple dataset with no relationship needed between the entries. ...
Scott Summers's user avatar
0 votes
1 answer
89 views

Should I use MongoDB or a relational database management system for this scenario? [closed]

I have a different item types, each item has different number of attributes some attributes might contain an arbitrary number of values. For example, a building which has amenities attribute, this ...
Rickless's user avatar
  • 101
2 votes
1 answer
6k views

best local database (for PC) [closed]

I have a PC which runs a local desktop application that connects to a logic server with a database. additionally i need a small cache database in this PC so when the client goes offline for some ...
Izikon's user avatar
  • 121

1
2 3 4 5
7