Questions tagged [database-recommendation]

Determining what database product best fits the requirements and limitations in a specific situation. This is advice that generally requires much more insight into requirements than can easily be gleaned on a Q&A forum such as StackExchange.

Filter by
Sorted by
Tagged with
0
votes
1answer
31 views

Creating big shared database

I wish to create DB in Firestore. My program will have multiple user and each user will have calendar and can create an event. The user can share this event with any other user (Similar to Google ...
0
votes
2answers
32 views

Geo Route - Best way/db to store route path

We are developing an app in that UI need to show a path where a truck driver drives the truck. Driver mobile will continuously send (example every 10 seconds) their live location. Which database is ...
0
votes
0answers
23 views

db choice for activity log

I'm working on a geo-replicated web platform, composed of an ecosystem of microservices. We need to improve and rework the user activity tracing pipeline and I'm looking for "the best" ...
1
vote
1answer
64 views

Database software solution [closed]

Our company has user data (name, email, phone number, systems of access, AD username) in a large Excel workbook. The Excel workbook is becoming very slow because of the 1000s of entries in it, and we'...
-2
votes
2answers
53 views

MySql : Does it worth to convert a column with type DATETIME to DATE?

At the start of a project, a DATETIME column made sense. But now, 5 years after, requierments changed the time part have never be used. My table has about 100k lines and grows with about 500 lines ...
0
votes
1answer
27 views

Is there a type of database that can directly recall an element given a pointer in O(1) time?

I'm currently using levelDb, which is a key->value store database. The only data being inserted are small binary blobs (that represent nodes for a large merkle tree). When I put a value in the db, I ...
1
vote
3answers
63 views

How to store real-time data to database [closed]

Here is my situation: I have a WebSocket connection that feeds me data real-time I have an async callback function that gets the data and inserts into a queue I have another thread that reads from ...
0
votes
3answers
23 views

Overwriting MySQL database to only store 1 month of data

We are logging data on hardware with only small memory (short on disk storage) only 4GB. We only require the data to be stored for 1 month and then be over written in a way that it overrides older ...
-2
votes
2answers
56 views

Python - Best database for exponentially growing database? [closed]

So I am making a Discord (social media) Bot in Python using discord.py-rewrite, and I need to save informations of lots of servers and users (such as how much money they have, what items thay have…). ...
4
votes
0answers
59 views

How to set up a solid MySQL/MariaDB Server for +3000 active connections? [closed]

Background. I have an App connecting to an RDS instance on Amazon (r3.Large) and it's working smoothly. However, the boss does not like to spend ~ $1,000 bucks a month on it so we are moving In-house....
0
votes
0answers
9 views

Database/cloud solution for very wide time series data (i.e. spectra with up to 8196 columns)?

I'm dealing with data from a science project which comes from a multi-channel analyzer: once per minute I get 2048 integer values from one device and 8192 integer values from another device. Both ...
4
votes
0answers
51 views

What DBMS to choose for my production environment? [closed]

This is my very first question on the StackExchange/StackOverflow community. I originally am an electrical engineer so I hope you bear with me. I need to set up a database whose purpose is to be ...
0
votes
2answers
76 views

Database which can be setup without admin user [closed]

I'm looking for a database (relational would be preferred, but NoSQL is also okay) which can be run without an admin user. I want to setup the database with an admin user, but then delete the admin ...
0
votes
1answer
31 views

View images as query results [closed]

I've done lots of research on the topic but I'm drawing a blank. Are their any database engines that can return rendered images in the query response? For example: Select images from fruit where ...
0
votes
1answer
213 views

Multi-master (NoSQL) database solutions with cloud and no-premise option

We are currently investigating database options for distributed database (possibly globally distributed) where the data in general is stored in "cloud" (this would not be a special requirement). The ...
4
votes
1answer
860 views

How do database operations (write, update, alter) on particular cell in a table are written to disk without overwriting entire file?

When I want to write to or alter particular cell of an excel file/table using python I'll use pandas read_csv then alter value in particular cell and write back to file with to_csv. But writing back ...
-4
votes
1answer
78 views

which is the appropriate database for my use case [closed]

I have a set of n sentences (n >= 100k). I want to perform queries of the sort where given a set of n_i sentences i return a set of m_i words that is present in one subset of n_i sentences and not ...
1
vote
0answers
58 views

How to design a database for production volume and loses control? [closed]

I must develop a database for inputting information of the produced volume (hourly), quality and technical issues during this production. As the input of the production volume is made manually, the ...
1
vote
2answers
511 views

Are there alternatives to Microsoft Access? [closed]

In my office, we often use MS Access for many applications (eg creating reports, data analysis and data processing) because it is convenient to use (easy data import, fast query building, easy ...
1
vote
1answer
35 views

Different categories of missings

Most database systems can represent missing values, typically as "Null" or something similar. But what if I want to represent different categories of missing data? For categorical data, this is ...
3
votes
2answers
242 views

Structured .TXT Data To A Proper DBMS [closed]

I'm presented with multiple .txt documents (each with its own set of columns) containing rows separated by some type of delimiter (which is different across the files). Each .txt file has different ...
0
votes
1answer
156 views

database and table design for billions of rows of data

basically i got 2 tables: header, details tables. CREATE TABLE `header` ( `ID` int(11) NOT NULL AUTO_INCREMENT, `RECORD_DATE` datetime DEFAULT NULL, `TICKER_ID` int(11) DEFAULT NULL, `...
0
votes
3answers
227 views

Zero Maintenance self-hosted off-line databases?

I'm looking for a "Zero Maintenance" database engine that can be installed on Windows. We have a lot of customers that want our software installed on their local computers. Although we have a cloud ...
2
votes
1answer
47 views

Storage solution to run IoT analytics [closed]

I have several hundred IoT devices pushing data to my server every minute. The data is structured and it has following columns: Site ID (String) Event Start time (Date Time) Event End Time (Date Time)...
-1
votes
1answer
150 views

Suggestions for type of DB to use (Elasticsearch vs MongoDB vs Hadoop)

I am hoping some of you highly skilled DBAs can provide some insight as to the best DB to use for this dataset. This is a relatively simple dataset with no relationship needed between the entries. ...
0
votes
1answer
75 views

Should I use MongoDB or a relational database management system for this scenario? [closed]

I have a different item types, each item has different number of attributes some attributes might contain an arbitrary number of values. For example, a building which has amenities attribute, this ...
2
votes
1answer
5k views

best local database (for PC) [closed]

I have a PC which runs a local desktop application that connects to a logic server with a database. additionally i need a small cache database in this PC so when the client goes offline for some ...
3
votes
2answers
13k views

Single user mode while restoring database

Is it necessary to put the database into single user mode before restoring a database? If so which one is more preferable putting the sql server into single user mode or putting the database only into ...
0
votes
1answer
277 views

Which database is best for storing mouse movement data for analytic stuff? [closed]

Problem I want to track the user behavior on website. I am tracking the mouse movement and after tracking certain number of mouse movements, i am planning to send this data to my server, where i will ...
0
votes
1answer
431 views

SQL Import text files [closed]

I have a directory that will regularly have text files dumped in it that I'm trying to get imported into a single SQL table. Basic format of the text files is as such: [DATA] Test: 12345 Test type: ...
0
votes
2answers
43 views

Regex rules engine based on SQL

I have a table which I use to determine actions based on conditions provided. This is what it looks like right now. IPAddress, MACAddress, Hostname, ScriptName, Argument1, Argument2, Argument3 10.2.1....
1
vote
1answer
69 views

Having two entities that are the same except for 1 distinct attribute

In an example scenario for a database design assignment, a company provides hotel rooms (split into two entities - Hotel and Room) and apartments. So the database will contain the following entities: ...
2
votes
3answers
4k views

What is the difference between views and materialized views

What is the difference between PostgreSQL's materialized views and MySQL's views?
90
votes
5answers
127k views

Best database and table design for billions of rows of data [closed]

I am writing an application that needs to store and analyze large amounts of electrical and temperature data. Basically I need to store large amounts of hourly electricity usage measurements for the ...
0
votes
1answer
107 views

MySQL : Are hash indices useless?

In MySQL, hash indices are only supported by the MEMORY storage engine. By using this engine, data is stored in RAM, not on the hard disk, so it will be lost when MySQL is restarted. Also, ...
1
vote
1answer
586 views

NoSQL or RDBMS for a Giant Lookup Table?

What is the best way store leaked website credentials? I've come up with two that would get the job done for the most part, but I am trying to find the fastest and most efficient solution. Take for ...
1
vote
1answer
46 views

Open access relational database [closed]

I have some very basic knowledge in SQL which I mainly learn from some theoretical data science course. I would like to write a few lines of SQL just to experiment and train myself. Can you please ...
3
votes
1answer
5k views

MySQL audit and general log

May ask for the difference of MySQL Audit log plugin and general log? I looking for any activities done in a MySQL server.
2
votes
2answers
781 views

Recommendation for storage of series of time series

Just a few words describing the data: In my application, there are acceleration measurements (for example at 25kHz) for the exemplary duration of one second. These measurements get repeated in not ...
3
votes
2answers
65 views

Update/fix or recreate old database [closed]

My employer is currently using a database build in Borland Visual dBase 5.5 that has been running on a Windows 95 machine for the last 20 years. I am trying to figure out my best course of action to ...
0
votes
2answers
148 views

whats the use of an autoincrement primary column?

I would like to know when is it really needed to use an auto increment primary column, what is the value it adds? my colleague suggests to have a separate auto increment column for a table as a ...
2
votes
1answer
137 views

Good databases for unanchored LIKE condition

Basically I need a database that is good with queries like LIKE %abc%. I already tried PostgreSQL with GIN indexes and it is very good, but maybe there is something even better? I also tried MongoDB ...
1
vote
0answers
91 views

What data store should I use for storing and querying a billion small (~2kb) JSON documents?

I'm trying to figure out which database to use for storing and querying on ~1 billion JSON documents about the size of 2KB each. About 2 TB of data. Nature of JSON documents: 3 types of documents (...
-1
votes
1answer
219 views

Design for membership of a group

I have two different databases. One of these is a Users table, and another is a Groups table. A group can have multiple users, and a user can have multiple groups What's the best way to associate a ...
0
votes
1answer
38 views

Searching for scalable storage solution

In one project I save statuses of processing in MySQL table: `id` `name` `email` `has_apples` `has_bananas` 1 Bob a@b.c 1 0 2 Mike c@d.e 0 1 3 ...
11
votes
2answers
3k views

Database for efficient range aggregate queries?

As a simplified example, suppose I have a table like this: seq | value ----+------ 102 | 11954 211 | 43292 278 | 19222 499 | 3843 The table may contain hundreds of millions of records, and I need ...
1
vote
2answers
171 views

Creating a database for students [closed]

the institute I am working at wants to create a database for students. I have to find the best and easiest solution for this application and I need your opinions. We would like to create a website/...
1
vote
0answers
739 views

MySQL MyISAM corrupted table repair failure

My MyISAM tables got corrupted(I guess due to fs corruption) filesystem_cstor.MDS_DATA warning : Table is marked as crashed warning : Table is marked as crashed error : Key in wrong position at ...
0
votes
2answers
438 views

global unique identifier for 2 tables in relational sql

There are 2 sub-systems[ suppliers and retailers ] in our online market chain management system . Entry in any of those[ suppliers or retailers ] should give a globally unique ID .There would be ...
3
votes
3answers
467 views

What databases can I use to represent ordered sets?

In a SQL database, the only way to represent an arbitrarily ordered set is to give every record an "Order" and every time you update or move an item around in this ordering you have to update or ...

1
2 3 4 5
7