Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange
Join us in building a kind, collaborative learning community via our updated Code of Conduct.

The tag has no usage guidance.

0
votes
0answers
5 views

Storing arrays of data in a time-series database

I'm building an low utilization time-series database to capture yearly data points for a set of items fewer than 100,000. My question has to do with storing arrays of data in a way that is easily ...
1
vote
2answers
28 views

Add cumulative sum to time-series query PostgreSQL 9.5

I wrote the query that gives me time-series over some date range and interval that shows revenue for each time interval: SELECT interval_date, coalesce(campaign_revenue,0) AS campaign_revenue,...
0
votes
1answer
37 views

Database for timeseries data [closed]

I work in a fintech company and we are redesigning our data system. We have around 120 GB of compressed data stored in the filesystem. The data concerns around 80K different timeseries each one of ...
3
votes
2answers
158 views

Speeding Up Query on a Time Series Table. It's Slow to get (MAX - MIN) Aggregation Value

Question How to improve this query to increase the speed of the query shown below from 30+ seconds to milliseconds? I am using PostgreSQL: v 9.6.6. Context I have a time series table buildings....
1
vote
0answers
33 views

Which Database to choose? [closed]

For my project, I have a time series data of around 30 TB. Data is structured. I have some additional requirements: Bulk load option should be available from csv(data size around 100GB). able to ...
3
votes
1answer
110 views

High Cardinality Time Series Database?

I have data that is being collected every 30 minutes from a website. This data looks like the following. The "epoch" row labels are placeholders for actual epoch timestamps of each sample. The columns ...
1
vote
0answers
49 views

Looking for a solution for timeseries storage and stream query [closed]

I have been looking for a (time series) database solution for quite a while. My candidates for now are: MySQL, MongoDB, Influx, Prometheus, DataDog, Arctic, kDB ... My needs include: 1, support ...
3
votes
1answer
69 views

How can I speed up my slow query?

I have a table of pigeon data. pigeon_id = ID of pigeon date_time = time of signal_event pigeon_station = id of pigeon station signal_strength = signal strength of pigeon CREATE TABLE `...
0
votes
0answers
49 views

Timeseries DB and howto store spectral data

Hoping to address my question within the right Forum. If not, please assist me, where to ask. Having an use case in which I get one-dimensional acceleration measurents delivered with a given sampling ...
0
votes
0answers
318 views

Efficiently storing time series data in PostgreSQL

What would you recommend in the following scenario please? I am new to PostgreSQL especially when working with such large datasets. You want to store time series information, specifically dividends ...
2
votes
1answer
1k views

Time series data of a several sources in one SQLite table or several? File size impact?

Here is the situation: A large amount of time series data from a very limited set of sources is to be kept in a SQLite database file. Time series sources are identified by a 10 character long string. ...
3
votes
1answer
33 views

Looking for a book on optimizing tables and queries for handling time sequence data

I once had an electronic copy of what I understood to be a classic work on optimizing tables and queries for handling timestamped data. It was old-ish when I found it 6-8 years ago. I was sure I ...
2
votes
2answers
308 views

Recommendation for storage of series of time series

Just a few words describing the data: In my application, there are acceleration measurements (for example at 25kHz) for the exemplary duration of one second. These measurements get repeated in not ...
4
votes
1answer
180 views

Efficiently store time based data

As a reporting solution, I have a large table with ~50M records called "reports". Currently, I am using PostgreSQL with partitioning table feature day by day, (table name reports_20170101 means that ...
1
vote
1answer
4k views

Understanding how to choose between fields and tags in InfluxDB

What are some good rules and examples of how to choose between storing data in fields vs. tags when designing InfluxDB schemas? What I have so far is that a measurement that changes over time ...