Questions tagged [timescaledb]

TimescaleDB is an open source time-series extension of PostgreSQL. Use this tag for questions related to TimescaleDB. Also tag with the more general "time-series-databases".

Filter by
Sorted by
Tagged with
1
vote
0answers
32 views

Are out of order inserts an issue?

I am running a PostgreSQL database that is logging state-of-health information for a number of systems. At the moment, it is running on a standard PostgreSQL server, but it seems like TimescaleDB has ...
0
votes
0answers
32 views

timescaleDB insertion speed issue

I’m trying to use pandas to interact with timescaleDB. I initiate my DB in DBeaver with the following CREATE TABLE db_009a005a_df_downloaded_grand ( symbol VARCHAR(32), timestamp TIMESTAMP ...
1
vote
1answer
48 views

TimescaleDB on Azure Postgres error when creating continuous aggregation

I am getting the following error SQL Error [0A000]: ERROR: functionality not supported under the current license "ApacheOnly", license¶ Hint: Upgrade to a Timescale-licensed binary to ...
1
vote
0answers
82 views

How to optimize for performance when querying millions of rows in real-time analytics?

Suppose I have a simple table called events like this: timestamp event_id action_count apr 5 01:05:00 foo 10 apr 5 01:04:15 bar 20 apr 5 01:06:10 baz 200 apr 5 01:04:30 baz 5 apr 5 01:03:00 baz ...
1
vote
1answer
45 views

timescaledb: Bulk insert exhausts all memory

Summary I am attempting to insert data into a timescaledb hypertable in bulk. Regardless of what I try, the memory usage grows gradually until the server process is killed due to a lack of memory. I ...
1
vote
1answer
56 views

Can't do simple query or drop table due to out of memory error, but pg_locks return no lock

I received this out of memory error when trying to drop a large table (70GB including index) but couldn't identify the root cause from pg_locks view DROP TABLE big_table; ERROR: out of shared memory ...
0
votes
1answer
28 views

How to quickly return the number of rows in a distributed hypertable with more than 100 million rows in TimescaleDB?

In a 'vanilla' PostgreSQL 12.7 database, I generally run the following query to learn the estimated number of rows in tables with 100+ million rows: ----------------------------------------------------...
1
vote
1answer
63 views

Database architecture of high frequency sensor values

I have a lot of sensors (around 1000) and want to save their values. The sensors will mostly work around a sampling rate of 10Hz. Regular queries will be used for a live-view application. It can be ...
1
vote
0answers
179 views

PostgreSQL does not start: FATAL: xlog flush request is not satisfied --- flushed only to 0

I have a Docker PostgreSQL (TimescaleDB) developer instance with a local Linux volume mapping. version: '3' services: dex-timeseriesdb: image: timescale/timescaledb:latest-pg12 # https://...
2
votes
1answer
44 views

TimescaleDB database design - should I use inheritance?

I have the following TimescaleDB hypertable: CREATE TABLE public.data ( event_time timestamp with time zone NOT NULL, pair_id integer NOT NULL, entry_id bigint NOT NULL, event_data1 ...
2
votes
2answers
274 views

Converting PostgreSQL table to TimescaleDB hypertable

I have a PostgreSQL table which I am trying to convert to a TimescaleDB hypertable. The table looks as follows: CREATE TABLE public.data ( event_time timestamp with time zone NOT NULL, ...
0
votes
1answer
132 views

postgres read query resample time series data for hourly averages

I am new to SQL trying to learn how to do read queries on time series data. Can someone give me a tip on how to resample interval time series data to hourly averages on the postgres read query? My ...
4
votes
1answer
99 views

Non-deterministic performance of query on select, from 1s to 60s on table with 1 billion rows

I'm trying to investigate why the performance of this query is so non-deterministic. It can take anywhere from 1 seconds, to 60 seconds and above. The nature of the query is to select a "time ...
2
votes
0answers
265 views

Multiple tables vs rows for timescaledb / postgresql

I am designing a postgresql/timescale database where I will be recording trades on multiple stocks. For each stock I will be saving the following columns: Trade time, Attribute 1, Attribute 2, ...
0
votes
0answers
35 views

TimescaleDB restore is not working properly

I did the docker volume restore from a tar file, that worked fine. The data size is around 50GB. When we run docker I was getting below error: 2021-03-19 07:07:17.117 UTC [1] LOG: listening on IPv4 ...
2
votes
0answers
18 views

How do I know which timescale db docker image was used?

I see timescaledb.last_tuned_version = '0.8.0' in postgresql.conf. How can I know which docker timescaledb image (exact version) was used?
-1
votes
1answer
54 views

TimescaleDB wildcard (%) slow

I have a timescaledb hypertable like this: create table logs ( time timestamp not null, partitionkey text not null, ip inet, raw text, transformed ...
3
votes
2answers
181 views

On docker volume restore: could not access file "$libdir/timescaledb-1.6.0": No such file or directory

I am trying to restore TimescaleDB data from one ubuntu machine to another ubuntu machine. On the both machines we have deployed TimescaleDB through docker and using the same tag. Docker image used: ...
1
vote
1answer
57 views

TimescaleDB distributed setup strategy

What is the best setup strategy for TimescaleDB? My initial thoughts based on the TimescaleDB FAQ was that it is indeed recommended and possible to basically have one database that contains both time ...
1
vote
2answers
98 views

Optimizing table for timeseries Postgres data table

I have the below table which maintains a timeseries result. The row only becomes relevant when the signal is true, When signal is false, it just marks that for that particular timestamp we got a ...
0
votes
1answer
26 views

First metric in each time "bucket" for multiple IDs

I have the following table in PostgreSQL 12: CREATE TABLE vehicle_fuel ( vehicle_id int NOT NULL , submitted_at timestamp NOT NULL , fuel float NOT NULL); Currently there are ...
1
vote
1answer
95 views

Postgres: Why is my delete query using up all available disk space?

I have a postgres table set up like so: Table "public.facts" Column | Type | Collation | Nullable | ...
1
vote
2answers
490 views

High autovacuum CPU/IO usage from database with more than 10k append-only tables

In my system I have more than 10k tables that are very similar, I only do insert operations in these tables and delete old data via a cron schedule one time per day. These insertions come each minute, ...
0
votes
0answers
228 views

PostgreSQL query takes hours instead of seconds after adding one row in a referenced table

I'm new to the database world and I think I'm missing some basic understanding of my issue. It seems to me this is a conceptual issue. I have a table 'data' with the Timescaledb extension. The column '...
0
votes
1answer
713 views

Postgres optimizing join of 2 large tables

I have 2 tables one with around 1M entries and other around 4M. I want to join these tables in a materialized view. But the materialized view creation is taking too long ~4 hours. I don't see the ...
0
votes
0answers
88 views

Space concerns for unique constraint on row for time-series db (PostgreSQL / TimescaleDB)

I was wondering if there is a more space-efficient way of doing unique row constraints on time-series DBs. Adding a normal unique key for the entire row will result in an index the same size or ...
0
votes
1answer
17 views

Add aggregated value filtered by a condition to existing query

I have this table to collect data from IoT device: CREATE TABLE public.conferimenti ( id bigint NOT NULL DEFAULT nextval('conferimenti_id_seq'::regclass), codicestazione smallint NOT NULL, ...
0
votes
1answer
369 views

Ways to optimize the PostgreSQL/TimeScaleDB query

What approaches I could take to optimize the performance of the following joinless query on the following PostgreSQL/TimeScaleDB table? So far, I managed to create the right index which is obviously ...
1
vote
1answer
898 views

Unable to convert a table to hypertable due to unique index error

I am creating a table using Flask SQL Alchemy as follows: class Price(db.Model): __tablename__ = "prices" id = db.Column(db.Integer, primary_key=True) country_code = db.Column(db.String(2)...
0
votes
0answers
175 views

Splitting columns and getting result as a JsonArray in Postgresql

I have a table like this: Time | id/type | value 1 A/a 10 2 A/b 15 3 A/c 8 4 A/b 2 I need to get a Json Array in the format: [[Time, value for ...
2
votes
1answer
677 views

ZFS Tunings for PostgreSQL

What are the recommended ZFS tunings for PostgreSQL 11 (with TimescaleDB 1.6 extension) running on striped mirrored vdevs of SATA3 SSDs? I am considering: ashift=12 atime=off relatime=on (or off?) ...
2
votes
1answer
816 views

Find Uncompressed/Compressed Sizes of TimescaleDB Database/Table

For a database/table in TimescaleDB and PostgreSQL 11 running on ZFS with both ZFS compression and native TimescaleDB compression enabled, how can you find the uncompressed and compressed sizes when ...
4
votes
1answer
271 views

Continuously Adding SSDs to an existing PostgreSQL Server

An Ubuntu 18.04 server dedicated to running a PostgreSQL 11.2 server (with TimescaleDB extension) will be running out of disk space soon so new SSD disks will need to be added to the machine to ...
0
votes
0answers
64 views

How does Timescale assign chunk ids?

Timescale allows us to query for chunk sizes in with something like SELECT * FROM chunk_relation_size('....'); I am trying to monitor the chunk sizes so that if any of them reaches a size that is ...
2
votes
0answers
423 views

Backing up Time Series Database (PostgreSQL/TimescaleDB) where old data will never be updated

If a PostgreSQL (using TimescaleDB extension) database that holds time series data is continuously growing in size, what is the recommended backup strategy if we do not want to continuously create ...
0
votes
0answers
217 views

How to use timescale-bitnami image on Windows?

Since there are issues with collations in the default alpine-based timescaledb images, I tried to use the bitnami-image. But I get an error on startup. docker run ^ -p 5432:5432 ^ -v tsdb-bitnami:/...
0
votes
1answer
596 views

Best way to async data inserts into timescaledb

Having 3 files with one data set of daily data inside: 2019-09-11.txt 2019-09-12.txt 2019-09-13.txt Having lines like: 2019-09-11 15:59:37.459802,1 2019-09-11 15:59:38.959802,1 [...] The files are ...
1
vote
1answer
681 views

Reordering a postgresql timescaledb hypertable

Is the standard postgresql way also possible on a timescaledb hypertable? CLUSTER [VERBOSE] tablename [ USING indexname ] Example: Creating table & hypertyble CREATE TABLE IF NOT EXISTS l1( ...
0
votes
2answers
424 views

How to move old data to cheap hard drive

I have a quite big PostgreSQL database (with timescale plugin). Right now it is consuming about 500Gb on a SSD. Most of the data is in the form of time series. In most cases data older than a few ...
1
vote
0answers
64 views

Group by equidistant integer intervals

I am using TimescaleDB (an extension to PostgreSQL) to store altitude data from a GPS sensor. The table looks like: CREATE TABLE IF NOT EXISTS altitude ( time TIMESTAMPTZ NOT ...
8
votes
1answer
307 views

Which data model/schema to apply to a timeseries datastore for data sources with varying fields

I'm asked to develop a data-storage for time-series data, yet despite significant research I'm unsure about the data model and storage technology to chose. About the data The source data which is to ...
0
votes
0answers
77 views

How to partition a table without time data?

I am using postgresql to store information about event ticket sales. I have two tables: event_sale and event_sale_seat: event_sale (id integer, created_at timestamp with time zone) event_sale_seat (...
8
votes
1answer
2k views

Can I use hypertables in timescaledb merely to get better insert rates?

I have a PostgreSQL db that I have a large bulk load running into. I wish this load to be as fast as possible. I'm already using the copy command etc. I have been reading about timescaledb and how ...
1
vote
1answer
341 views

Speeding up group by and max query

In my iot use case, I have a table which stores sensor readings. I am using the timescaledb extension. I have the following table definition: CREATE TABLE readings ( id BIGSERIAL ...
0
votes
4answers
230 views

Dynamically generate batched data for import

I need to execute a test in which I have to simulate 20 years' historical data in PostgreSQL (and TimescaleDB) DB. My problem is that I have to generate .sql files and ingest them (using psql-client) ...
1
vote
0answers
40 views

How to aggregate transactions to form a stateful view which can be updated efficiently?

How to aggregate transactions to form a stateful view which can be updated efficiently? For example how to turn the following transactions: CREATE TABLE txns_combined(from_party,to_party,price,qty,...