I'm writing a price tracking application.
Every day I need to store price information about ~15M products. (So it's about 15M * 365 = 5.5B records per year).
One product has many prices over history. My main table (if I opt for a SQL DBMS) should include the following attributes:
price(4bytes int) can be
date(only date without time since daily update)
E.g. (9223372036854, 85.41, 14-01-2019, "USD")
I don't want to mark the latest price as 'active' or something, so I'm interested only in price history itself. The database should have high IO throughput (~1000 simultaneous reads).
Queries I'm planning to run:
- Get all price for the specific
product_idfor the specific time range
- Basic math operations like
So, I am curious:
- Should I stick to a SQL DBMS (Postgres) or use some NoSQL product (e.g. Amazon Redshift)
- Which DBMS can you recommend?