Questions tagged [bigtable]

Bigtable is a wide-column NoSQL data storage system designed and built by Google.

Filter by
Sorted by
Tagged with
0
votes
0answers
16 views

Google BigTable and multi-level nested data

I am creating an application which aims to create forecast models based on simulated meteorological data, taken at 24 hour intervals from each of the 500 (simulated) sensors. Data is made of nested (...
-1
votes
1answer
31 views

suggestion needed for big data development [closed]

I am trying to find out what is state of the art with database, python, and big data. My starting point began with a SQL server, and multiprocessing pandas, and dask. Imagine I need to maintain a ...
0
votes
0answers
7 views

Running BigQuery on BigTable vs loading from Google Storage

I have a medium size dataset (a few TBs), that is changing over time that requires BigQuery analysis. The first attempt to do analysis was composed by: dumping the DB into a JSON moving it into a ...
0
votes
0answers
158 views

Choosing right database for storing bank transactions

I am starting a new project within GCP and I am trying to choose a right tool for storing bank transactions: I don't need transactions, these will be basically write-only, no updates I don't need ...
0
votes
2answers
261 views

How to speed up an insertion from a huge table with postgres?

I have 5 tables in my database with respectively a size of 70Gb, 500Mb, 400 Mb, 110Mb and 20 Mb. I want to create a new table that contains all columns of all tables, so I tried 2 queries, the first ...
2
votes
1answer
746 views

Can you use BigQuery to run on top of Bigtable

I need to run BigQuery on top of Bigtable live, not as an export. I have found the information stating it was in beta but only as an export function. I would like to run BigQuery against Bigtable data ...
3
votes
1answer
742 views

Replacing an aggregation system of statistics

We currently have a database under MySQL, storing aggregated statistics in different tables (recent hours, hours, days, months). The tables are updated by workers running at different rates depending ...
9
votes
1answer
2k views

Why can't we perform joins in a distributed database like Bigtable?

From this answer to "What database does Google use?": Bigtable is not a relational database. It does not support joins nor does it support rich SQL-like queries. Is this obvious? I do not ...
12
votes
1answer
280 views

What are the performance implications of polymodels versus normal Bigtable models in Google App Engine?

What produces the best performance in regular Google App Engine use, a polymodel or a normal "Bigtable" model? The polymodel, effectively, creates a column in the parent table called "class" which ...