Questions tagged [dynamodb]
Amazon DynamoDB is a NoSQL Database featured as a part of the AWS.
0
votes
0answers
8 views
optimal (price) solution in aws for write-heavy read-infrequently key/value store? [closed]
Apologies in advance if this question is too vague. Admins: feel free to delete if so.
Background:
Copious amounts of user activity data streamed to S3
File size ~32 MB
Record size ~1k; format = ...
0
votes
0answers
24 views
replication type of dynamodb
What is the replication type of the DynamoDB system? Like is it master slave, peer to peer, multi master, or something else.
I know that that for global tables, DynamoDB has cross replication with ...
-2
votes
1answer
62 views
Can PostGIS or Oracle Spatial and Graph scale to hundreds of terabytes of data, or should I use a NoSQL option like DynamoDB? [closed]
I'm going to have a very large data set (a few hundred terabytes big eventually), but it is very well structured, relatively simple data involving lat, long points (which is why I want some GIS ...
0
votes
0answers
40 views
AWS DMS attribute-type list into DynamoDB?
I'm trying to use AWS DMS (Database Migration Service) to load data from a .csv file stored into S3 to AWS DynamoDB. One of the columns (the last one) in the csv file is a list. Sample data:
...
1
vote
0answers
35 views
Most effective way of logging user query activity
We are logging and permanently storing all the queries performed about private persons in our database. Due to GDPR we need to be able to show all the entities who have requested personal data and the ...
1
vote
1answer
46 views
Suitable NoSQL DB design for a fleet of IoT devices [closed]
This is my use case:
10,000 IoT devices
Each IoT device sends its environmental data (temperature, pressure, etc.) every 30 seconds
Data of each device will be kept for 24 hours
The main requirement ...
1
vote
1answer
17 views
How does an encrypted DynamoDB (the same question applies to RDS as well) query work?
I am trying to understand whether the primary key is encrypted when I choose to encrypt in rest for AWS DynamoDB
If the primary key is encrypted, how does a primary-key look up get
performed under ...
0
votes
1answer
496 views
How to update DynamoDB item by searching on GSI primary key?
Table has these columns on DynamoDB:
primaryKey
sortKey
GSI_primaryKey
data
And there is GSI added with primary key GSI_primaryKey and sort key on primaryKey
How to update column data if I have ...
1
vote
0answers
25 views
DynamoDB query by flag which tells if it's time to re-process the item
I have a table of stuff and some of it needs to be processed with cron daily or every minute. On SQL table I would add column last_time_processed and save timestamp in it. The query would take rows ...
3
votes
3answers
85 views
Storing ~700 Tb in SQL Db
I am a newbie to Db's on a whole, and I came across a tutorial, wherein we needed to store ~700 Tb of data over a few years. It was mentioned that scaling SQL for such limits of data is not the best ...
7
votes
1answer
3k views
When to use multiple tables in DynamoDB?
The DyanmoDB best practices make it clear that:
You should maintain as few tables as possible in a DynamoDB application. Most well designed applications require only one table.
I find it amusing ...
2
votes
0answers
896 views
NoSql - Dynamo db - when do you need multiple tables?
I'm experienced in RDBMS, but new to NoSql. This aws dynamodb design advice says that "most well designed applications require only one table". I'm trying to wrap my head around that. I don't see a ...
3
votes
1answer
545 views
How can I reuse a table name after deletion (in DynamoDB)?
I am working through a tutorial which requires creating a DynamoDB table with a specific name. On my first pass at creating the table I did something out sync with the tutorial, so I deleted the table ...
1
vote
0answers
50 views
DynamoDB how to best perform != query?
Within the key-value, hash-table DynamoDB we can only query for partition keys and optionally for a sorting key.
My Question is: If a Table A has items with primary partition attribute aId and I've ...
0
votes
1answer
302 views
Insert into DynamoDB when data has different attributes
Is there any way dynamodb can handle dynamic attributes? Depending on the request, I need to store different web query parameters in the same table.
What I want to do is like this, if I make a java ...
0
votes
1answer
448 views
Porting a MySQL back-end to AWS DynamoDB
I'm setting up a back-end for a mobile application using Amazon Web Services. I'm fine with S3 and Lambda, but about using DynamoDB I have some problems. Before using AWS, I was developing the core of ...
1
vote
0answers
235 views
most efficient way to deal with real time gps data. S3 vs dynamoDB vs postgres
I have an application that is very write heavy. It saves GPS data every second. The way I handle it at the moment is to store the data locally and upload it to s3 every 5 minutes. The database (...
3
votes
1answer
235 views
How should I use DynamoDB table
I have a list of items. Each item is attached to several urls and each url has a score number. So I have something like this :
How should I organise this in dynamoDB? How should I format my Json file ...
2
votes
1answer
305 views
Best way to store a list of numbers where individual numbers can be deleted
I want to store a list of 50 or less nine digit numbers for each primary key in a DynamoDB. Usually I would be using a get request to retrieve the list for a specific primary key.
Sometimes I would ...
1
vote
1answer
5k views
NoSQL : Getting latest item from DynamoDB table
I'm implementing chat server currently, with dynamoDB.
Here is keys from ChatData table
Primary partition key : roomNo
Primary sort key : seq
Chat server, can created many instant rooms, ...
2
votes
1answer
365 views
Which AWS database services are designed for storing logging records like log4j or log4perl?
I have been using the file system for log4j and log4perl records and want to start using a database to store the information, especially to lookup records organized by pid. We are using MySQL RDS for ...
6
votes
2answers
13k views
DynamoDB - Multiple range keys
Is it possible to have multiple fields as range key?
Say I have a table where each row is uniquely identified by <A,B,C>
-------------------------------
A | B | C | D | E |
----...
0
votes
1answer
70 views
After modifying the throughput of a DynamoDB table, where can I see the new throughput value before it gets active?
After modifying the throughput of a table in DynamoDB, the "Modify Throughput" is greyed out:
Where can I see the new throughput value before it gets active? Sometimes it takes a while for a ...
4
votes
2answers
2k views
Why are some write requests throttled whereas the average consumed write capacity is below the provisioned write capacity?
I see the following graphs in one of my DynamoDB table:
Between 2/15 9:30 and 2/15 10:00 some write requests were throttled while the average consumed write capacity was below the provisioned write ...
0
votes
0answers
65 views
History of the provisioned write capacity in DynamoDB beyond the last two weeks
Is there any way to see the history of the provisioned write capacity for a DynamoDB table beyond the last two weeks? When I go to the Amazon AWS console, select a DynamoDB table and look at the ...
7
votes
4answers
22k views
Import CSV or JSON file into DynamoDB
I have 1000 CSV files. Each CSV file is between 1 and 500 MB and is formatted the same way (i.e. same column order). I have a header file for column headers, which match my DynamoDB table's column ...
0
votes
0answers
448 views
Column order in a DynamoDB table browsed through RazorSQL
I use RazorSQL to navigate in a DynamoDB database. What's the rationale behind the column order?
I am asking as the import tool uses the same order (which means if I import a CSV file it needs to be ...
3
votes
1answer
946 views
Best way to store, query and update 300M rows of data
I'm struggling to find a solution (preferably DBaaS) that I can rely on for storing and querying some 300M rows of data (roughly 100GB).
The data in question is pretty much numeric. There is also one ...
3
votes
2answers
3k views
Using AWS DynamoDB Geospatial index with Python
Amazon's AWS DynamoDB features Geospatial Indexing, which facilitates geo queries:
Query Support: Box queries return items that fall within a pair of geo
points that define a rectangle as ...
4
votes
2answers
8k views
DynamoDB: searching with primary key or range key, which way is faster?
To those familiar with DynamoDB, I'm trying to make a table where items only have 2 entries. For example, . Most of the time I'll be searching the user_id with a facebook_id on hand.
Amazon's ...
