Questions tagged [architecture]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
0answers
34 views

Does Log File contain both committed and uncommitted transactions?

My question is related to SQL Server architecture. Mainly log file. In the picture below it says that when transaction is committed, log record in LOG CACHE will be moved to Log file. Does it mean ...
0
votes
3answers
31 views

Database design for monthly leaderboards

I have a system where users can make predictions on events. There are about two events a week. When the event ends the system scores all the predictions and updates this in the database. Here is an ...
1
vote
1answer
30 views

How to query for address “predictions” while applying constraints

Let's say I have this simplified database scheme. The scheme consists of three tables, street, city and zipcode that all have a many-to-many relationship to each other. What I want to do is a ...
-3
votes
1answer
29 views

Which database to use? Storing one string every second for several days [closed]

I would like to observe some cryptocurrency prices and for that, I want to store a string, everey second in a database for ca. 3 days. The string will vary in length, it will be 2500 characters max. (...
0
votes
0answers
55 views

Data integrity in one-to-many distributed architecture

We are a retail shop that has a central data repository which collects data continuously from geographically distributed 1500 odd servers (each store has one SQL Server instance). Like a one to many ...
2
votes
1answer
95 views

Horizontal and Vertical Fragmentation on Distributed Database

My Architecture: I need to build a database with SQL Server, where the data from each server is distributed to the other server. How can I achieve this kind of architecture? How do I maintain ...
0
votes
0answers
7 views

SolR data location after HDFS indexing

I have a requirement to evaluate a Big Data solution based on SolR but I have some questions unanswered after my search. The solution need to provide access and search capabilities to structural data ...
1
vote
0answers
68 views

Performance benefits using gRPC to communicate with Postgresql from Web? [closed]

Standard REST server is rather simple to understand and get up and running. But a gRPC server that do the same thing seems to be more complicated. Are there many that uses the concept web > gRPC > ...
1
vote
1answer
49 views

Architecture design for a large number of db records upgrade

Honestly struggled a bit with the title of the question. Here is the deal. I have a specific set of db operations on various tables across an db. In a simpler sense it's kind of a migration, that I ...
2
votes
0answers
110 views

PostgreSQL: Having many instances of one application should I go with database per instance or schema per instance? [closed]

I am not asking for an opinion here. I need an answer supported by arguments. We have an web-application that will be installed multiple times on one server (one instance per customer). How should I ...
1
vote
1answer
42 views

Reducing the number of tables used - mySQL

I have a table for tax implementation in my application, but I am not sure the design I have done for the table. Can someone review it? val_taxes is the table which has all types of tax listed in ...
0
votes
0answers
29 views

Advice Regarding Database Design

I am working on a poory designed application, so please do not judge me by the work i have been posed. I have servers table whose data can be visualised as and attributes table which can be ...
3
votes
1answer
209 views

Should SSIS packages and SQL database be on same server?

I'm a bit new to SSIS. I have a lot of 'dev', building, query, tuning performance on SQL Server but am not the master of admin/ overall performance modeling. So here's my question --- Should SSIS ...
1
vote
0answers
272 views

Interesting Database Designs for Product Catalogue including a Recursive Approach

I am doing some work for a client and they are creating a database of products of which I need to consume product data when it's created and updated to store in a third party service and then present ...
2
votes
2answers
141 views

Difference between OLTP and Inmon Data Warehouse

What is the general difference between OLTP and Inmon-style Datawarehouse? It seems like they are the same. OLTP just copies all the tables into a Read-Only Datawarehouse DB. I know what a Kimball ...
1
vote
0answers
50 views

Coffee shop static tag/attribute querying (satisfying AND & OR condition groups) - Relational DB/DBMS or NoSQL?

Let's say you are storing information about coffee shops, and you want to assign an arbitrary number/assortment of static tags/labels to each cafe which act like attributes (i.e., the cafe either has ...
0
votes
1answer
101 views

Looking for an efficient way to build some kind of “FIFO” table

I need to store measured data on a daily basis for a given period in the future, lets say 7 days. The current day should be always day 1. Basic Example: | id | day | value | |----|--------|-------|...
1
vote
0answers
47 views

A flexible and robust schema for storing precomputed values/metrics

Background I'm dealing with a table that contains a lot of historical data. What I am doing is generating a bunch of metrics based on different combinations of column values and date periods (e.g. ...
2
votes
2answers
66 views

Splitting the servers

We have a Windows 2012 VM running SQL Server 2012. There are around 20 databases with a total size of 5.83 TBs. There is 64GB of RAM and 16 logical processors on the box. The server is extremely busy ...
1
vote
1answer
66 views

Redundant data or UNION

I couldn't come up with better title. I'm preparing data structure for GDPR and I ran into one problem. I have two types of legal basis for storing the personal data: Law User specific (consent) ...
10
votes
1answer
270 views

Optimizing a 'latest' query in Postgres on 20M rows

My table looks as follows: Column | Type | -----------------------+-------------------+ id | integer | source_id | integer ...
1
vote
0answers
250 views

Designing a PostgreSQL database for high-volume updates

I am designing a database for a system that has to handle lots of writes operations (99%+ are updates, sometimes inserts) but at all times it has to provide fast reads. At the moment selects take a ...
4
votes
1answer
127 views

Split Brain Administrators

I have been appointed the DBA for our organization. I have been asked by senior officials to allow the two divisions of IT to have full control of their databases. They have asked for the following ...
0
votes
2answers
57 views

Database design for payment feature system

I am building a system where visitors can buy modules from my website. For now I only have 3 available, but of course this number will keep growing. In order to facilitate this in my MySQL database ...
0
votes
1answer
39 views

Efficient many to two relationship

I'm building out a database with a users table, and I want to store the mutual (Facebook) friends between every set of two users in the database. Doing this in a normalized, efficient way seems tricky....
0
votes
1answer
188 views

Archiving strategy

I have an instance with only one database which contains 4 years of data (400 gigas). I name this instance inst_live I want to implement this following archiving strategy: create an archive instance (...
0
votes
1answer
322 views

Data Warehouse: Staging Area, DWH databases and ETL tool on one server? [closed]

I am thinking about a DWH server layout and I'd like to ask you if you can spot any downsides to this layout. The basic idea is to have Staging Area & Data Warehouse DBs and the ETL Tool for the ...
4
votes
1answer
61 views

Approach to Handling Errors/DataCorrections in Aggregated Data

We're in the process of building a vNext Data/Reporting Platform for capturing Web & Sales Traffic. At a very high level we're capturing Impressions, Clicks & Sales Data which then needs to ...
6
votes
1answer
569 views

Entity-relationship diagrams and application program functionalities

It seems that the core functionalities of an application program I'm working on are nothing but associative entities. Hence one-to-many relations sort of produce "metadata" that will only feed (one ...
0
votes
1answer
1k views

What should be architecture of multi client web application?

My question is not related to a specific technology rather it's about design methodology that should be chosen. My company is about to create a web application whose users will be corporate companies. ...
0
votes
2answers
2k views

Best way to store deleted rows

I have a table with operations that can be deleted by users. What happens, is that I want to store deleted rows for some time, to serve as recover in case any client regrets the deletion. One of the ...
1
vote
0answers
51 views

Logical data independence

I have a basic doubt about logical data independence. I read that in logical independence, we can remove attributes from relation without affecting external schema. How can the removal of attribute ...
1
vote
1answer
27 views

MS-Access: How do I go about building a database with inconsistent data sources?

I'm working on building a database to aggregate various data sources and feed a set of Tableau dashboards. The data is all employee data, the problem is, I only have one file of seven with a unique ...
0
votes
1answer
182 views

Recursive Seller Account with Balance

I need to build a database for managing Short Messaging Service (SMS). In this I have 2 types of users Reseller Must have starting SMS balance for example: 1,000 - credit table He can sell ...
1
vote
2answers
87 views

Database Roles Security: In SQL Server architecture where does permissions are evaluated in RE or SE or Access methods

I got a question if i create a login and database user for a database named TEST, and i have given permissions to user as db_datareader only. 1) Where does this permission evaluated when a user ...
0
votes
1answer
194 views

Selective synchronization between distributed clusters

What's the best practice for the following scenario: I've an embeded device with a single, lightweight database; a powerful server with a cluster; a cluster in the cloud. I'd like to synchronize the ...
1
vote
3answers
2k views

Primary and secondary replicas on same server

We're considering different options for HA/DR with SQL Server 2016. AlwaysOn Availability Groups are obviously an option. I understand we can read from secondary replicas, unlike DB mirroring for ...
0
votes
1answer
50 views

Model data with many to many and overrides

I'm having some trouble modeling the database for this particular scenario in Postgres: We have a set of toys that contain several pieces. Each piece is associated with one or more materials. All of ...
2
votes
2answers
81 views

Optimize architecture for SQL Server projects [closed]

I often find myself hacking together multiple .sql files for a project and calling them one after the other through Task Scheduler. Everything I know about SQL is self-taught, so I don't know anything ...
2
votes
2answers
4k views

SQL Server 2016 Multiple Availability Groups and instances

So we are getting ready to make a major architecture shift and I get to be on the hook for it, yay! Currently we have 22 separate availability groups each with their own windows cluster across 44 ...
0
votes
1answer
72 views

Database architecture for interactions between users (8B rows, 1TB of data)

I'm saving an interactions table between two users. I have two interaction types, and each interaction can happen more than once. The easiest reference would be Facebook Likes and comments on posts: ...
2
votes
1answer
820 views

What is a database mission-statement?

What exactly is a database mission-statement? My question was prompted after submitting an academic-assignment requiring a "mission-statement" for ERD-modeling. I've yet to encounter this ...
12
votes
4answers
5k views

Drives vs. Mount Points?

The previous Senior DBA set up mount points for all of our drives across every SQL Server throughout the company. The new Senior DBA is horrified by mount points wants to change our standard (mainly, ...
1
vote
1answer
123 views

Permission for business logic layer & application

I'm very new to db development and currently working on my first production app. I learned that I would need a business logic layer (BLL) to authenticate and authorize users (for example John can only ...
0
votes
1answer
116 views

SQL Server grant to multiple domains

I am working in a joint venture of four different contractors doing one big project. Many of the application will have to use the different ADFS servers each of the four companies have. Some are ...
2
votes
2answers
3k views

Sync two databases on different servers

I can't pick the right solution for my below requirement. Can you people please advise? We have two SQL Server 2012 database servers: First one is in Texas (USA). Our client will use this for UAT. ...
1
vote
1answer
438 views

Automatic Failover or Database Mirroring?

We have a software backed with database. We want to keep database at a remote location and have it all the time available. For this task, a 5 year old project experience came into my mind. I remember, ...
-1
votes
1answer
37 views

Maintaining quantities of products in database [closed]

I am building one online bakery store. Here I will have to manage products like cakes and pastries. A half kg cake could have price of 250 where as 1 kg cake will have price of 450. That is, it doesn'...
4
votes
1answer
165 views

Numerical data with lots of NULLs: 6NF or document database?

I have a source of numerical data mostly comprised of sensor readings, physical quantities and flags. Each associated with a datetime. | id | timetag | sensor1 | sensor2 ...
1
vote
1answer
4k views

Changing varchar(max) to varchar(255) requires rebuilding table

Our developers (prior to me being DBA) set the data type for a field to VARCHAR(MAX) when in reality it only needs to be VARCHAR(255). This wasn't discovered until after our table had grown to over ...