Questions tagged [data-warehouse]
A database system optimised for reporting, particularly in aggregate. Often, but not always implemented using a star schema.
23
questions
14
votes
2
answers
12k
views
ETL: extracting from 200 tables - SSIS data flow or custom T-SQL?
Based on my analysis, a complete dimensional model for our data warehouse will require extraction from over 200 source tables. Some of these tables will be extracted as part of an incremental load and ...
28
votes
4
answers
88k
views
Compare two similar Postgres databases for differences [closed]
I occasionally download publicly available data sets in the form of Postgres dBs. These datasets are updated/modified/expanded over time by the repository host.
Is there a Postgres command or ...
2
votes
2
answers
3k
views
Best way to capture historical changes between levels in a dimensional hierarchy
What is the cleanest way to capture changes between levels in a dimensional hierarchy?
I have the dimensional hierarchy [Area] > [Region] > [Location], where Area is the parent to Region and Region ...
28
votes
5
answers
20k
views
What are some ways to implement a many-to-many relationship in a data warehouse?
The dominant topologies of Data Warehouse modelling (Star, Snowflake) are designed with one-to-many relationships in mind. Query readability, performance, and structure degrades severely when faced ...
17
votes
2
answers
4k
views
Open Source Business Intelligence/DWH solutions [closed]
I wonder that this question hasn't already been asked. Google only has very few results for me that don't show a high quality tool
What are some Open Source (also free is ok) solutions for Data ...
14
votes
2
answers
9k
views
Handling time zones in data mart/warehouse
We are starting to design the building blocks of a data mart/warehouse and we need to be able to support all time zones (our clients are from all over the world). From reading discussions online (and ...
13
votes
2
answers
10k
views
Alternative to EAV for dynamic fields in a star schema data warehouse
I need to support dynamic fields and values in a big datawarehouse for storing API requests log, my user case is that I need to store all API requests query string and able to perform query against ...
10
votes
2
answers
4k
views
Data Warehouse design for reporting against data for many time zones
We are trying to optimize a data warehouse design that will support reporting against data for many time zones. For example, we might have a report for a month's worth of activity (millions of rows) ...
10
votes
4
answers
2k
views
Where should one put indexes in a time dimension table?
After reading the Questions and Answers from this website about indexes, a question came to my mind.
What if, one is using a time dimension table with the lower level of granularity being the day. ...
8
votes
3
answers
26k
views
Data warehouse server. How do you calculate RAM/CPU specifications?
I am trying to write a spec for a data warehouse server for our planned data warehouse upgrade.
As we run virtual servers on VMWare hosts we have the ability to add or remove resources as necessary. ...
8
votes
2
answers
18k
views
Best approach for populating date dimension table
I am looking to populate a date dimension table in a SQL Server 2008 database.
The fields in the table are as follows:
[DateId] INT IDENTITY(1,1) PRIMARY KEY
[DateTime] ...
8
votes
2
answers
9k
views
Sql Server 2012 data warehousing and different versions
With Sql Server 2012 there are 3 flagship editions: Enterprise Edition, Business Intelligence, Standard.
The full comparison between the three: http://www.microsoft.com/sqlserver/en/us/future-...
8
votes
1
answer
750
views
Dimension and Fact for same entities?
I'm rather new at DW design and am working on a DW to model some IT infrastructure.
The major problem/question at this point is how to model drive information.
We will be collecting aggregate data ...
6
votes
0
answers
255
views
Using the Schema Generation Wizard to regenerate a previously-generated schema
Lately, I've been trying to clean up a group of projects that my company received from an outside contractor. Among them is an SSAS cube, with an associated data warehouse.
The contractors generated ...
5
votes
2
answers
4k
views
Schema for Financial Database
My company is starting a new initiative aimed at building a financial database from scratch.
We would be using it in these ways:
Time series analysis of: a company's financial data (ex: IBM's total ...
3
votes
2
answers
3k
views
Have a separate database for data warehousing?
I have built a typical web application using PHP and MySQL for enterprise usage.
The MySQL database is 3NF as much as possible.
However, as time goes by, the requests for the data appear to be more ...
3
votes
1
answer
1k
views
Dimensional Modeling of a Loan Approval Process and Fact Grain(s)
Context:
I'm modeling for a lending company and I'm modeling our loan approval process. I have some basic dimensions relative to our business figured out:
Time(day)
Account
Opportunity
...
3
votes
2
answers
1k
views
Always On Availability Groups as a Secondary Read Only Database [closed]
I am working on setting up a secondary copy of our prod DB for Data Warehousing and even something we can possibly use to offload other processes and reporting on. Basically just a read only copy of ...
2
votes
1
answer
2k
views
Update OLAP Cube data
We are using OLAP in our project and we are facing a scenario where we need to update the cube with real time data on daily basis.
I need some suggestions about an optimal way for updating the data ...
1
vote
2
answers
2k
views
Design star schema for relatonal database
I'm a newbie to data warehousing and I've been reading articles and watching videos on the principles but I'm a bit confused as to how I would take the design below and convert it into a star schema.
...
1
vote
1
answer
4k
views
Data Warehouse Kimball Customer and Customer Address Dimensions
I have a Customer Table and Multiple Customer Addresses. A customer can have multiple addresses: home, work, vacation,etc.
In Kimball data warehouse, would I utilize a bridge table to go between ...
1
vote
1
answer
628
views
How to change a web application that now needs to become OLTP and OLAP application?
Previously, I did a simple web application for an enterprise client using PHP and MySQL.
After some time, it has grown to a point where I realized after talking with people here that I need to treat ...
0
votes
1
answer
3k
views
Benefits of using Staging Database while designing Data Warehouse [closed]
I am in process of designing a Data Warehouse Architecture.
While exploring various options to Extract data from Production and putting into Data Warehouse, I came across many articles which mainly ...