A database system optimised for reporting, particularly in aggregate. Often, but not always implemented using a star schema.

learn more… | top users | synonyms

0
votes
2answers
110 views

Business Logic in Data Warehouse

my question is: Should business logic be stored in the data warehouse data store? Or should it only exist in the reporting applications? To give a more concrete example: In the CRM operational ...
2
votes
2answers
1k views

Datawarehouse - Dimension, Fact, or Degenerative dimension

I am building a warehouse for a billing system that bills a number of services/utilities on the same invoice, as such I am having real trouble conforming to a recognised design method for the ...
0
votes
2answers
169 views

Daily snapshot fact table

I have a list of products per costumer. Costumers can delete or add products to their list. I want to know in each day what is the list of products (and count) by costumer. My first approach is to ...
0
votes
1answer
13 views

New fact table or new dimension

I have a fact table with 2 dimensions: cohort_id date_id Each record contains the amount of active users from a specific cohort at a particular date - typical structure for the cohort analysis. ...
3
votes
2answers
70 views

Is it good or bad practice to have a fact table relate to the same dimension table multiple times?

I'm new to DW/BI, and this seems like a pretty basic question, but I can't seem to find a good answer. I have a fact table that would have more than one date associated with it, so I was thinking ...
1
vote
0answers
24 views

Best practices to segment people and attributes for advertising database

we have a database where we store people some attributes per person in the following tables: people (id, name, email, phone) people_attributes (id, person_id, attribute_name, attribute_value) ...
0
votes
0answers
145 views

Calculate sum of a whole column in IBM Datastage without any grouping

I have a table in oracle with salary as one of the columns. I want to calculate the sum of this salary column. It is pretty simple in SQL sum(salary) but I have made some dimensions and facts using ...
0
votes
1answer
30 views

How to keep the data warehouse synchronised with the source systems? [closed]

I'm a DBA who is responsible for exporting data from an ERP system for Business Intelligence purposes. The data from ERP system is being sent to the data warehouse and they are used in the ETL ...
1
vote
1answer
47 views

Name for intermediate aggregated data [closed]

We have raw data and aggregated data as well as sometimes multiple levels of aggregation between. Is there a name for the data in that intermediate "state" of aggregation? Just like how we have Real ...
1
vote
1answer
22 views

Table for actual values

I have a database where logging happens and is processed in a data-warehouse styled environment. This means there are staging cycles where the data comes in and then is processed. For a reporting ...
0
votes
1answer
199 views

Constellation Schema; Relationships between fact tables

What are acceptable types of depedendcies between facts in a multiple-fact schema? Conceptually talking, As you know a Multi-Dimensional Model may have multiple facts (like in a constellation ...
3
votes
4answers
1k views

How do you roll up header-level values on a fact table with line-item granularity?

From what I've read, the recommended granularity for a fact table based on an order header / line item structure is at the line item level. In the process, any additive values that apply only to the ...
0
votes
0answers
11 views

Is there value in storing audit fields in a fact table?

I've always stored at least two basic housekeeping fields in all of my dimension and fact tables: DateCreated and DateModified. However, this adds two fairly wide (eight bytes each, in MS SQL) ...
1
vote
1answer
426 views

creating a report on the mysql jasperReport server

I have mysql local database, in it I have sample data mart. I have installed jasperReport server to my computer. Just using this tool, I want connect to the local mysql database and just create a pdf ...
1
vote
1answer
127 views

Migrate Management Data Warehouse to a New Instance

Is there a defined procedure to follow for moving a SQL Server 2012 management data warehouse to a new server\instance? We intend to setup an MDW on a test sql server instance first, but will then ...
1
vote
4answers
430 views

Looking for ideas on maintaining data warehouse in close to real-time - ETL tools, etc

I have done a fair number of traditional data warehouse implementations where the loads were done in a batch-oriented manner, i.e. the data is refreshed nightly or, at most, every few hours. I now ...
5
votes
2answers
2k views

Compare two similar Postgres databases for differences

I occasionally download publicly available data sets in the form of Postgres dBs. These datasets are updated/modified/expanded over time by the repository host. Is there a Postgres command or ...
0
votes
2answers
117 views

How to prevent users other than DBAs from creating database links

To begin, please keep in mind that I am a very green DBA. I have done prior research and have not really found anything too promising, or maybe it just seems that way because I am still struggling in ...
1
vote
2answers
130 views

Dimension or Degenerate Dimension?

I am taking a course on data warehousing. Currently, I am reading through Ralph Kimball's Data Warehouse Toolkit. I understand that a degenerate dimension is a dimension key that is stored in a fact ...
0
votes
1answer
27 views

Data warehouse: Can I tell any details from Source System on delays or blocks? [closed]

I have a MS SQL Server 2012 machine that is acting as our data warehouse currently. We are having issues with long running jobs, and am curious if there is a way to get detailed historical logging on ...
0
votes
1answer
53 views

What to do when facts change frequently in a star schema for data warehouse?

I have a Quotation Management system that I built as a CRUD web app. Over time, I realized I need to improve it so that management can have their reports. Hence I studied the Kimball method of data ...
0
votes
0answers
43 views

Use trigger to update SCD2 End date and IsCurrentRow flag

I'm implementing a data warehouse that has type 2 slowly changing dimensions. When a change is made to a SCD type 2 column, I need to insert a new row into the dimension for that entity and also ...
1
vote
0answers
44 views

how many fact tables do I need given I want to build an OLAP for Quotation Line Item and Purchase Order Line Item report?

My client wants a report that looks something like this on a daily basis. +---------------+-------------------------+-----------------+---------------------+-------------+ | ProductNumber | ...
0
votes
1answer
75 views

How to change a web application that now needs to become OLTP and OLAP application?

Previously, I did a simple web application for an enterprise client using PHP and MySQL. After some time, it has grown to a point where I realized after talking with people here that I need to treat ...
2
votes
2answers
112 views

Have a separate database for data warehousing?

I have built a typical web application using PHP and MySQL for enterprise usage. The MySQL database is 3NF as much as possible. However, as time goes by, the requests for the data appear to be more ...
0
votes
0answers
49 views

Fact table linked to Slowly Changing Dimension

I'm struggling to understand the best way to model a particular scenario for a data warehouse. I have a Person dimension, and a Tenancy dimension. A person could be on 0, 1 or (rarely) multiple ...
1
vote
2answers
189 views

TSQL vs SSIS Lookup

I was trying to find some well performing Tsql equivalents for the SSIS Lookup component. Especially for Fact table loading. After few different query patterns the most obv performed the best: ...
5
votes
4answers
2k views

Datawarehouse bad practice?

In our Datawarehouse context, we have to update some record in fact tables inside our ETL. One thing we did is to create nonclustered indexes just before the heaviest queries, and drop them ...
1
vote
1answer
67 views

How to migrate data of to another sql server

Good day, I have a database running on a virtual machine hosted at our ISP. It is a fairly large database which has about 5GB of data inserted into it every day (network logs). It is partitioned ...
1
vote
1answer
84 views

Best way to document Dwh views [closed]

I works in a company that provide Dwh views as an API for external Customers (We use MS-SQL 2008 & 2012). every once in a while we release new views and updates the existing views. We have ...
0
votes
0answers
17 views

What known strategies, if any, can I use to validate a Slowly Changing Dimension?

I have a customer dimension in our data warehouse (SSAS 2014 Multidimensional). It is set up as a Type II SCD, with just Start and End Date fields to track changes. (null end date = current). As our ...
1
vote
3answers
59 views

Data Warehouse measures without a corresponding dimension

I have an operations database that contains this table: salesQuality salesPrice salesCategory According to my business requirements, the salesQality and salesPrice are measures. However, ...
0
votes
0answers
68 views

Data warehousing: data transfer process too slow with larger batches

I have two primary instances of SQL Server, one for OLTP and one for reporting. The data warehouse for reporting is basically a Type 2 SCD: every table has DWDateStart and DWDateEnd columns and the ...
0
votes
0answers
47 views

Physical Table being used a Temp Table in a warehosue. Any advantage?

As I stated in previous posts I've inherited a warehouse based on SQL Server framework. In my continuous review of existing components and the practices adopted by the predecessors I found something ...
0
votes
0answers
31 views

Accounting - Dimention table in mysql

I am designing a accounting and mini erp system. I use a date dimension table to track all date related data. In oracle we can have many schema for a database. so we could create each schema for ...
0
votes
2answers
525 views

How to choose suitable naming convention for Dimensional Table Column in a Data Mart?

I have done a lot of reading on naming columns for use in a data mart / data warehouse, as well as for general programming usage. For example, if I had a business branch in a normal application I ...
10
votes
2answers
685 views

Clustered columnstore indexes and foreign keys

I am performance tuning a data warehouse using indexes. I am fairly new to SQL Server 2014.Microsoft describes the following: "We view the clustered columnstore index as the standard for storing ...
0
votes
0answers
47 views

Required Information to start oracle warehouse builder

I am using windows 8 64 bit . I want to install Oracle Warehouse Builder on my system. I have installed Oracle 11g and come to know that Warehouse Builder is already a part of it. But when I start ...
1
vote
2answers
276 views

avoiding unique key collisions across tables

This might be related to the idea of data warehousing, but i'm not sure, though it is extreme theory. We have a table where records get written to first, let's call it tbl_recording which looks like: ...
0
votes
0answers
91 views

How alter on infobright (BRIGHTHOUSE storage engine) actually works

I have been using infobright-3.4.1 (5.1.40) for data warehousing. I know it is outdated version but there no plan to upgrade the version currently. Even though infobright is build on mysql, the way it ...
1
vote
3answers
619 views

Purpose of Data Warehousing?

I have been reading up on Data Warehousing and its purpose. The main purpose seems to be to track historical data and whatever changes may have occurred over time. The DW book I am reading gives a ...
1
vote
1answer
39 views

MySQL data to Postgres every X time

Our team (Uni students) have a project that we are updating. Old project team has a Live MySQL database. We want to make a archive/warehouse from it in PostgreSQL. My question is: How can we import ...
1
vote
2answers
30 views

Dimension for Product Properties based on Product Type - Sparse Dimension?

I am creating dimension of product properties for sales facts. Property of product depend of product type. For example: - Type = smartphone. Properties = model, OS, size - Type = book. Properties = ...
0
votes
1answer
13 views

Conformed Fields or Snowflake? - Shop and Customer Location

I have shop dimension and customer dimension which both has location information. Should I create location dimension to correlate shop location and customer location? I believe this one is called ...
7
votes
2answers
2k views

Alternative to EAV for dynamic fields in a star schema data warehouse

I need to support dynamic fields and values in a big datawarehouse for storing API requests log, my user case is that I need to store all API requests query string and able to perform query against ...
8
votes
3answers
736 views

Updating a big replicated Dimension (SQL Server PDW)

We use a SQL Server PDW appliance for our data warehouse. One of the tables in our warehouse is a replicated table with about 20 million rows. As part of our ETL process we need to expire old records ...
0
votes
0answers
110 views

Problem in Incorporating filters into Data Warehouse design

While implementing a data warehouse (proof of concept) I have a requirement to incorporate a user level save-able filter on dimensions. The requirement is a proof of concept so I have the liberty to ...
2
votes
0answers
99 views

SQL Server, Mount Points and File Groups design [closed]

I am looking for some advice on a data warehouse we are building. Specifically around SQL Server, mount points and file groups. We have two design options for how mount points and files groups should ...
7
votes
2answers
4k views

ETL: extracting from 200 tables - SSIS data flow or custom T-SQL?

Based on my analysis, a complete dimensional model for our data warehouse will require extraction from over 200 source tables. Some of these tables will be extracted as part of an incremental load and ...
1
vote
1answer
35 views

Separating system databases from MDW SQL Server 2008 R2

We have the Management Datawarehouse feature configure on two of our SQL Servers. Both point to the same central database and upload their results to it. Everything works fine with the built in ...