A database system optimised for reporting, particularly in aggregate. Often, but not always implemented using a star schema.

learn more… | top users | synonyms

1
vote
3answers
256 views

Looking for ideas on maintaining data warehouse in close to real-time - ETL tools, etc

I have done a fair number of traditional data warehouse implementations where the loads were done in a batch-oriented manner, i.e. the data is refreshed nightly or, at most, every few hours. I now ...
1
vote
1answer
951 views

Fastest mechanism to move data between tables in SQL server

We are building a data warehouse. For some of our target tables, the only way to manage the process correctly is to re-transform all the data every time something changes. Currently we do this using ...
1
vote
1answer
939 views

Datawarehouse - Dimension, Fact, or Degenerative dimension

I am building a warehouse for a billing system that bills a number of services/utilities on the same invoice, as such I am having real trouble conforming to a recognised design method for the ...
1
vote
1answer
260 views

Open source tools to manage Data Quality [closed]

Are there open source (or commercial) tools that can report data quality issues in a data warehouse using the Kimball star schema model? It doesn't have to be the silver bullet. I'm just looking for ...
1
vote
2answers
21 views

Dimension for Product Properties based on Product Type - Sparse Dimension?

I am creating dimension of product properties for sales facts. Property of product depend of product type. For example: - Type = smartphone. Properties = model, OS, size - Type = book. Properties = ...
1
vote
0answers
140 views

500GB Data Warehouse - how to split it into FileGroups?

OK, so I have: 500 GB DW 5 GB in smaller DBs 220 GB TempDB 350 GB in Log files. My machine is Fujitsu Primergy 64 cores (with HT) and 192 GB RAM. I have several IO locations: 540 GB in-server ...
1
vote
2answers
60 views

Dimension or Degenerate Dimension?

I am taking a course on data warehousing. Currently, I am reading through Ralph Kimball's Data Warehouse Toolkit. I understand that a degenerate dimension is a dimension key that is stored in a fact ...
1
vote
1answer
93 views

Migrate Management Data Warehouse to a New Instance

Is there a defined procedure to follow for moving a SQL Server 2012 management data warehouse to a new server\instance? We intend to setup an MDW on a test sql server instance first, but will then ...
1
vote
0answers
109 views

Running materialized view refresh in parallel

I have a large materialized view that is refreshed periodically (complete refresh) and I would like to do it in parallel. I can already run the query part in parallel but the problem is (much slower) ...
1
vote
0answers
91 views

What type of fact table / loading solution for a reservation system?

I am designing a Data Warehouse with SQL Server 2012 and SSIS. The source system handles hotel reservations. The reservations are split between two tables, header and header line item. The ...
1
vote
1answer
360 views

creating a report on the mysql jasperReport server

I have mysql local database, in it I have sample data mart. I have installed jasperReport server to my computer. Just using this tool, I want connect to the local mysql database and just create a pdf ...
1
vote
0answers
512 views

sql server 2008 execution plan different on two production servers [closed]

We have two servers running SQL server 2008 R2, with identical databases, where we implemented a datawarehousing solution. The cube processing operation was taking a VERY long time in one of the ...
1
vote
0answers
34 views

Monoblock, Multiblock queries?

What exactly mean the terms monoblock / multiblock queries in data warehouses when talking about materialized views? Does a monoblock query just use one data source (a normal table) while a multiblock ...
1
vote
0answers
626 views

An advice to design a fact table with a scd as a dimension

I have a problem of conception and I would like to get your ideas on how I'll be able to do what I am aiming. My goal is to create a datawarehouse, with three dimensions and one fact table so far. ...
0
votes
2answers
2k views

Possible career paths for Oracle Certified Associate (OCA) [closed]

In order to be confident in databases as a entry level job candidate, I completed the OCA certification. Now I want to know what career paths follow this. Can one go into data-mining, BI, or ...
0
votes
2answers
1k views

Can a surrogate key and a primary key be in the same table?

For example we have: Surrogate key: ABC123 Primary key: 1 Name: James Is this legit in a Data Warehouse table?
0
votes
2answers
192 views

Teradata performance statistics

I need some statistics regarding the performance of Teradata, something like with a given hardware, given nodes and given AMPs - a table which has thousands of rows can be read in 't' secs. I need ...
0
votes
1answer
263 views

What are good resources on data modelling for business intelligence? [closed]

We are a SaaS startup offering purchase & procurement solutions. The data model for operational transactions has been created (relational DB). We also want to offer analytics on those transactions ...
0
votes
2answers
156 views

Query to return fields of distinct values per key

In the process of building a data warehouse we are creating some aggregation tables for a reporting engine. We would like to build a single aggregation table from the fact table that can exist as list ...
0
votes
2answers
321 views

SQL Server 2005 replication for a data warehouse

We are trying to implement some kind of Data Warehouse at my current employer. Most of our data is in a SQL Server 2005, but we might also integrate some Access databases and some databases in a SQL ...
0
votes
1answer
551 views

Benefits of using Staging Database while designing Data Warehouse [closed]

I am in process of designing a Data Warehouse Architecture. While exploring various options to Extract data from Production and putting into Data Warehouse, I came across many articles which mainly ...
0
votes
1answer
45 views

How Many Rows om Int and Big Int [closed]

How many rows does datatype int and big int retrieve in their table when you work with fact table in SQL server?
0
votes
1answer
137 views

Dimensional model or Relational model for data warehouse? [closed]

I have a pretty trivial questions in data warehouse, I know we use Dimensional data model to construct data marts and use Relational data model in staging area. What data model technique we use to ...
0
votes
1answer
4k views

SSIS convert DT_WSTR to date

I'm new to SSIS trying to covert data types. I'm pulling data from Google Analytics and loading data into a SQL 2008 database. The date column from Google analytics appears as "DT_WSTR" and the values ...
0
votes
1answer
44 views

Oracle scheduler chain priority in data warehouse applications

The scenario is as follows: We have a data warehouse type application that relies on the Oracle job scheduler and a Chain. This chain is responsible for generating materialized views (caches) that ...
0
votes
1answer
70 views

TSQL vs SSIS Lookup

I was trying to find some well performing Tsql equivalents for the SSIS Lookup component. Especially for Fact table loading. After few different query patterns the most obv performed the best: ...
0
votes
1answer
10 views

Conformed Fields or Snowflake? - Shop and Customer Location

I have shop dimension and customer dimension which both has location information. Should I create location dimension to correlate shop location and customer location? I believe this one is called ...
0
votes
2answers
137 views

How to choose suitable naming convention for Dimensional Table Column in a Data Mart?

I have done a lot of reading on naming columns for use in a data mart / data warehouse, as well as for general programming usage. For example, if I had a business branch in a normal application I ...
0
votes
1answer
59 views

Override Dimension Column Value

I have a dimension with a column called 'Type'. There is a list of default 'Types' in this dimension. However, this 'Type' column can be overriden. i.e. each user can replace the default value with ...
0
votes
1answer
65 views

Beginning Data Warehouse Design [closed]

I am beginning to develop a Data Warehouse. The data does not already exist in a relational database. Instead it will be sourced from various 3rd party vendors. The data requirements have been drawn ...
0
votes
1answer
319 views

Data Warehouse - Slowly Changing Dimensions with Many to Many Relationships

As an example, let's say I have a fact table with two dimensions and one measure FactMoney table ProjectKey int PersonKey int CashAmount money The two dimensions are defined like this: ...
0
votes
1answer
222 views

How to simplify schema for multi database / hundreds of millions of rows data set

We currently have a MySQL data set that was started about 10 years ago that aggregates a log of data, and accumulates millions of rows each month. The people that developed our system started ...
0
votes
1answer
210 views

Using N-Tier in Business Intelligence

I have read that you also can apply N-Tier for Businesss Intelligence based on these criteria: *Presentation *Functional logic *Data What is your experience when you are using N-Tier? // ...
0
votes
0answers
33 views

Data warehousing: data transfer process too slow with larger batches

I have two primary instances of SQL Server, one for OLTP and one for reporting. The data warehouse for reporting is basically a Type 2 SCD: every table has DWDateStart and DWDateEnd columns and the ...
0
votes
0answers
22 views

what is the difference between data migration and ETL?

What is the basic difference between ETL and data migration? Are not both terms are used for the same purpose ? Data migration includes extractions, transformations of data and Loading to target ...
0
votes
0answers
38 views

Physical Table being used a Temp Table in a warehosue. Any advantage?

As I stated in previous posts I've inherited a warehouse based on SQL Server framework. In my continuous review of existing components and the practices adopted by the predecessors I found something ...
0
votes
0answers
16 views

Accounting - Dimention table in mysql

I am designing a accounting and mini erp system. I use a date dimension table to track all date related data. In oracle we can have many schema for a database. so we could create each schema for ...
0
votes
0answers
19 views

Required Information to start oracle warehouse builder

I am using windows 8 64 bit . I want to install Oracle Warehouse Builder on my system. I have installed Oracle 11g and come to know that Warehouse Builder is already a part of it. But when I start ...
0
votes
0answers
36 views

How alter on infobright (BRIGHTHOUSE storage engine) actually works

I have been using infobright-3.4.1 (5.1.40) for data warehousing. I know it is outdated version but there no plan to upgrade the version currently. Even though infobright is build on mysql, the way it ...
0
votes
0answers
58 views

Calculate sum of a whole column in IBM Datastage without any grouping

I have a table in oracle with salary as one of the columns. I want to calculate the sum of this salary column. It is pretty simple in SQL sum(salary) but I have made some dimensions and facts using ...
0
votes
0answers
69 views

Problem in Incorporating filters into Data Warehouse design

While implementing a data warehouse (proof of concept) I have a requirement to incorporate a user level save-able filter on dimensions. The requirement is a proof of concept so I have the liberty to ...
0
votes
1answer
54 views

Business Logic in Data Warehouse

my question is: Should business logic be stored in the data warehouse data store? Or should it only exist in the reporting applications? To give a more concrete example: In the CRM operational ...
0
votes
0answers
30 views

Should I use conventional or computed columns for trivial metrics in a fact table?

A fact table can often have measures which are basically trivial. For example Orders.NumOrders will probably be "1" for every real record (synthetic records representing "no order" may populate this ...
0
votes
1answer
146 views

Constellation Schema; Relationships between fact tables

What are acceptable types of depedendcies between facts in a multiple-fact schema? Conceptually talking, As you know a Multi-Dimensional Model may have multiple facts (like in a constellation ...
0
votes
0answers
17 views

How to ensure on Oracle RAC One Node that the OWB control service is started on the active node after a planned relocate or unexpected fail-over? [duplicate]

I followed the document 'How To Install a Warehouse Builder 11g Repository on a RAC' (Doc ID 1571166.1) to set up the OWB repository (11.2.0.4) on my Oracle RAC One Node system. Because it's a RAC One ...
0
votes
0answers
27 views

Does data guard support Oracle Warehouse Builder?

Does data guard support Oracle Warehouse Builder (both 11.2.0.4)? If not, what is the procedure to setup/configure my OWB project (repository, workspace, control center service...) on the standby ...
0
votes
0answers
35 views

When there is a Type 1 and type 2 SCD in a dimension table, how are updates to the type 1 column handled after the type 2 column is updated?

Eg: ID Type1SCD Type2SCD FromDate todate 1000 100 ABC 01-JUL-2014 NULL Now, Type2SCD is updated ID Type1SCD Type2SCD FromDate todate 1000 100 ABC 01-JUL-2014 12-JUL-2014 ...
0
votes
1answer
590 views

Compare two similar Postgres databases for differences

I occasionally download publicly available data sets in the form of Postgres dBs. These datasets are updated/modified/expanded over time by the repository host. Is there a Postgres command or ...
0
votes
1answer
101 views

apply cdc to existing data warehouse

I'm building an education data warehouse. I have various dimensions that i would like to track changes to i.e. DimStudent, DimClass, DimCollege, DimExamPaper etc. etc. My solution currently drops ...
0
votes
0answers
84 views

Is there better way to design SQL tables

I need to design a quick application for small warehouse. I just want to check if there is a better design approach. I am using polymorphic associations for comments tables. Business Rules If ...