A database system optimised for reporting, particularly in aggregate. Often, but not always implemented using a star schema.
-1
votes
1answer
28 views
data warehouse construction from mdf and ldf file via etl
I have sample data warehouse stored in the form of mdf and ldf format. I want to use any ETL tool to extract data and then load datawarehouse on the specified database with username, password and ...
3
votes
0answers
102 views
Where and how to store my weird datamart
I could really use some help here.
Here's my situation.
I'm building a datamart in SQL Server 2005, which will furnish a single report (for now). We have 26 clients (medical organizations) that ...
0
votes
2answers
48 views
Can a surrogate key and a primary key be in the same table?
For example we have:
Surrogate key: ABC123
Primary key: 1
Name: James
Is this legit in a Data Warehouse table?
0
votes
1answer
44 views
SSIS convert DT_WSTR to date
I'm new to SSIS trying to covert data types. I'm pulling data from Google Analytics and loading data into a SQL 2008 database. The date column from Google analytics appears as "DT_WSTR" and the values ...
-3
votes
0answers
44 views
how to build simple data warehouse [closed]
For training purpose, I am trying to build a sample data warehouse on Ubuntu 12.04 or Windows, which one is possible I will use it. However, I couldnot find a guide in the google. Thus, how can I ...
0
votes
0answers
30 views
How to handle “many columns” in OLAP RDBMS
I have a fact that has around 1K different numerical attributes (i.e. columns). I would like to store this in to a column-oriented DB and perform cube analysis on it.
I tried to design a star ...
0
votes
2answers
36 views
Teradata performance statistics
I need some statistics regarding the performance of Teradata, something like with a given hardware, given nodes and given AMPs - a table which has thousands of rows can be read in 't' secs.
I need ...
6
votes
3answers
165 views
Header and line item data source mismatch
I'm working with a star schema for a data warehouse and I am running into a problem with header and line items from different data sources.
CREATE TABLE DataSourceAHeader
(
OrderId INT NOT NULL
...
1
vote
2answers
86 views
sql server 2008 execution plan different on two production servers
We have two servers running SQL server 2008 R2, with identical databases, where we implemented a datawarehousing solution. The cube processing operation was taking a VERY long time in one of the ...
3
votes
0answers
115 views
Is SQL Server data compression categorically good for read-only databases?
Some literature on SQL Server data compression I read state that the write cost increases to about four times what would normally be required. It also seems to imply that this is the primary downside ...
0
votes
0answers
32 views
Suggested Database and Web Application Framework for Enterprise, “Big-Data” App? [closed]
I have a web application that I have been developing for a small group within my company over the past few years, using Pipeline Pilot (plus jQuery and Python scripting) for web development and ...
3
votes
1answer
68 views
Should I snowflake or duplicate it across my facts?
I'm building up a data warehouse to be used by SSAS to create cubes on, and I'm debating between two possible schemas.
In my warehouse, I've got two different fact tables that tracking daily changes ...
0
votes
0answers
24 views
SAP Business Warehouse 0APO_LOCNO_ATTR datasource extraction
We are currently importing 0APO_LOCNO_ATTR from several different source systems. I want to be able to import the field PRECISID into BW from this datasource. Here is what I have discovered/tried so ...
1
vote
1answer
85 views
Modeling staff dimension in data warehouse
I need to write a data warehouse diagram. I've got a problem with staff area. I have to store a information about workers details like name, age etc., and workers job time and agreement details like ...
1
vote
1answer
71 views
Open source tools to manage Data Quality [closed]
Are there open source (or commercial) tools that can report data quality issues in a data warehouse using the Kimball star schema model? It doesn't have to be the silver bullet. I'm just looking for ...
3
votes
1answer
88 views
What to do with duplicate lookup information
I have multiple databases that I want to store in one data warehouse database. I am wondering how I design the import process to handle multiple lookup tables.
For example, say I have 5 databases all ...
1
vote
1answer
79 views
Conceptual Design of a data warehouse (declaring the grain)
I am trying to design a data warehouse using this example scrubbed data. I need to declare the "grain". I know its the lowest level of detail in the fact table, but I am having a hard time determining ...
2
votes
2answers
116 views
Disaster recovery plan - Having multiple servers
I work in an organization where departments are in different buildings. I have a data centre in the main building. All the in-house applications connect to the SQL Server residing in the server in the ...
3
votes
1answer
73 views
Is there a standard way to replace codes with values from a lookup table for reporting or analytics?
Suppose I have a "main" table that was probably heavily normalized and consists largely of columns that merely contain codes that are lookups into other tables (they are probably foreign keys but feel ...
1
vote
2answers
137 views
Data warehouse support tickets
I'm starting to design a data warehouse for a company. The first questions we're trying to resolve are regarding their support ticketing system. My initial schema is as follows
Now one of the ...
4
votes
1answer
269 views
Big Data vs Relational Database on making structure of Data-ware house for telecom data analysis [closed]
I'm currently doing my final year project on telecommunication mining. On starting project I got confuse on choosing database. As data on mobile communication is going on increasing so I think Big ...
0
votes
1answer
130 views
What are good resources on data modelling for business intelligence? [closed]
We are a SaaS startup offering purchase & procurement solutions. The data model for operational transactions has been created (relational DB). We also want to offer analytics on those transactions ...
1
vote
2answers
142 views
XML Large DataBase is the best? [closed]
Is the best way to implement a large database is XML? Or is there a better way?
1 - reduce the time complexity
2 - Reduce the amount of traffic between the tables
And other factors ...
Which ...
4
votes
1answer
1k views
ETL: extracting from 200 tables - SSIS data flow or custom T-SQL?
Based on my analysis, a complete dimensional model for our data warehouse will require extraction from over 200 source tables. Some of these tables will be extracted as part of an incremental load and ...
5
votes
2answers
151 views
Cardinality rule for bitmap indexes
The Oracle documentation includes the following advice:
A bitmap index should be built on each of the foreign key columns of
the fact table or tables
In that reference, there is even a bitmap ...
1
vote
1answer
104 views
Force chain to start immediately after completion instead of on a timer
Is it possible to force an Oracle chain to restart immediately after it finishes executing, instead of on a timer? I have only found ways to do a temporal restart, which doesn't really work for me as ...
5
votes
3answers
276 views
Partition pruning with multiple date columns
I have a large table in Oracle 11g database that holds historical data from several years, so I would like to partition it by year. The problem is that the table has multiple date columns and they are ...
3
votes
2answers
116 views
how often to run Tablediff
I wonder if it is safe to run the Tablediff tool on a database fairly often?
Let's say every 15 or 30 minutes. Also, the Data in the DB is around 100 GB.
1
vote
0answers
54 views
Advices for modeling facts, time hierarchies based on two conditions
Sorry if my question does not belong to that SE but I tried to find the best place and it ended up here.
My problem is this :
I've got a table modeled as this in our datawarehouse env. :
MYTABLE ...
4
votes
1answer
134 views
When should startup parameter -E be used?
We are starting to build a data warehouse system using SQL Server 2008 R2. One of the senior DBAs told us to consider using a startup parameter -E for the SQL Server service. I read from Books Online ...
4
votes
2answers
149 views
Isolation Level for a Data Warehouse
We are building out a data warehouse (and also some data marts as well) in our organization. My DBA skills have mostly been on OLTP type applications, but I am moving into supporting OLAP for our ...
2
votes
1answer
186 views
In star schemas, what should I do when a dimension has a date attribute?
I'm trying to learn about dimensional models and star schemas. Say I have a Sales fact table recording the total sales at retail stores, with, say, four dimensions, Date, Customers, Stores, and ...
0
votes
1answer
29 views
Oracle scheduler chain priority in data warehouse applications
The scenario is as follows:
We have a data warehouse type application that relies on the Oracle job scheduler and a Chain. This chain is responsible for generating materialized views (caches) that ...
0
votes
2answers
115 views
SQL Server 2005 replication for a data warehouse
We are trying to implement some kind of Data Warehouse at my current employer.
Most of our data is in a SQL Server 2005, but we might also integrate some Access databases and some databases in a SQL ...
3
votes
1answer
143 views
How to represent aggregates in a data warehouse
I am building the dimensional model for a data warehouse (as an exercise for a mini-course I am doing) and I want to build an aggregate to speed up queries.
Basically, I want the aggregate to group ...
0
votes
0answers
441 views
oracle database project ideas [closed]
I have to prepare three project ideas for my final year undergraduate project module. I like to work with databases and i want any challenging database design and implementation with various ...
4
votes
1answer
168 views
Should I Link a Fact to Hierarchical Dimension at ALL Levels or only the most granular?
Related question about the same project here.
I'm looking at two approaches to model a hierarchical relationship between my fact and dimension tables in a data warehouse for storing IT infrastructure ...
6
votes
1answer
103 views
Dimension and Fact for same entities?
I'm rather new at DW design and am working on a DW to model some IT infrastructure.
The major problem/question at this point is how to model drive information.
We will be collecting aggregate data ...
0
votes
0answers
68 views
Oracle Change Data Control - how to use SOURCE_COLMAP$ and TARGET_COLMAP$
Has anyone successfully used the TARGET_COLMAP$ column in Oracle Change Data Control to identify which columns have changed? I'm trying to produce audit reports for users and identify for the user ...
2
votes
1answer
359 views
Does surrogate key assignment for a fact table require that the source data has natural keys?
Let's say I have a simple OLTP database with orders, products, and customers:
And from it, I am building a data mart with an orders fact table, product dimension, customer dimension, and date ...
0
votes
1answer
42 views
Can't Find Meta data tool [closed]
I having problem to find a Meta data tool that should be used for data warehouse or data mart in order to make documentation.
0
votes
1answer
133 views
How to simplify schema for multi database / hundreds of millions of rows data set
We currently have a MySQL data set that was started about 10 years ago that aggregates a log of data, and accumulates millions of rows each month. The people that developed our system started ...
3
votes
3answers
362 views
How do you roll up header-level values on a fact table with line-item granularity?
From what I've read, the recommended granularity for a fact table based on an order header / line item structure is at the line item level. In the process, any additive values that apply only to the ...
3
votes
1answer
66 views
Architectural Question about Data analytics
I understand that in many OLTP architectures there is some ELT stuff which creates a OLAP Data warehouse model and then you can run data analytics on this. However, this can take some time to ...
3
votes
1answer
68 views
Reporting Table Design
I'm writing a system that allows users to store values against each week in October and November and each day in December - starting from the first Monday. I'm holding the raw data entered by the ...
0
votes
2answers
261 views
SQL Server 2012 Data Warehousing Overall Flow [closed]
I am studying Data Warehousing in SQL Server 2012
I am attempting to learn the various tools included by practicing on the different tools separately.
I have practiced with:
AdventureWorks ...
7
votes
3answers
972 views
When should indexes be dropped and recreated?
We are constructing a data warehouse that initially will be 1 TB and will grow around 20gigs every month.
For certain tables we are doing daily ETL processes and others we are doing weekly/monthly.
...
4
votes
1answer
229 views
Database structure, relational or data warehouse?
Good morning,
Im having some issues with how my database should be laid out and would appreciate some guidance. I have several tables (rainfall data), each containing the following columns:
Date ...
0
votes
0answers
55 views
Biztalk + BI = where? [closed]
I have heard that you can use Biztalk in to transfer data to the Business intelligence.
Exactly where do you put the Biztalk's integration in relation to the architecture of Business Intelligence?
13
votes
2answers
2k views
What are the arguments in favor of using ELT process over ETL?
I realized that my company uses an ELT (extract-load-transform) process instead of using an ETL (extract-transform-load) process.
What are the differences in the two approaches and in which situations ...
