A database system optimised for reporting, particularly in aggregate. Often, but not always implemented using a star schema.

learn more… | top users | synonyms

-1
votes
0answers
24 views

Sequential file reading warning in datastage [on hold]

When I try to load data from sequence file to oracle database, delimiter is '|', ETL Tool is IBM datastage 9.1, Compile was correctly, Load process finalize without any error,my issue is some rows ...
0
votes
0answers
43 views

Is there a way to check which views have data? Oracle 11g

I'm undergoing a cleanup process for a data mart design. However, I want to get rid of any views (in the design) which result in having 1 or less rows of data. Instead of manually going through ...
1
vote
1answer
14 views

How to load .dat files to oracle database

I have .DAT files extracted from telecom switch. I want to upload this file to an Oracle server using IBM data-stage ETL tool. Unfortunately these files are not readable format. This is a picture ...
2
votes
2answers
41 views

Do valid to/from columns on a fact table make sense?

I recently came across "valid from" and "valid to" columns on a fact table. Obviously this is common for dimensions but I've not seen them on fact tables before and can't find any info suggesting ...
0
votes
1answer
14 views

New fact table or new dimension

I have a fact table with 2 dimensions: cohort_id date_id Each record contains the amount of active users from a specific cohort at a particular date - typical structure for the cohort analysis. ...
1
vote
0answers
33 views

Best practices to segment people and attributes for advertising database

we have a database where we store people some attributes per person in the following tables: people (id, name, email, phone) people_attributes (id, person_id, attribute_name, attribute_value) ...
0
votes
1answer
38 views

How to keep the data warehouse synchronised with the source systems? [closed]

I'm a DBA who is responsible for exporting data from an ERP system for Business Intelligence purposes. The data from ERP system is being sent to the data warehouse and they are used in the ETL ...
1
vote
1answer
55 views

Name for intermediate aggregated data [closed]

We have raw data and aggregated data as well as sometimes multiple levels of aggregation between. Is there a name for the data in that intermediate "state" of aggregation? Just like how we have Real ...
1
vote
1answer
22 views

Table for actual values

I have a database where logging happens and is processed in a data-warehouse styled environment. This means there are staging cycles where the data comes in and then is processed. For a reporting ...
0
votes
0answers
31 views

Is there value in storing audit fields in a fact table?

I've always stored at least two basic housekeeping fields in all of my dimension and fact tables: DateCreated and DateModified. However, this adds two fairly wide (eight bytes each, in MS SQL) ...
0
votes
2answers
133 views

How to prevent users other than DBAs from creating database links

To begin, please keep in mind that I am a very green DBA. I have done prior research and have not really found anything too promising, or maybe it just seems that way because I am still struggling in ...
0
votes
1answer
27 views

Data warehouse: Can I tell any details from Source System on delays or blocks? [closed]

I have a MS SQL Server 2012 machine that is acting as our data warehouse currently. We are having issues with long running jobs, and am curious if there is a way to get detailed historical logging on ...
0
votes
0answers
60 views

Use trigger to update SCD2 End date and IsCurrentRow flag

I'm implementing a data warehouse that has type 2 slowly changing dimensions. When a change is made to a SCD type 2 column, I need to insert a new row into the dimension for that entity and also ...
1
vote
0answers
47 views

how many fact tables do I need given I want to build an OLAP for Quotation Line Item and Purchase Order Line Item report?

My client wants a report that looks something like this on a daily basis. +---------------+-------------------------+-----------------+---------------------+-------------+ | ProductNumber | ...
0
votes
1answer
69 views

What to do when facts change frequently in a star schema for data warehouse?

I have a Quotation Management system that I built as a CRUD web app. Over time, I realized I need to improve it so that management can have their reports. Hence I studied the Kimball method of data ...
0
votes
1answer
88 views

How to change a web application that now needs to become OLTP and OLAP application?

Previously, I did a simple web application for an enterprise client using PHP and MySQL. After some time, it has grown to a point where I realized after talking with people here that I need to treat ...
2
votes
2answers
138 views

Have a separate database for data warehousing?

I have built a typical web application using PHP and MySQL for enterprise usage. The MySQL database is 3NF as much as possible. However, as time goes by, the requests for the data appear to be more ...
0
votes
0answers
59 views

Fact table linked to Slowly Changing Dimension

I'm struggling to understand the best way to model a particular scenario for a data warehouse. I have a Person dimension, and a Tenancy dimension. A person could be on 0, 1 or (rarely) multiple ...
6
votes
4answers
1k views

Datawarehouse bad practice?

In our Datawarehouse context, we have to update some record in fact tables inside our ETL. One thing we did is to create nonclustered indexes just before the heaviest queries, and drop them ...
1
vote
1answer
69 views

How to migrate data of to another sql server

Good day, I have a database running on a virtual machine hosted at our ISP. It is a fairly large database which has about 5GB of data inserted into it every day (network logs). It is partitioned ...
0
votes
0answers
19 views

What known strategies, if any, can I use to validate a Slowly Changing Dimension?

I have a customer dimension in our data warehouse (SSAS 2014 Multidimensional). It is set up as a Type II SCD, with just Start and End Date fields to track changes. (null end date = current). As our ...
1
vote
3answers
62 views

Data Warehouse measures without a corresponding dimension

I have an operations database that contains this table: salesQuality salesPrice salesCategory According to my business requirements, the salesQality and salesPrice are measures. However, ...
1
vote
1answer
90 views

Best way to document Dwh views [closed]

I works in a company that provide Dwh views as an API for external Customers (We use MS-SQL 2008 & 2012). every once in a while we release new views and updates the existing views. We have ...
0
votes
0answers
80 views

Data warehousing: data transfer process too slow with larger batches

I have two primary instances of SQL Server, one for OLTP and one for reporting. The data warehouse for reporting is basically a Type 2 SCD: every table has DWDateStart and DWDateEnd columns and the ...
0
votes
0answers
48 views

Physical Table being used a Temp Table in a warehosue. Any advantage?

As I stated in previous posts I've inherited a warehouse based on SQL Server framework. In my continuous review of existing components and the practices adopted by the predecessors I found something ...
0
votes
0answers
32 views

Accounting - Dimention table in mysql

I am designing a accounting and mini erp system. I use a date dimension table to track all date related data. In oracle we can have many schema for a database. so we could create each schema for ...
3
votes
2answers
82 views

Is it good or bad practice to have a fact table relate to the same dimension table multiple times?

I'm new to DW/BI, and this seems like a pretty basic question, but I can't seem to find a good answer. I have a fact table that would have more than one date associated with it, so I was thinking ...
0
votes
0answers
51 views

Required Information to start oracle warehouse builder

I am using windows 8 64 bit . I want to install Oracle Warehouse Builder on my system. I have installed Oracle 11g and come to know that Warehouse Builder is already a part of it. But when I start ...
1
vote
2answers
222 views

TSQL vs SSIS Lookup

I was trying to find some well performing Tsql equivalents for the SSIS Lookup component. Especially for Fact table loading. After few different query patterns the most obv performed the best: ...
0
votes
0answers
120 views

How alter on infobright (BRIGHTHOUSE storage engine) actually works

I have been using infobright-3.4.1 (5.1.40) for data warehousing. I know it is outdated version but there no plan to upgrade the version currently. Even though infobright is build on mysql, the way it ...
1
vote
3answers
743 views

Purpose of Data Warehousing?

I have been reading up on Data Warehousing and its purpose. The main purpose seems to be to track historical data and whatever changes may have occurred over time. The DW book I am reading gives a ...
0
votes
1answer
14 views

Conformed Fields or Snowflake? - Shop and Customer Location

I have shop dimension and customer dimension which both has location information. Should I create location dimension to correlate shop location and customer location? I believe this one is called ...
1
vote
1answer
41 views

MySQL data to Postgres every X time

Our team (Uni students) have a project that we are updating. Old project team has a Live MySQL database. We want to make a archive/warehouse from it in PostgreSQL. My question is: How can we import ...
1
vote
2answers
32 views

Dimension for Product Properties based on Product Type - Sparse Dimension?

I am creating dimension of product properties for sales facts. Property of product depend of product type. For example: - Type = smartphone. Properties = model, OS, size - Type = book. Properties = ...
0
votes
0answers
185 views

Calculate sum of a whole column in IBM Datastage without any grouping

I have a table in oracle with salary as one of the columns. I want to calculate the sum of this salary column. It is pretty simple in SQL sum(salary) but I have made some dimensions and facts using ...
0
votes
0answers
121 views

Problem in Incorporating filters into Data Warehouse design

While implementing a data warehouse (proof of concept) I have a requirement to incorporate a user level save-able filter on dimensions. The requirement is a proof of concept so I have the liberty to ...
2
votes
0answers
105 views

SQL Server, Mount Points and File Groups design [closed]

I am looking for some advice on a data warehouse we are building. Specifically around SQL Server, mount points and file groups. We have two design options for how mount points and files groups should ...
11
votes
2answers
797 views

Clustered columnstore indexes and foreign keys

I am performance tuning a data warehouse using indexes. I am fairly new to SQL Server 2014.Microsoft describes the following: "We view the clustered columnstore index as the standard for storing ...
1
vote
1answer
38 views

Separating system databases from MDW SQL Server 2008 R2

We have the Management Datawarehouse feature configure on two of our SQL Servers. Both point to the same central database and upload their results to it. Everything works fine with the built in ...
2
votes
1answer
38 views

Modeling Conversion Events in a Data Warehouse

How should I model conversion events? For instance, if a sales opportunity goes from "stage: prospecting" to "stage: validating", should that be treated as a changing dimension, or a conversion event ...
0
votes
2answers
115 views

Business Logic in Data Warehouse

my question is: Should business logic be stored in the data warehouse data store? Or should it only exist in the reporting applications? To give a more concrete example: In the CRM operational ...
0
votes
2answers
666 views

How to choose suitable naming convention for Dimensional Table Column in a Data Mart?

I have done a lot of reading on naming columns for use in a data mart / data warehouse, as well as for general programming usage. For example, if I had a business branch in a normal application I ...
5
votes
2answers
4k views

Is Data Warehousing possible in MySQL and PostgresSQL [closed]

I am fairly new to DB design and development. My requirement is simple drilldown/slicing based on time and language of words (in a language on a particular day). However, my db is mysql. But so far I ...
1
vote
2answers
139 views

How to architect an analytical BI platform? [closed]

I am working on a new BI project for a medium sized corporation. Right now there is no Analytical infrastructure in place and the reporting is done manually in Excel. There are a few different data ...
2
votes
1answer
73 views

Is data warehouse monitoring same as database monitoring? [closed]

I have a requirement, where data warehouse population is to be monitored. I am in confusion, and needed a clear picture. Is data warehouse different than database? eg. For monitoring database we ...
1
vote
0answers
221 views

500GB Data Warehouse - how to split it into FileGroups?

OK, so I have: 500 GB DW 5 GB in smaller DBs 220 GB TempDB 350 GB in Log files. My machine is Fujitsu Primergy 64 cores (with HT) and 192 GB RAM. I have several IO locations: 540 GB in-server ...
2
votes
1answer
3k views

Best approach for populating date dimension table

I am looking to populate a date dimension table in a SQL Server 2008 database. The fields in the table are as follows: [DateId] INT IDENTITY(1,1) PRIMARY KEY [DateTime] ...
2
votes
1answer
62 views

Hierarchy for dimensional model

I am trying to model a DW where I have many levels of geography (Neighborhood, District, City, State). I have several demographic data that should be included in the model. These data include count ...
0
votes
0answers
64 views

Should I use conventional or computed columns for trivial metrics in a fact table?

A fact table can often have measures which are basically trivial. For example Orders.NumOrders will probably be "1" for every real record (synthetic records representing "no order" may populate this ...
1
vote
2answers
158 views

Database design suggestions for a data scraping/warehouse application?

I'm looking into the database design for a data warehouse kind of project which involves a large number of inserts daily. The data archives will be further used to generate reports. I will have a ...