A database system optimised for reporting, particularly in aggregate. Often, but not always implemented using a star schema.

learn more… | top users | synonyms

1
vote
0answers
5 views

Datastage connector error

This is a related with IBM datastage 9.1, when I try to test oracle connector. Show error massage like as a below "Error loading connector library ccora11g.dll %1 is not valid win32 application", PLs ...
0
votes
2answers
193 views

Daily snapshot fact table

I have a list of products per costumer. Costumers can delete or add products to their list. I want to know in each day what is the list of products (and count) by costumer. My first approach is to ...
0
votes
0answers
10 views

SSAS bridge table with Slowly changing dimensions

I am designing a datamart using the basic principles of Kimball for use in SSAS. I have a many many to many attribute relationships (multi-valued dimension objects), however I have a few questions: ...
3
votes
1answer
18 views

Stored procedure deployment - push or pull into database? [closed]

Using stored procedures as part of an ETL process to populate tables in another database, which method would be considered a best practice (if any) in terms of deployment, maintenance, visibility and ...
0
votes
0answers
27 views

What options exist for replicating SQL Server over the public internet

Specifically, I'd like to set up a reporting copy of a SQL Server 2012 transactional database. This primary runs in a managed services provider, and I want a copy in an AWS EC2 SQL Server instance. ...
1
vote
1answer
466 views

creating a report on the mysql jasperReport server

I have mysql local database, in it I have sample data mart. I have installed jasperReport server to my computer. Just using this tool, I want connect to the local mysql database and just create a pdf ...
0
votes
0answers
18 views

Proxy for MDW data collection on remote servers - SQL Server 2012

I am trying to setup data collection (for disk usage) from remote servers and upload it to my MDW database. I understand I will need a proxy set up for the agent to do this but which subsystem to I ...
1
vote
2answers
152 views

Business Logic in Data Warehouse

my question is: Should business logic be stored in the data warehouse data store? Or should it only exist in the reporting applications? To give a more concrete example: In the CRM operational ...
0
votes
0answers
29 views

What is the recommended RAID configuration for data Warehouse? [duplicate]

I am trying to understand if there is RAID best for data warehouse.( for version SQL Server 2012 or 2014). so What is the best RAID for data Warehouse performance wise? What is the recommended RAID ...
1
vote
1answer
167 views

Migrate Management Data Warehouse to a New Instance

Is there a defined procedure to follow for moving a SQL Server 2012 management data warehouse to a new server\instance? We intend to setup an MDW on a test sql server instance first, but will then ...
0
votes
0answers
6 views

Datetime to string in pentaho DI

I have a date value in the text file and Pentaho identify it as a date format like this, '2015-06-30 00:00:02'. I want to get string output to new field like this , '20150630'. Ho can I do this in ...
0
votes
0answers
15 views

Data Warehouse for reporting - 6 Dimension tables,or 1 table and 6 views?

Problem: I have been asked to add a Dimension table to our data warehouse and create the ETL tasks to populate it. Lets call the table "DimInternalFault". The source table for DimInternalFault is ...
0
votes
0answers
6 views

Datavaulting polymorphic association (conditional) columns

I'm trying to implement data vault into our business but I'm stuck with the data vault model. We are having some source tables (3NF) which contain some polymorphic association (conditional) columns: ...
0
votes
1answer
11 views

Dimensional Model for inheritance in dimensions

How are dimensions typically modeled in a dimensional model if one dimension logically inherits from another dimension? For example, assume I have an Employee dimension and a Driver dimension, where ...
1
vote
1answer
25 views

Are there best practices or standardized syntax for writing transformation logic?

This may not be the appropriate forum, but its the closest I could find. I write a lot of source to target mappings for work. These documents just describe the operations/logic/transformations/etc. ...
0
votes
0answers
65 views

Handle Duplicate entries in Fact table in Data Cube

We have been constructing data cube for our project in which we are facing a problem like 1 to many relationship in the dimension tables and making entries in fact table (duplication). ...
1
vote
0answers
24 views

Best way to perform real time analytics on a growing collection of json file ( very large ) [closed]

I have a very large collection of JSON file (tens of millions) on S3 and I need to have some kind of aggregation (perform continuously as the collection grows). The aggregation is mainly counter ...
2
votes
1answer
63 views

Update Cube data

We are using OLAP in our Project. We are facing a scenario where we need to update the cube with real time data on daily basis. I need some suggestions about an optimal way for updating the data in ...
2
votes
1answer
98 views

Server roles in SQL Server 2016

There are 3 new server roles in SQL Server 2016: mediumrc largerc xlargerc Any idea what these are for? Google doesn't give any information about these.
0
votes
0answers
27 views

ETL flow in Fact tables

I've got a simple theoretical question... If we discuss the principles, elements, design and implementation of a typical ETL flow for a dimension table then, in my understanding, (in short) I'd say ...
1
vote
0answers
15 views

Process dimension task is querying the wrong column!

I'm in the process of building a new data warehouse and I am starting out by building a few dimensions. I have created a fairly typical "Date" dimension and that seems ok. Now I am trying to create ...
-5
votes
3answers
250 views

Is business intelligence (BI) primarily a technical project or a business project? [closed]

I am currently involved in the planning stages for a Business Intelligence (BI) project in our company. We are attempting to understand many facets of the business, and as such the technical side ...
9
votes
1answer
502 views

Should I disable “auto update statistics” in a data warehousing scenario?

I have 200 GB data warehouse in SQL Server. I have been experiencing really slow execution times for some queries; for example 12 hours for a simple delete query with an inner join. After doing ...
2
votes
2answers
66 views

Do valid to/from columns on a fact table make sense?

I recently came across "valid from" and "valid to" columns on a fact table. Obviously this is common for dimensions but I've not seen them on fact tables before and can't find any info suggesting ...
0
votes
0answers
49 views

Is there a way to check which views have data? Oracle 11g

I'm undergoing a cleanup process for a data mart design. However, I want to get rid of any views (in the design) which result in having 1 or less rows of data. Instead of manually going through ...
1
vote
1answer
30 views

How to load .dat files to oracle database

I have .DAT files extracted from telecom switch. I want to upload this file to an Oracle server using IBM data-stage ETL tool. Unfortunately these files are not readable format. This is a picture ...
0
votes
1answer
244 views

Constellation Schema; Relationships between fact tables

What are acceptable types of depedendcies between facts in a multiple-fact schema? Conceptually talking, As you know a Multi-Dimensional Model may have multiple facts (like in a constellation ...
2
votes
2answers
1k views

Datawarehouse - Dimension, Fact, or Degenerative dimension

I am building a warehouse for a billing system that bills a number of services/utilities on the same invoice, as such I am having real trouble conforming to a recognised design method for the ...
0
votes
1answer
18 views

New fact table or new dimension

I have a fact table with 2 dimensions: cohort_id date_id Each record contains the amount of active users from a specific cohort at a particular date - typical structure for the cohort analysis. ...
4
votes
2answers
97 views

Is it good or bad practice to have a fact table relate to the same dimension table multiple times?

I'm new to DW/BI, and this seems like a pretty basic question, but I can't seem to find a good answer. I have a fact table that would have more than one date associated with it, so I was thinking ...
1
vote
0answers
44 views

Best practices to segment people and attributes for advertising database

we have a database where we store people some attributes per person in the following tables: people (id, name, email, phone) people_attributes (id, person_id, attribute_name, attribute_value) ...
0
votes
0answers
255 views

Calculate sum of a whole column in IBM Datastage without any grouping

I have a table in oracle with salary as one of the columns. I want to calculate the sum of this salary column. It is pretty simple in SQL sum(salary) but I have made some dimensions and facts using ...
0
votes
1answer
52 views

How to keep the data warehouse synchronised with the source systems? [closed]

I'm a DBA who is responsible for exporting data from an ERP system for Business Intelligence purposes. The data from ERP system is being sent to the data warehouse and they are used in the ETL ...
1
vote
1answer
61 views

Name for intermediate aggregated data [closed]

We have raw data and aggregated data as well as sometimes multiple levels of aggregation between. Is there a name for the data in that intermediate "state" of aggregation? Just like how we have Real ...
1
vote
1answer
24 views

Table for actual values

I have a database where logging happens and is processed in a data-warehouse styled environment. This means there are staging cycles where the data comes in and then is processed. For a reporting ...
3
votes
4answers
1k views

How do you roll up header-level values on a fact table with line-item granularity?

From what I've read, the recommended granularity for a fact table based on an order header / line item structure is at the line item level. In the process, any additive values that apply only to the ...
0
votes
0answers
51 views

Is there value in storing audit fields in a fact table?

I've always stored at least two basic housekeeping fields in all of my dimension and fact tables: DateCreated and DateModified. However, this adds two fairly wide (eight bytes each, in MS SQL) ...
1
vote
4answers
539 views

Looking for ideas on maintaining data warehouse in close to real-time - ETL tools, etc

I have done a fair number of traditional data warehouse implementations where the loads were done in a batch-oriented manner, i.e. the data is refreshed nightly or, at most, every few hours. I now ...
6
votes
2answers
3k views

Compare two similar Postgres databases for differences

I occasionally download publicly available data sets in the form of Postgres dBs. These datasets are updated/modified/expanded over time by the repository host. Is there a Postgres command or ...
0
votes
2answers
154 views

How to prevent users other than DBAs from creating database links

To begin, please keep in mind that I am a very green DBA. I have done prior research and have not really found anything too promising, or maybe it just seems that way because I am still struggling in ...
1
vote
2answers
190 views

Dimension or Degenerate Dimension?

I am taking a course on data warehousing. Currently, I am reading through Ralph Kimball's Data Warehouse Toolkit. I understand that a degenerate dimension is a dimension key that is stored in a fact ...
0
votes
1answer
27 views

Data warehouse: Can I tell any details from Source System on delays or blocks? [closed]

I have a MS SQL Server 2012 machine that is acting as our data warehouse currently. We are having issues with long running jobs, and am curious if there is a way to get detailed historical logging on ...
0
votes
1answer
102 views

What to do when facts change frequently in a star schema for data warehouse?

I have a Quotation Management system that I built as a CRUD web app. Over time, I realized I need to improve it so that management can have their reports. Hence I studied the Kimball method of data ...
0
votes
0answers
73 views

Use trigger to update SCD2 End date and IsCurrentRow flag

I'm implementing a data warehouse that has type 2 slowly changing dimensions. When a change is made to a SCD type 2 column, I need to insert a new row into the dimension for that entity and also ...
1
vote
0answers
58 views

how many fact tables do I need given I want to build an OLAP for Quotation Line Item and Purchase Order Line Item report?

My client wants a report that looks something like this on a daily basis. +---------------+-------------------------+-----------------+---------------------+-------------+ | ProductNumber | ...
0
votes
1answer
110 views

How to change a web application that now needs to become OLTP and OLAP application?

Previously, I did a simple web application for an enterprise client using PHP and MySQL. After some time, it has grown to a point where I realized after talking with people here that I need to treat ...
2
votes
2answers
218 views

Have a separate database for data warehousing?

I have built a typical web application using PHP and MySQL for enterprise usage. The MySQL database is 3NF as much as possible. However, as time goes by, the requests for the data appear to be more ...
0
votes
0answers
84 views

Fact table linked to Slowly Changing Dimension

I'm struggling to understand the best way to model a particular scenario for a data warehouse. I have a Person dimension, and a Tenancy dimension. A person could be on 0, 1 or (rarely) multiple ...
1
vote
2answers
323 views

TSQL vs SSIS Lookup

I was trying to find some well performing Tsql equivalents for the SSIS Lookup component. Especially for Fact table loading. After few different query patterns the most obv performed the best: ...
6
votes
4answers
2k views

Datawarehouse bad practice?

In our Datawarehouse context, we have to update some record in fact tables inside our ETL. One thing we did is to create nonclustered indexes just before the heaviest queries, and drop them ...