A database system optimised for reporting, particularly in aggregate. Often, but not always implemented using a star schema.

learn more… | top users | synonyms

1
vote
0answers
7 views

Datastage connector error

This is a related with IBM datastage 9.1, when I try to test oracle connector. Show error massage like as a below "Error loading connector library ccora11g.dll %1 is not valid win32 application", PLs ...
0
votes
0answers
12 views

SSAS bridge table with Slowly changing dimensions

I am designing a datamart using the basic principles of Kimball for use in SSAS. I have a many many to many attribute relationships (multi-valued dimension objects), however I have a few questions: ...
3
votes
1answer
22 views

Stored procedure deployment - push or pull into database? [closed]

Using stored procedures as part of an ETL process to populate tables in another database, which method would be considered a best practice (if any) in terms of deployment, maintenance, visibility and ...
0
votes
0answers
27 views

What options exist for replicating SQL Server over the public internet

Specifically, I'd like to set up a reporting copy of a SQL Server 2012 transactional database. This primary runs in a managed services provider, and I want a copy in an AWS EC2 SQL Server instance. ...
0
votes
0answers
18 views

Proxy for MDW data collection on remote servers - SQL Server 2012

I am trying to setup data collection (for disk usage) from remote servers and upload it to my MDW database. I understand I will need a proxy set up for the agent to do this but which subsystem to I ...
0
votes
0answers
29 views

What is the recommended RAID configuration for data Warehouse? [duplicate]

I am trying to understand if there is RAID best for data warehouse.( for version SQL Server 2012 or 2014). so What is the best RAID for data Warehouse performance wise? What is the recommended RAID ...
0
votes
0answers
6 views

Datetime to string in pentaho DI

I have a date value in the text file and Pentaho identify it as a date format like this, '2015-06-30 00:00:02'. I want to get string output to new field like this , '20150630'. Ho can I do this in ...
0
votes
0answers
15 views

Data Warehouse for reporting - 6 Dimension tables,or 1 table and 6 views?

Problem: I have been asked to add a Dimension table to our data warehouse and create the ETL tasks to populate it. Lets call the table "DimInternalFault". The source table for DimInternalFault is ...
0
votes
0answers
7 views

Datavaulting polymorphic association (conditional) columns

I'm trying to implement data vault into our business but I'm stuck with the data vault model. We are having some source tables (3NF) which contain some polymorphic association (conditional) columns: ...
0
votes
1answer
11 views

Dimensional Model for inheritance in dimensions

How are dimensions typically modeled in a dimensional model if one dimension logically inherits from another dimension? For example, assume I have an Employee dimension and a Driver dimension, where ...
1
vote
1answer
25 views

Are there best practices or standardized syntax for writing transformation logic?

This may not be the appropriate forum, but its the closest I could find. I write a lot of source to target mappings for work. These documents just describe the operations/logic/transformations/etc. ...
1
vote
0answers
26 views

Best way to perform real time analytics on a growing collection of json file ( very large ) [closed]

I have a very large collection of JSON file (tens of millions) on S3 and I need to have some kind of aggregation (perform continuously as the collection grows). The aggregation is mainly counter ...
0
votes
0answers
66 views

Handle Duplicate entries in Fact table in Data Cube

We have been constructing data cube for our project in which we are facing a problem like 1 to many relationship in the dimension tables and making entries in fact table (duplication). ...
2
votes
1answer
63 views

Update Cube data

We are using OLAP in our Project. We are facing a scenario where we need to update the cube with real time data on daily basis. I need some suggestions about an optimal way for updating the data in ...
0
votes
0answers
29 views

ETL flow in Fact tables

I've got a simple theoretical question... If we discuss the principles, elements, design and implementation of a typical ETL flow for a dimension table then, in my understanding, (in short) I'd say ...
2
votes
1answer
102 views

Server roles in SQL Server 2016

There are 3 new server roles in SQL Server 2016: mediumrc largerc xlargerc Any idea what these are for? Google doesn't give any information about these.
1
vote
0answers
15 views

Process dimension task is querying the wrong column!

I'm in the process of building a new data warehouse and I am starting out by building a few dimensions. I have created a fairly typical "Date" dimension and that seems ok. Now I am trying to create ...
0
votes
0answers
49 views

Is there a way to check which views have data? Oracle 11g

I'm undergoing a cleanup process for a data mart design. However, I want to get rid of any views (in the design) which result in having 1 or less rows of data. Instead of manually going through ...
1
vote
1answer
30 views

How to load .dat files to oracle database

I have .DAT files extracted from telecom switch. I want to upload this file to an Oracle server using IBM data-stage ETL tool. Unfortunately these files are not readable format. This is a picture ...
2
votes
2answers
66 views

Do valid to/from columns on a fact table make sense?

I recently came across "valid from" and "valid to" columns on a fact table. Obviously this is common for dimensions but I've not seen them on fact tables before and can't find any info suggesting ...
0
votes
1answer
19 views

New fact table or new dimension

I have a fact table with 2 dimensions: cohort_id date_id Each record contains the amount of active users from a specific cohort at a particular date - typical structure for the cohort analysis. ...
1
vote
0answers
44 views

Best practices to segment people and attributes for advertising database

we have a database where we store people some attributes per person in the following tables: people (id, name, email, phone) people_attributes (id, person_id, attribute_name, attribute_value) ...
0
votes
1answer
52 views

How to keep the data warehouse synchronised with the source systems? [closed]

I'm a DBA who is responsible for exporting data from an ERP system for Business Intelligence purposes. The data from ERP system is being sent to the data warehouse and they are used in the ETL ...
1
vote
1answer
61 views

Name for intermediate aggregated data [closed]

We have raw data and aggregated data as well as sometimes multiple levels of aggregation between. Is there a name for the data in that intermediate "state" of aggregation? Just like how we have Real ...
1
vote
1answer
24 views

Table for actual values

I have a database where logging happens and is processed in a data-warehouse styled environment. This means there are staging cycles where the data comes in and then is processed. For a reporting ...
0
votes
0answers
53 views

Is there value in storing audit fields in a fact table?

I've always stored at least two basic housekeeping fields in all of my dimension and fact tables: DateCreated and DateModified. However, this adds two fairly wide (eight bytes each, in MS SQL) ...
0
votes
2answers
160 views

How to prevent users other than DBAs from creating database links

To begin, please keep in mind that I am a very green DBA. I have done prior research and have not really found anything too promising, or maybe it just seems that way because I am still struggling in ...
0
votes
1answer
28 views

Data warehouse: Can I tell any details from Source System on delays or blocks? [closed]

I have a MS SQL Server 2012 machine that is acting as our data warehouse currently. We are having issues with long running jobs, and am curious if there is a way to get detailed historical logging on ...
0
votes
0answers
73 views

Use trigger to update SCD2 End date and IsCurrentRow flag

I'm implementing a data warehouse that has type 2 slowly changing dimensions. When a change is made to a SCD type 2 column, I need to insert a new row into the dimension for that entity and also ...
1
vote
0answers
59 views

how many fact tables do I need given I want to build an OLAP for Quotation Line Item and Purchase Order Line Item report?

My client wants a report that looks something like this on a daily basis. +---------------+-------------------------+-----------------+---------------------+-------------+ | ProductNumber | ...
0
votes
1answer
103 views

What to do when facts change frequently in a star schema for data warehouse?

I have a Quotation Management system that I built as a CRUD web app. Over time, I realized I need to improve it so that management can have their reports. Hence I studied the Kimball method of data ...
0
votes
1answer
112 views

How to change a web application that now needs to become OLTP and OLAP application?

Previously, I did a simple web application for an enterprise client using PHP and MySQL. After some time, it has grown to a point where I realized after talking with people here that I need to treat ...
2
votes
2answers
222 views

Have a separate database for data warehousing?

I have built a typical web application using PHP and MySQL for enterprise usage. The MySQL database is 3NF as much as possible. However, as time goes by, the requests for the data appear to be more ...
0
votes
0answers
85 views

Fact table linked to Slowly Changing Dimension

I'm struggling to understand the best way to model a particular scenario for a data warehouse. I have a Person dimension, and a Tenancy dimension. A person could be on 0, 1 or (rarely) multiple ...
6
votes
4answers
2k views

Datawarehouse bad practice?

In our Datawarehouse context, we have to update some record in fact tables inside our ETL. One thing we did is to create nonclustered indexes just before the heaviest queries, and drop them ...
1
vote
1answer
77 views

How to migrate data of to another sql server

Good day, I have a database running on a virtual machine hosted at our ISP. It is a fairly large database which has about 5GB of data inserted into it every day (network logs). It is partitioned ...
0
votes
0answers
23 views

What known strategies, if any, can I use to validate a Slowly Changing Dimension?

I have a customer dimension in our data warehouse (SSAS 2014 Multidimensional). It is set up as a Type II SCD, with just Start and End Date fields to track changes. (null end date = current). As our ...
1
vote
3answers
70 views

Data Warehouse measures without a corresponding dimension

I have an operations database that contains this table: salesQuality salesPrice salesCategory According to my business requirements, the salesQality and salesPrice are measures. However, ...
1
vote
1answer
103 views

Best way to document Dwh views [closed]

I works in a company that provide Dwh views as an API for external Customers (We use MS-SQL 2008 & 2012). every once in a while we release new views and updates the existing views. We have ...
0
votes
0answers
100 views

Data warehousing: data transfer process too slow with larger batches

I have two primary instances of SQL Server, one for OLTP and one for reporting. The data warehouse for reporting is basically a Type 2 SCD: every table has DWDateStart and DWDateEnd columns and the ...
0
votes
0answers
51 views

Physical Table being used a Temp Table in a warehosue. Any advantage?

As I stated in previous posts I've inherited a warehouse based on SQL Server framework. In my continuous review of existing components and the practices adopted by the predecessors I found something ...
0
votes
0answers
37 views

Accounting - Dimention table in mysql

I am designing a accounting and mini erp system. I use a date dimension table to track all date related data. In oracle we can have many schema for a database. so we could create each schema for ...
4
votes
2answers
97 views

Is it good or bad practice to have a fact table relate to the same dimension table multiple times?

I'm new to DW/BI, and this seems like a pretty basic question, but I can't seem to find a good answer. I have a fact table that would have more than one date associated with it, so I was thinking ...
0
votes
0answers
67 views

Required Information to start oracle warehouse builder

I am using windows 8 64 bit . I want to install Oracle Warehouse Builder on my system. I have installed Oracle 11g and come to know that Warehouse Builder is already a part of it. But when I start ...
1
vote
2answers
329 views

TSQL vs SSIS Lookup

I was trying to find some well performing Tsql equivalents for the SSIS Lookup component. Especially for Fact table loading. After few different query patterns the most obv performed the best: ...
0
votes
0answers
164 views

How alter on infobright (BRIGHTHOUSE storage engine) actually works

I have been using infobright-3.4.1 (5.1.40) for data warehousing. I know it is outdated version but there no plan to upgrade the version currently. Even though infobright is build on mysql, the way it ...
1
vote
3answers
889 views

Purpose of Data Warehousing?

I have been reading up on Data Warehousing and its purpose. The main purpose seems to be to track historical data and whatever changes may have occurred over time. The DW book I am reading gives a ...
0
votes
1answer
23 views

Conformed Fields or Snowflake? - Shop and Customer Location

I have shop dimension and customer dimension which both has location information. Should I create location dimension to correlate shop location and customer location? I believe this one is called ...
1
vote
1answer
43 views

MySQL data to Postgres every X time

Our team (Uni students) have a project that we are updating. Old project team has a Live MySQL database. We want to make a archive/warehouse from it in PostgreSQL. My question is: How can we import ...
1
vote
2answers
46 views

Dimension for Product Properties based on Product Type - Sparse Dimension?

I am creating dimension of product properties for sales facts. Property of product depend of product type. For example: - Type = smartphone. Properties = model, OS, size - Type = book. Properties = ...