What book or webpage can I read the architecture and methodology for creating ETL process?
In other words, I'm looking for "how to do it" to create a ETL process when you have many source system to be involved and you also have a data warehouse.
3
-
are you looking for a generic way, i mean designing an ETL process regardless of the tool or you want to develop an ETL package of a specific tool, because every tool is different and in your case you mentioned sqlserver as a tag, so you might be looking for DTS sql 2000 or SSIS sql 2005 & above– AmmarRCommented Jun 14, 2012 at 14:12
-
The answer is "designing an ETL process regardless of the tool". I would like to use sql code only, no ETL application like SSIS or Informatica.– HelloWorld1Commented Jun 14, 2012 at 15:01
-
for "designing an ETL process regardless of the tool" , books or courses by Ralph Kimball very useful for generic concepts just like @Codek & @N West suggested, you also have the TDWI search for ETL papers. --- point 2 to use sql code only, Linked servers & Openquery will help you transfer Data to SQL with sql code only– AmmarRCommented Jun 14, 2012 at 15:23
Add a comment
|
1 Answer
I would recommend reading The Data Warehouse Toolkit by Ralph Kimball. Goes through the theory, with some good examples, and will leave you with a solid understanding of the theory. Then you can look at the tools themselves.
If you're looking for something to build your ETL process, Pentaho have something called the "Star Modeller" which lets you model your dwh, and it then builds the ETL/cubes etc. But it's pretty new and far from complete - worth keeping an eye on though.
-
He also wrote The Data Warehouse ETL Toolkit which is a through explanation of ETL architecture.– N WestCommented Jun 14, 2012 at 15:02