meta user
network profile
| bio | website | blog.codingbadger.com |
|---|---|---|
| location | London, United Kingdom | |
| age | 30 | |
| visits | member for | 7 months |
| seen | May 2 at 10:09 | |
| stats | profile views | 16 |
|
Feb 15 |
comment |
What to do with duplicate lookup information Thanks! That was my other idea but it seemed a bit like I was dropping bits of information I may need (The original Id's of the customer state in their respective systems) However, thinking about it I am not sure what I would use them for. Getting caught up in over thinking I suspect! |
|
Feb 12 |
comment |
Database not naturally shrinking log file Damn it - cannot believe I couldn't find that! |
|
Oct 29 |
comment |
Powershell script executing within SQL Server Agent @PatrickKeisler No I haven't - how would I do that? |
|
Oct 26 |
comment |
Powershell script executing within SQL Server Agent @PatrickKeisler Yes it is. |
|
Oct 19 |
comment |
Advice on how to approach data cleaning & importing @Jon Ah yes, you are totally right there. I am not sure how I didn't notice that. I may have used the SourceTable at some point and forgotten to remove it. Still tinkering and monitoring at the moment so I may well change the approach. I am processing ~100 event types which is taking ~2minutes which is well within my time constraints. Thanks for your input :-) |
|
Oct 19 |
comment |
Advice on how to approach data cleaning & importing Answer posted! :) |
|
Oct 19 |
comment |
Advice on how to approach data cleaning & importing Sure, I will post it as an answer. It uses slightly different logic from your case example but your answer certainly fueled my initial thoughts :) |
|
Oct 12 |
comment |
Advice on how to approach data cleaning & importing @Zane: This will be a daily import process. |
|
Oct 11 |
comment |
Advice on how to approach data cleaning & importing I think this is similar to where my own thought process led me to. (Well it involved a mapping table & dynamic SQL :) I might give it a try and see how it performs. I was hoping there would be a better way but as the incoming data is a bit of a mess I can't see how there can be any other way. |
|
Sep 26 |
comment |
MI Data Warehouse Advice @Mark Thanks, it is nice and warm here. Although the bulk of the data exists in the 5-10 tables there are other tables that do contain reporting information. (probably around an additional 10-15 tables) If the data was transformed in to Fact & Dimensions I should think this could be reduced significantly. I can't access the production database directly. (The import process picks up the data from a SFTP site). I wouldn't want to create a cube on this data as it stands as I don't believe all of it is correct. |
