206 reputation
112
bio website blog.codingbadger.com
location London, United Kingdom
age 30
visits member for 8 months
seen 17 hours ago
stats profile views 16

Oct
19
comment Advice on how to approach data cleaning & importing
@Jon Ah yes, you are totally right there. I am not sure how I didn't notice that. I may have used the SourceTable at some point and forgotten to remove it. Still tinkering and monitoring at the moment so I may well change the approach. I am processing ~100 event types which is taking ~2minutes which is well within my time constraints. Thanks for your input :-)
Oct
19
comment Advice on how to approach data cleaning & importing
Answer posted! :)
Oct
19
answered Advice on how to approach data cleaning & importing
Oct
19
comment Advice on how to approach data cleaning & importing
Sure, I will post it as an answer. It uses slightly different logic from your case example but your answer certainly fueled my initial thoughts :)
Oct
19
awarded  Scholar
Oct
19
accepted Advice on how to approach data cleaning & importing
Oct
19
revised Difficulty creating logins on SQL Server 2012 (error: 15401)
formatting
Oct
19
suggested suggested edit on Difficulty creating logins on SQL Server 2012 (error: 15401)
Oct
12
comment Advice on how to approach data cleaning & importing
@Zane: This will be a daily import process.
Oct
11
comment Advice on how to approach data cleaning & importing
I think this is similar to where my own thought process led me to. (Well it involved a mapping table & dynamic SQL :) I might give it a try and see how it performs. I was hoping there would be a better way but as the incoming data is a bit of a mess I can't see how there can be any other way.
Oct
11
revised Advice on how to approach data cleaning & importing
added 48 characters in body
Oct
11
asked Advice on how to approach data cleaning & importing
Sep
28
awarded  Teacher
Sep
28
answered Script Contents of SQL Server Database From a Batch File
Sep
28
answered Integrating intranet web logins with AD emails
Sep
28
awarded  Supporter
Sep
26
awarded  Editor
Sep
26
revised MI Data Warehouse Advice
added 96 characters in body
Sep
26
comment MI Data Warehouse Advice
@Mark Thanks, it is nice and warm here. Although the bulk of the data exists in the 5-10 tables there are other tables that do contain reporting information. (probably around an additional 10-15 tables) If the data was transformed in to Fact & Dimensions I should think this could be reduced significantly. I can't access the production database directly. (The import process picks up the data from a SFTP site). I wouldn't want to create a cube on this data as it stands as I don't believe all of it is correct.
Sep
25
awarded  Student