I'm writing a simple package to load data into tables and a I have multiple destinations within the same package. I'm attempting to first attempt batch inserts but want to fall back to row by row in case an error is encountered. When the error is encountered in the row by row insert, I'd like to kick that out to an error table. My architecture looks like this:
However, I get an error in my Union component because there are multiple ErrorCode and ErrorColumns coming from each flow, one from the batch insert and one from the row by row insert.
I'm attempting to union the error output together in order to not have to duplicate any logic I want to do with my error handling.
What's the best solution for dealing with this? Is there a way to remove columns from a data flow?