An SSIS package keeps failing for no reason. There are only three lookup transform components in the package (besides the source and output component), two running in partial cache mode and the other in full cache mode. Each lookup will need to find records among tens of millions of entries.
When the full-cached component have cached around 10M records the data flow will fail. The only error message is "Data flow task failed" (no error code provided). At that time the server has 15% free memory, and SSIS uses up about 3GB. There is no warning about memory space during execution. Windows Server and SQL Server are 64 bit, but I'm not sure about Visual Studio BIDS.