Skip to main content
added 1648 characters in body
Source Link

My preference is to install SSIS on a separate server from my main database instance. Here's why.

SSIS is, for the most part, a standalone application. As such, it also has its own resource needs, and consumes CPU and memory resources, just as any other applicationneeded. There are going to be times when SSIS spikes CPU and memory, and limits SQL Server from getting the CPU and memory resources it would like. Similarly, SQL Server can spike CPU and memory, and limit SSIS from getting the CPU and memory it would like.

It's much more difficult to balance the CPU and memory needs between two applications on one server, than it is to isolate them to their own VM, and scale them appropriately. As such, you'llto do so you would need to account for that when sizing your servers to support both and settingalso set your max server memory settings in SQL Server, to ensure enough memory is available for SSIS. It's simply a head-ache I prefer to avoid, if at all possible.

With Virtualization these daysInstead, it's easysize your SQL Server to takesupport your SQL Server workload. For example, if under peak load, your SQL Server requires 8 CPUs and 64 GB of RAM, build a SQL VM with that as your baseline. Now, if SSIS needs 2 CPUs and 16 GB of RAM, those needs are a net addition to the additional CPU8 CPUs and 64 GB of RAM you've already decided you would have allocationneed for SQL Server.

Should you choose to run these two on the one large clustersame server, you're looking at 10 CPUs and instead78 GB for RAM. Typically, either way you slice of that piece off and give it, you need the same number or resources to run the two services. The question comes down to whether you want to try to manage them on the same server.

With Virtualization these days, it's almost a smaller VM thatnone issue. Simply slice up the CPU and memory resources you dedicatewant for each service, and give each its own VM to SSISrun on.

This will make performance issues much easier to troubleshoot down the road. All too many times I have seen scenarios where a DBA struggles to figure out if it is SSIS or SQL that is the problem when performance issues arise on a single server.

Take for example CPU spike to 100% while an SSIS package runs. Is this related to bad queries pulling data out of your OLTP database, or instead inefficiencies within SSIS package and overall ETL process?

With the two services running on separate servers, you can easily see which server has its resources spike the most during your SSIS process, and tackle the component head on. You also prevent one service from impacting the other, since they no long share a server.

With that said, you can beforealso refere to the Scale Out support for high availability on MS Docs to help make SSIS highly available when not installed along side SQL Server on the same cluster.

My preference is to install SSIS on a separate server from my main database instance. SSIS consumes CPU and memory resources, just as any other application would. As such, you'll need to account for that when sizing your servers and setting your max server memory settings in SQL Server, to ensure enough memory is available for SSIS. It's simply a head-ache I prefer to avoid, if at all possible.

With Virtualization these days, it's easy to take the additional CPU and RAM you would have allocation to the one large cluster, and instead slice of that piece off and give it to a smaller VM that you dedicate to SSIS.

This will make performance issues much easier to troubleshoot down the road. All too many times I have seen scenarios where a DBA struggles to figure out if it is SSIS or SQL that is the problem when performance issues arise on a single server.

With that said, you can before to the Scale Out support for high availability on MS Docs to help make SSIS highly available.

My preference is to install SSIS on a separate server from my main database instance. Here's why.

SSIS is, for the most part, a standalone application. As such, it also has its own resource needs, and consumes CPU and memory, as needed. There are going to be times when SSIS spikes CPU and memory, and limits SQL Server from getting the CPU and memory resources it would like. Similarly, SQL Server can spike CPU and memory, and limit SSIS from getting the CPU and memory it would like.

It's much more difficult to balance the CPU and memory needs between two applications on one server, than it is to isolate them to their own VM, and scale them appropriately. As such, to do so you would need to account for sizing your servers to support both and also set your max server memory settings in SQL Server, to ensure enough memory is available for SSIS. It's simply a head-ache I prefer to avoid, if at all possible.

Instead, size your SQL Server to support your SQL Server workload. For example, if under peak load, your SQL Server requires 8 CPUs and 64 GB of RAM, build a SQL VM with that as your baseline. Now, if SSIS needs 2 CPUs and 16 GB of RAM, those needs are a net addition to the 8 CPUs and 64 GB of RAM you've already decided you need for SQL Server.

Should you choose to run these two on the same server, you're looking at 10 CPUs and 78 GB for RAM. Typically, either way you slice, you need the same number or resources to run the two services. The question comes down to whether you want to try to manage them on the same server.

With Virtualization these days, it's almost a none issue. Simply slice up the CPU and memory resources you want for each service, and give each its own VM to run on.

This will make performance issues much easier to troubleshoot down the road. All too many times I have seen scenarios where a DBA struggles to figure out if it is SSIS or SQL that is the problem when performance issues arise on a single server.

Take for example CPU spike to 100% while an SSIS package runs. Is this related to bad queries pulling data out of your OLTP database, or instead inefficiencies within SSIS package and overall ETL process?

With the two services running on separate servers, you can easily see which server has its resources spike the most during your SSIS process, and tackle the component head on. You also prevent one service from impacting the other, since they no long share a server.

With that said, you can also refere to the Scale Out support for high availability on MS Docs to help make SSIS highly available when not installed along side SQL Server on the same cluster.

Source Link

My preference is to install SSIS on a separate server from my main database instance. SSIS consumes CPU and memory resources, just as any other application would. As such, you'll need to account for that when sizing your servers and setting your max server memory settings in SQL Server, to ensure enough memory is available for SSIS. It's simply a head-ache I prefer to avoid, if at all possible.

With Virtualization these days, it's easy to take the additional CPU and RAM you would have allocation to the one large cluster, and instead slice of that piece off and give it to a smaller VM that you dedicate to SSIS.

This will make performance issues much easier to troubleshoot down the road. All too many times I have seen scenarios where a DBA struggles to figure out if it is SSIS or SQL that is the problem when performance issues arise on a single server.

With that said, you can before to the Scale Out support for high availability on MS Docs to help make SSIS highly available.