If you want to totally restrict certain serverservers, then the Windows Firewall should be configured to the restriction.
If you need to prevent a specific login from connecting, then of course you would need to manage that login's rights to the server.
Depending on the granularity of what you need to do, you might need to use both approaches.