Hello Daniel,
If understood correctly you want to disable the port when used for management not for load balancing.
If that's the case then you need to do:
CSS11503(config)# restrict web-mgmt
CSS11503(config)# restrict ssh
CSS11503(config)# restrict ftp
HTH
__ __
Pablo