I'm not aware of your network topology, but basically the switch needs to be reachable from your computer on TCP port 22 (SSH) - simply put, if you can ping it and there's no firewall on the way that blocks port 22 (or your IP address, or the switch's IP address), then you shouldn't need VPN.