I suppose the switch is L2 only?
What are the subnet masks used?
I suppose the switch IP address and the server IP address are NOT in the same subnet?
So what is the default gateway configured on the switch?
What does traceroute to the server show?
Can you compare with the output from the switch which Pings successfully?