You don't say what kind of VOIP phone, but as a rule the media packets (voice) will use UDP, and the control packets (call setup) will use TCP. If you are seeing lots of ICMP packets I would be very curious to know specifically what type of ICMP -- port unreachables, echos (pings), or ip redirects.