I think that the failed pings might be due to packet loss. Please check if you have CEF and tunnel checksum enabled. If that is true, then packed loss is most certainly the cause. I remember reading somewhere that high packet loss is observed when both CEF and tunnel checksum are enabled. You could turn off one of the two and things should work just fine.