I'm not sure I understand your description here...
They end up with _two_ copies of the voice message in their inbox after playing it back over the phone? Or were you expecting to not see a message in the user's inbox if they accessed it over the phone interface? All voice mail messages are delivered to the inbox of the user regardless unless I'm misunderstanding your description here...