Hi Dylan,
Under the User or User Template check the setting for "Phone menu" - When exiting the Conversation - Call Action - **Hang Up**
It sounds like your setting would be "Phone menu" - When exiting the Conversation - Call Handler - Opening Greeting.
Cheers!
Rob