Hey dgaikwad,
Are you permitting all traffic in authz profile? If specific, can you please share your authz profile settings.
Are you facing issues with Remote desktop connection only? What about the other traffic?
Also can you please share your switch logs at the time you are testing Remote desktop connection and endpoint is losing it's IP.
Spooster IT Services Team