Vinay,
1.) Confirm that the Remote VPN is up.
2.) Within the VPN Client, confirm which IP address you are assigned from the VPN IP Pool.
3.) Perform a packet capture on the inside interface of SITE A. When you try to connect to a server at Site A, you should see a SYN (Client->Server), SYN-ACK (Server->Client), ACK (Client->Server) to setup the TCP connection. Reference the link below on how to perform and view packet captures:
https://supportforums.cisco.com/docs/DOC-1222
4.) If you see only the SYN packet egress the inside interface of the ASA towards the server, you will need to investigate the routing between the server and the IP address as assigned to the VPN Client.
One command that may come into play here is 'reverse-route'. This keyword, appended to the end of the 'crypto dynamic-map' entry will inject the route of the client into any upstream dynamic routing processes, allowing the return traffic to be received by the client.
http://www.cisco.com/en/US/docs/security/asa/asa82/command/reference/c5.html#wp2235127
Let me know if this helps!
Best Regards,
Kevin