Even if you created a policy route (PBR) on the ASR to force the traffic to the inside host, the problem is that the IP header on the packet still has the wrong destination IP. The end host would receive the packet and immediately drop it because the public IP isn't installed on any of its interfaces. You have to have translation somewhere if you're not going to use the real IP of the inside host.
