Do you have anyother IP addresses available other than the "outside" ip address??
If not - a possible solution would still be to PAT, but write an acl that only allows these 3 users to access the external site. Then you only have to give the provide the external IP.
This is not ideal - but it is a solution.
HTH>