You can try assigning a small /30 subnet from your public IPs using one of your ASA interface and connecting it to the 'Public'.
That way you can make use of a public IP for your server and connect it to this interface.
As for routing wise, set your default route via the 'Public' interface and static routes individually for the internal LANs.