No conflict - I've done it many times. Both listen on tcp/443 but the URLs are different.
Remote access VPN (AnyConnect clients) use (by default) simply the interface IP address. (You can optionally specify a more specific FQDN for different connection profiles.)
ASDM uses https://<IP address>/admin.