You can configure cert only authentication on the ASA. You will need to disable XAUTH on the respective remote access tunnel group. Please see the example below.
tunnel-group RAVPN ipsec-attributes
trust-point ciscovpn
isakmp ikev1-user-authentication none