The difference between when you try to connect to the FTD itself for management purposes and when a remote VPN user tries to connect is that the FTD management accesses are going to be communicated via the FTD management port. However, the remote VPN accesses are going to be relayed by the FTD through the interface configured to reach to the RADIUS server, ISE in this case.
If routing wise the FTD can reach to ISE out of its say inside interface, then the issue could be that the FTD is not added to ISE as a client, in this case the IP address you need to configure on ISE for the FTD would be its inside interface, not the management IP.