Assuming your hardware is sized to accommodate the load, there's no technical reason why you cannot combine them. (Also assuming you're not terminating your site-site VPNs on a multi-context mode firewall since remote access VPN isn't supported for those.)
The more common reason I see is to distribute across units is to lessen the operational risk and impact - i.e. if something goes wrong it only affects one type of connection or a subset of your users.
One other thing is that remote access VPNs of that size are sometimes supported via use of a VPN cluster while remote access VPNs don't support VPN cluster technology per se.