Can you give us more information? is this SD-WAN ? is this vEDGe or cEDGE ? what is the version of code ? some config snipped for to understand.
as per I know there is a small delay of 7 seconds to take failover. Are you looking at tunnel interface as last resort?