I think I found the cause.
At least it is now working.
On the SIP trunk security profile the three check boxes below were unchecked where the integration document says they should be checked.
Accept Out-of-Dialog Refer
Accept Unsolicited Notification
Accept Replaces Header
Set them to checked, reset the trunk and all was good.
The perils when someone else builds the servers and integration.