We found an issue with the vASA software and apparently this is a common problem and it has been escalated to the Cisco development team as of the time I wrote this post.
For anyone Googling this, this was the only mention of this problem on these f...