The firewalls ended up being primary with the same address and MAC. I later notice looking at the logs that both were going back an forth from primary to secondary 3 to 4 times a day since the upgrade. After it did that twice during the same weekend I decided to go back to 6.2.3 since no problem. I have not seen this problem documented anywhere. I have a colleague running 6.3.3 on a pair of 515 without any problem.
