We have no stacking module installed, just pull out the power cords for like 5 minutes and it booted up fine.

So glad I found this forum post. Indeed power off for about 20 seconds didn't work. I left it for 5 minutes off and then it was booting fine.