Heads Up :
The post you are writing will appear in a public forum. Please ensure all content is appropriate for public consumption. Review the employee guidelines for the community here.
Otherwise (if it continues to fail), enabling debug logging on the second server, performing another authentication via Offline Access, and then examining the duo.log file would be the next troubleshooting step.