The impact would be that the users who already exist in Duo would also be able to authenticate through SSO for any SSO service provider apps you then configure after enabling Duo SSO.
If there is a concern that the Azure usernames don’t match the usernames of the existing users, the Azure usernames can be added as username aliases to existing users in Duo via Azure directory sync, CSV import, Admin API update, or manual entry. See this guide.