Somehow I managed to solve the issue i did the following:
1: Created an access rule on ipv6 allowing RDP (and removed later) - did not work
2: Enabled upnp - did not work
3: Set the rdp server as DMZ, tested RDP and worked, then removed the server as dmz and it continued to work.
I have no idea why and it doesn't even make sense but it worked...