Windows 10 : the AltGr button stops working

This issue is something that once in a while bugs me and today I finally investigate it to discover that is was really only due to an active remote desktop (RDP) connection. Either close the connection or bring the RDP client in foreground and press ALT+ENTER. The issue should vanish for all applications.