I tried version 16.43 and the current 17.05 on Win 10 and it worked fine.
When launched from an admin command prompt I see a check mark toggle.
As you pointed out, it creates a Debugger value. But I found that twice, once in the 64 bit section and also in the 32 bit section of the registry.
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows NT\CurrentVersion\Image File Execution Options\taskmgr.exe
HKEY_LOCAL_MACHINE\SOFTWARE\WOW6432Node\Microsoft\Windows NT\CurrentVersion\Image File Execution Options\taskmgr.exe
Maybe one is getting deleted and the second one isn't? Remember to hit F5 to refresh if you are looking with regedit.