Hi Askshay,
I believe you have to put the computers that you don't want to apply to this group, since it is a domain GPO at the computer level.
Test it.
Another issue is to see if in your domain, on the DC where you are configuring this policy, it is replicating the GPO/GPO settings to the other domain controllers.
As a result, after doing this, you can open the CMD as an administrator and run:
gpupdate /force
After that, restart the workstation.
Open the CMD again, as an administrator and type
gpresult /r to validate if the GPO is in fact applied.
And another command would be rsop to validate if the configuration is being applied on the workstation.
I am at your disposal