Hello MerteSakker-2385,
Thank you for posting in our Q&A forum.
Based on the description, I understand the servers you mentioned are in the domain, and the groups (such as Exchangeserver1-LocalAdmin) that matches these server names are in the also domain.
I think you can do it via two methods.
Method 1
Create one OU for each server.
Server1OU puts Server 1, create a GPO1 and link it to Server1OU, edit GPO1 with add server1-LocalAdmin to local Administrators.
Server2OU puts Server 2, create a GPO2 and link it to Server2OU, edit GPO2 with add server2-LocalAdmin to local Administrators.
Server3OU puts Server 3, create a GPO3 and link it to Server3OU, edit GPO3 with add server3-LocalAdmin to local Administrators.
Method 2
Create one OU for all the servers.
ServerOU puts all the servers.
Create one GPO for each server.
Create GPO1 and link it to ServerOU, edit GPO1 with add server1-LocalAdmin to local Administrators (we can use Security Filtering to make GPO1 only apply to server1, that is make Authenticated Users only has Read permission, we should uncheck Apply Group Policy permission, and add server1 with Read permission and Apply Group Policy permission).
Create GPO2 and link it to ServerOU, edit GPO2 with add server2-LocalAdmin to local Administrators (we can use Security Filtering to make GPO2 only apply to server2, that is make Authenticated Users only has Read permission, we should uncheck Apply Group Policy permission, and add server2 with Read permission and Apply Group Policy permission).
.
Create GPO3 and link it to ServerOU, edit GPO3 with add server3-LocalAdmin to local Administrators (we can use Security Filtering to make GPO3 only apply to server3, that is make Authenticated Users only has Read permission, we should uncheck Apply Group Policy permission, and add server3 with Read permission and Apply Group Policy permission).
Hope the information above is helpful.
Best Regards,
Daisy Zhou
============================================
If the Answer is helpful, please click "Accept Answer" and upvote it.