From above description I could understand that you are looking to deploy firewall host policy on windows server endpoints.
Please do correct me if this is not the ask by responding in comments section or follow the suggestion below.
- Go to the Microsoft Defender portal (https://security.microsoft.com), and sign in.
- In the navigation pane, choose Device configuration. Policies are organized by operating system and policy type.
- Select an operating system tab (such as Windows clients).
- Expand Firewall to view your list of policies.
If you don't have any further queries and the suggestion above answers your ask, please "Accept the answer", This will help us and others in the community as well.
Thanks,
Akshay Kaushik