Hi Luke Kim ,
Welcome to the Microsoft Q&A Platform! Thank you for asking your question here.
Please go through this document: https://learn.microsoft.com/en-us/entra/identity/conditional-access/howto-conditional-access-policy-location to enable access to AVD windows with allowed IP addresses only.
If you have any further queries, do let us know.
If the answer is helpful, please click "Accept Answer" and "Upvote it."