@Ziggy Zulueta, Thanks for posting in Q&A. Based on my researching, Conditional access policy has a feature nemed location. You can create Office location.
https://learn.microsoft.com/en-us/entra/identity/conditional-access/location-condition
Then create conditional access policy to block any location access exclude the office location:
Hope the above information can help.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.