Basically this is possible.
You need generally in addition to the Azure WVD requirements:
- Site-To-Site VPN Connection from Azure to on-premises.
- Routing Azure <-> on-premises
- DNS name resolution - Azure resources and on-premises resources
(If the reply was helpful please don't forget to upvote and/or accept as answer, thank you)
Regards
Andreas Baumgarten