Hi @Yash ,
I confirmed with our engineering team that Windows Admin Center deployed in Azure is currently only available to manage Azure IaaS VMs and not for on-prem management. This is something on their roadmap for looking at a future release, but there isn't anything further I can share at this time.
Thanks so much!
Trent