Hey Harsha,
azure front door is definitely a great fit for your use case, we recently implemented here is some documentation from Microsoft cloud best practices for your reference. in addition to front door you might need load balancer in your use case.
https://learn.microsoft.com/en-us/azure/frontdoor/front-door-overview
https://azure.microsoft.com/en-us/resources/templates/front-door-premium-app-service-private-link/
https://learn.microsoft.com/en-us/azure/architecture/guide/technology-choices/load-balancing-overview?toc=%2Fazure%2Ffrontdoor%2Fstandard-premium%2Ftoc.json
let me know if this helps! if you have any specific questions related to integral parts in azure front door I m more than happy to help!