Hello @ashutosh upadhyay ,
Here is a similar thread that would help in understanding how to deploy Fast API on azure using azure app service
deploy-fastapi-on-azure
deploy-fastapi-and-uvicorn-on-azure-app-service
(If the response was helpful please don't forget to upvote and accept as answer, thank you)