Welcome to Microsoft Q&A and thank you for posting your questions here.
To understand your question, you would like to use Azure App Service for authentication and as front-end for Azure API, also; you would like to know how to go about doing this and if there any templates that exist that you can use for a start.
Yes, you can use Azure App Service as a frontend for your Azure APIM instance.
To use for front-end for Azure API, Authentication, how to go about it and different work around and scenarios could be found in the link below.
Create a Front Door for a highly available global web application.
The link will guide you to use step by steps for standard/premium or classic with images.
Hope you find this helpful! To let the community and other users know this answer is useful, kindly vote for it. Do not hesitate to contact if you have more questions.
Best Regards,
Sina