@Davis, Daniel Thank you for reaching out.
Your web app needs to authenticate and access the Azure SQL Database via a managed Identity.
A detailed tutorial is here to guide you with the process.
Please follow the steps and get back to us if you still face any issues.
If an answer is helpful, please "Accept answer" or "Up-Vote" which might help other community members reading this thread.