Hello @noah a,
welcome to this moderated Azure community forum.
According to this blog post, you need to enable the logs:
Navigate to your Windows Web App and select the "App Service Logs" option under the "Monitoring" section in the left pane. Toggle the "Application Logging (Filesystem)" option to On...
Do you see this setting?
If needed, refresh the page to be sure the setting is picked up.
If the response helped, do "Accept Answer". If it doesn't work, please let us know the progress. All community members with similar issues will benefit by doing so. Your contribution is highly appreciated.