You can use the Azure CLI command az webapp cors remove --allowed-origins to remove CORS. From the portal, search for CORS under your app service and remove any origins that's listed.
You are correct on the following:
Every literature I could find indicates that if the CORS config in the Azure portal is completely blank then the application would be responsible for handling these requests but that does not seem to be the case currently.
Since you don't have any listed origins, the issue may be something else. I'm assuming you enabled CORS like https://learn.microsoft.com/en-us/aspnet/core/security/cors?view=aspnetcore-5.0? Can you elaborate further on the issue you're seeing?
Regards,
Ryan