I see @Kameron Kennemer and thank you for the additional context.
Since you modified your nginx configuration, it may not be taking affect. Make a copy of /etc/nginx/sites-enabled/default
and place it the site home directory. Then, create a startup.sh script that uses the new configuration.
#!/bin/bash
cp /home/site/default /etc/nginx/sites-enabled/default
service nginx reload
Refer to NGINX Rewrite Rules for Azure App Service Linux PHP 8.x for details.