@Joshua-3609 Thanks for sharing details, after internal discussion on this it came out that, it is required to restart the site to pick up changes, specially if those are manually added.
If you use any of the publishing methods such as Maven or CLI (OneDeploy command: az webapp deploy …), we will schedule the restart after copying the files.
Hope this helps, Let us know.