Thanks for asking question! App Service Always On also generate periodic (every 5min) probes to app instances and causing failed requests with error 404, and this can be found in Application Insights. You may try rewriting the Always on path by referring this blog: 404 response code caused by App Services– AlwaysOn feature might be helpful.
Let us know in case issue persists.