I'm using Azure/Entra ID Application Proxy with an on-prem Windows Server running IIS. It successfully routes traffic to our homepage (web01.local/home/), but I'm facing issues with navigation links to resources on different servers. For instance, clicking a link meant for a SharePoint server (sharepointserver.local/documents/test) incorrectly tries to navigate via the homepage server URL (web01.local/documents/test), which doesn't work because it's the wrong server. Obviously, this works on prem since each navbar is just linked to the internal URL for each local machine, which are all accessible on prem, but the App Proxy doesn't know how to translate to something publicly available with these conditions.
Has anyone tackled this problem of configuring the Application Proxy to correctly handle URLs for resources across multiple servers? Would the best solution here be to create an app proxy for each server, then adjust the navigation links to point to the respective Application Proxy URLs instead of relying on internal DNS names?