Hello Nafila,
Thanks for reaching out.
Yes, Azure AD application proxy connector is a lightweight agent that runs only on a Windows Server (2012 R2 or higher version) but you can publish web applications running on servers other than Windows Server as long as AAD proxy connector machine has network connectivity with Non-windows application server (Like: Linux).
This setup to work, you need to have windows server which is connected to same network as backend application server and installed AD application proxy connector on windows server, then you should be able to publish it through Azure AD proxy.
However, you might not be able to use Windows Integrated authentication along with pre-authentication for a non-Windows Server, depending on if the web server supports Negotiate (Kerberos authentication).
Flow would be:
Remote access to on-premises applications through Azure AD Application Proxy: https://learn.microsoft.com/en-us/azure/active-directory/app-proxy/application-proxy
If your backend application does support Kerberos Constrained Delegation (KCD) and you would like to enable Windows Integrated Authentication to experience SSO as shown below then make sure App proxy connector is domain joined and SPNEGO enabled on each App proxy connectors. Hope this helps.
------
Please "Accept the answer" if the information helped you. This will help us and others in the community as well.