ADFS Rules to control Web Application Proxy Page

Question

Hi all, so i have a client whose ADFS password update page is being published to the internet through an on-prem web application proxy in their DMZ.

However, i wanted to know if it is possible to only allow specific IPs to access this page only when coming through the proxy using ADFS access rules?

(Disabling it is not an option as due to current networking, some services are currently only able to access it by hitting the DMZ first.)

Or is this only possible using firewall rules?

Note: Current environment is 2019 ADFS FBL 4

Thanks.