Sounds like a there might be a memory leak, have you try poolmon, I've had success using in the past to finding memory leak issues.
We are running a Windows 2019 core edition with features on demand (on prem server). The server is actually a Azure Application Proxy Connector.
The configuration is a 4 vcpu w/ 16GB RAM
We had several connection issues today and after troubleshooting using perfmon / sysinternal tools that the high memory was caused by the Page Table that is close to 5GB.
The Free system page table entry is not a problem... over 10 000 000 free.
The system cache resident bytes is low... around 200MB
Any hints ?