Hello,
First, I would recommend to check in Task Manager what is the cause of the memory usage, even it is very likely that it is all consumed by users sessions, you may like to investigate if there are specific RDS applications used by those users that needs high memory capability.
At first glance, your hardware allocation is not enough to host that amount of users. Remember that RDP uses the resources in the host server, meaning each user session will represent the needs as per 1 session of Windows. If we can consider that the minimum requirement for Windows 10 is 1GB of RAM, after 10-12 users connected you should already be experiencing some lag.
For a 50 user RDS server, the orientative recommendation would be:
- A processor with at least 8 cores and 16 threads, preferably Xeon family due to the high CPU Cache memory in order to provide fluent GUI experiences.
- A minimum of 64GB RAM to support user sessions and running applications. If the running applications for each user session are memory demanding, it should be considered to increase the system RAM memory.
--If the reply is helpful, please Upvote and Accept as answer--