Hi, please ensure you have the latest Nvidia driver installed on the VM from Azure:
https://learn.microsoft.com/en-us/azure/virtual-machines/windows/n-series-driver-setup#nvidia-grid-drivers
As for configuring the display have you tried using the Windows settings app? Are you connecting directly to the VM with RDP or connecting via WVD? Is your session in full screen on a 4K display? Looking forward to seeing your answer.