Hi there Vinaykumar Srigireddy
Thats a good question and thanks for using QandA platform
To take advantage of the GPU capabilities of Azure N-series VMs, NVIDIA or AMD GPU drivers must be installed. For VMs backed by NVIDIA GPUs, the NVIDIA GPU Driver Extension installs appropriate NVIDIA CUDA or GRID drivers.
The NVIDIA GPU Driver Extension for Windows installs NVIDIA GPU drivers on Windows N-series virtual machines (VMs). Depending on the VM family, the extension installs CUDA or GRID drivers. When you install NVIDIA drivers by using this extension, you accept and agree to the terms of the NVIDIA End-User License Agreement. During the installation process, the VM might reboot to complete the driver setup.
The instructions for manual installation of the drivers, and the list of current supported versions are available for review. For more information, see Install NVIDIA GPU drivers on N-series VMs running Windows.
For more info follow the documentation below
https://learn.microsoft.com/en-us/azure/virtual-machines/sizes-gpu
https://learn.microsoft.com/en-us/azure/virtual-machines/extensions/hpccompute-gpu-windows
If this helps kindly accept the answer.