Edit

Windows ML execution providers

Windows ML provides execution providers for accelerating inference on NPU, GPU, and CPU. To learn more about accelerating inference, see Accelerate AI models.

Included execution providers

The following execution providers are included with the ONNX Runtime that ships with Windows ML:

Available execution providers

Unlike the CPU and DirectML providers, which ship in-box (see Included execution providers), the execution providers below are not included with the runtime — they're downloaded on demand.

The execution providers listed below are available on Windows 11 PCs running version 24H2 (build 26100) or greater (depending on device and driver compatibility) for dynamic download via the Windows ML ExecutionProviderCatalog APIs. To use these providers, see Install Windows ML EPs and Register Windows ML EPs. To see what version of each EP is currently available and info about upcoming releases, see Windows ML Execution Provider Releases.

The following execution providers are available to developers using Microsoft.WindowsAppSDK.ML or Microsoft.Windows.AI.MachineLearning version 2.x:

Execution provider EpName Vendor
MIGraphX MIGraphXExecutionProvider AMD
NvTensorRtRtx NvTensorRtRtxExecutionProvider NVIDIA
OpenVINO OpenVINOExecutionProvider Intel
QNN QNNExecutionProvider Qualcomm
VitisAI VitisAIExecutionProvider AMD
WebGPU (Experimental) WebGpuExecutionProvider Microsoft

Before your app uses an execution provider, please be sure to read the licenses corresponding to the execution provider.

MIGraphX (AMD)

NvTensorRtRtx (NVIDIA)

OpenVINO (Intel)

QNN (Qualcomm)

VitisAI (AMD)

WebGPU (experimental)

Important

WebGPU EP is experimental and requires installing experimental NuGet packages. It is not available in Windows ML 1.8.x. For full usage details, see WebGPU EP.

Version and release history
MSIX version WebGPU EP release notes
0.4.0.0 0.4.0
0.3.0.0 0.3.0
0.2.1.0 0.2.1
0.1.0.0 0.1.0

See also