Edit

Windows ML execution providers

Windows ML provides execution providers for accelerating inference on NPU, GPU, and CPU. To learn more about accelerating inference, see Accelerate AI models.

Included execution providers

The following execution providers are included with Windows ML:

Available execution providers

Unlike the included providers, the execution providers below are not included with Windows ML — they're downloaded on demand.

The execution providers listed below are available on Windows 11 PCs running version 24H2 (build 26100) or greater (depending on device and driver compatibility) for dynamic download via the Windows ML ExecutionProviderCatalog APIs. To use these providers, see Install Windows ML EPs and Register Windows ML EPs. To see what version of each EP is currently available and info about upcoming releases, see Windows ML Execution Provider Releases.

The following execution providers are available to developers using Microsoft.WindowsAppSDK.ML or Microsoft.Windows.AI.MachineLearning version 2.x:

Execution provider EpName Vendor
MIGraphX MIGraphXExecutionProvider AMD
NvTensorRtRtx NvTensorRtRtxExecutionProvider NVIDIA
OpenVINO OpenVINOExecutionProvider Intel
QNN QNNExecutionProvider Qualcomm
VitisAI VitisAIExecutionProvider AMD
WebGPU (Experimental) WebGpuExecutionProvider Microsoft

Before your app uses an execution provider, please be sure to read the licenses corresponding to the execution provider. For the full list of third-party license terms, see Windows ML third-party notices.

MIGraphX (AMD)

  • EpName: "MIGraphXExecutionProvider"
  • Requirements:
    • AMD RDNA 3 or later GPU
    • AMD GPU driver version 25.10.13.09 or later
    • This execution provider is not supported for GenAI scenarios today.
  • Documentation: Documentation
  • Support: Support
  • License terms: See MIGraphX in Windows ML third-party notices.
  • Version and release history: Windows ML Execution Provider Releases

NvTensorRtRtx (NVIDIA)

OpenVINO (Intel)

QNN (Qualcomm)

  • EpName: "QNNExecutionProvider"
  • Requirements:
    • Snapdragon(R) X Elite - X1Exxxxx
      • Qualcomm(R) Hexagon(TM) NPU with minimum driver version 30.0.140.0 and above
    • Snapdragon(R) X Plus - X1Pxxxxx
      • Qualcomm(R) Hexagon(TM) NPU with minimum driver version 30.0.140.0 and above
  • Documentation: Documentation
  • Support: Support
  • License terms: See QNN in Windows ML third-party notices.
  • Version and release history: Windows ML Execution Provider Releases

VitisAI (AMD)

  • EpName: "VitisAIExecutionProvider"
  • Requirements:
    • Min: Adrenalin Edition 25.6.3 with NPU driver 32.00.0203.280
    • Max: Adrenalin Edition 25.9.1 with NPU driver 32.00.0203.297
  • Documentation: Documentation
  • Support: Support
  • License terms: See VitisAI in Windows ML third-party notices.
  • Version and release history: Windows ML Execution Provider Releases

WebGPU (experimental)

Important

WebGPU EP is experimental and requires installing experimental NuGet packages. It is not available in Windows ML 1.8.x. For full usage details, see WebGPU EP.

Version and release history
MSIX version WebGPU EP release notes
0.4.0.0 0.4.0
0.3.0.0 0.3.0
0.2.1.0 0.2.1
0.1.0.0 0.1.0

See also

  • Last updated on