Get started with Foundry Local

Foundry Local is a local version of Microsoft Foundry that enables local execution of large language models (LLMs) directly on your Windows device. This is a good alternative if you want to go deeper and implement an AI scenario that's not available with the Windows AI APIs.

This on-device AI inference solution provides privacy, customization, and cost benefits compared to cloud-based alternatives. Best of all, it fits into your existing workflows and applications with an easy-to-use CLI and REST API. For more information on Foundry Local, see the Foundry Local documentation.