Successfully Deployed Grok-3 but Can’t Use It for Agent Creation

Question

Hi everyone,

I’ve just successfully deployed the Grok-3 model in my Azure OpenAI environment—everything shows as “Succeeded” under Model deployments (see screenshot 1.png). 🎉

However, when I try to create a new Agent and select a model for deployment (for example, to add personal resources like PDFs for grounding), the Grok-3 model does not appear in the deployment dropdown (screenshot2.PNG). Instead, I only see the gpt-4o deployment as an option.

My Setup:

Grok-3 deployment status: ✅ Succeeded

Deployment type: Global Standard

Model version: v1

Goal: To create an agent that can reference my own documents (e.g. PDFs)

Issue: Grok-3 does not appear in the deployment list when assigning to an agent

Answer 1

Hello Sajeda Sultana,

Thank you for posting your question in the Microsoft Q&A forum. 

The absence of Grok-3 in your agent deployment dropdown despite successful model deployment suggests a compatibility limitation in Azure AI Studio’s current integration. While Grok-3 is available for inference, Azure AI Agents (as of June 2024) only support select models like GPT-4o for document grounding and agent-based workflows. 

Key observations and workarounds you may try: 

• Platform Limitation: Azure AI Agents don’t yet support Grok-3 for RAG (Retrieval-Augmented Generation) or PDF processing. 
• Alternative Paths: 
  • Use Grok-3 via direct API calls for inference, then manually integrate outputs with your documents. 
  • Pair GPT-4o (for grounding) with Grok-3 (for final responses) using a hybrid orchestration layer. 
• Future Updates: Microsoft is expanding model support monitor the Azure Updates page for Grok-3 agent compatibility using the link here - https://azure.microsoft.com/en-us/updates/

For immediate needs, consider using Azure AI Search with GPT-4o for document processing, then pass curated context to Grok-3 via chained APIs. 

If the above answer helped, please do not forget to "Accept Answer" as this may help other community members to refer the info if facing a similar issue. Your contribution to the Microsoft Q&A community is highly appreciated. 

Answer 2

Hi Sajeda Sultana

Even though you've successfully deployed the Grok-3 model in your Azure OpenAI environment and the deployment status shows as “Succeeded,” the model currently does not appear in the dropdown list when creating a new Agent in Azure AI Studio.

This issue arises because, as of now, the Grok-3 model is not yet supported for use within the Azure AI Studio Agent framework, particularly for scenarios involving grounding with personal documents like PDFs.

To work around this limitation, you can use supported models such as GPT-4o or GPT-4-turbo, which are fully compatible with the Agent creation workflow and document grounding features.

If your use case specifically requires Grok-3, you might consider building a custom function solution using the Azure OpenAI REST API or SDKs, then you can use it as tool to AI agent.

Reference : Models supported by Azure AI Foundry Agent Service

Hope it helps

Thank you