Unsupported credential error from azure.ai.inference to use Llama

Question

Unsupported credential error from azure.ai.inference to use Llama

strawberrybfs 5

Hi, I was trying to use Llama model following this tutorial:

https://learn.microsoft.com/en-us/azure/ai-studio/how-to/deploy-models-llama?tabs=python-llama-3-2%2Cmeta-llama-3-1&pivots=programming-language-python

However, I'm not sure if my credential is correct. I'm using the following format where your-host-name is my AZURE_INFERENCE_ENDPOINT is target in the screenshot and AZURE_INFERENCE_CREDENTIAL is the key in the screenshot. Then I had this error "TypeError: Unsupported credential: "

Can anyone help? Thank you!

Screenshot 2024-11-23 at 9.09.32 PM

client = ChatCompletionsClient( endpoint=os.environ["AZURE_INFERENCE_ENDPOINT"], credential=AzureKeyCredential(os.environ["AZURE_INFERENCE_CREDENTIAL"]), )

Avinash Devarakonda 615 Reputation points Microsoft External Staff

2024-11-25T06:49:25.6433333+00:00
Hi strawberrybfs,

Welcome to Microsoft Q&A Forum, thank you for posting your query here!

The error "TypeError: Unsupported credential" suggests that the credential you are using may not be compatible with the ChatCompletionsClient. In your case, you are using AzureKeyCredential, which is appropriate for endpoints that require a key for authentication.

if your model was deployed with Microsoft Entra ID support, you should use DefaultAzureCredential instead of AzureKeyCredential. This is particularly important if your endpoint does not require a key.

Here’s how you can modify your client initialization:

from azure.identity import DefaultAzureCredential client = ChatCompletionsClient( endpoint=os.environ["AZURE_INFERENCE_ENDPOINT"], credential=DefaultAzureCredential(), )

Make sure that your endpoint was deployed with Microsoft Entra ID support and that you have the required permissions to invoke it.

Thank You.
Avinash Devarakonda 615 Reputation points Microsoft External Staff

2024-11-27T02:29:25.1866667+00:00

Hi strawberrybfs,

Following up to see if the given response was helpful.

Thank You.
Avinash Devarakonda 615 Reputation points Microsoft External Staff

2024-11-29T08:56:03.0566667+00:00

Hi strawberrybfs,

We haven’t heard from you on the last response and was just checking back to see if the give response was helpful.

Thank You.