How to use llama 3.2 vision with dedicated endpoint

Adriano Freitas 0 Reputation points
2024-11-07T23:48:48.2+00:00

I'm trying to access a Llama 3.2 11b Vision model, deployed on a dedicated endpoint, but the sample code does not work:

Screenshot 2024-11-07 at 20.40.48

This is the error on logs:

Screenshot 2024-11-07 at 20.41.28

When using azure.ai lib it was not successful either:

Screenshot 2024-11-07 at 20.44.34

Any thoughts?

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,350 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Adriano Freitas 0 Reputation points
    2024-11-08T11:30:42.3733333+00:00

    Hi @santoshkc , thanks for your reply.

    The region is centralus, and the sample code is the first image. This is exactly the same code provided under the 'Consume' tab, on 'Endpoints'.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.