How to get endpoint URI for finetuned LLM

Freddie 10 Reputation points
2024-07-10T14:21:42.07+00:00

I've deployed a GPT-4 model in Azure AI Studio, but the Target URI in the Endpoint section is missing (shows as "---"). The deployment seems successful otherwise, with an API key provided. How can I obtain the correct endpoint URI for my deployed model? Screenshot 2024-07-10 1515392.png

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,961 questions
{count} votes

1 answer

Sort by: Most helpful
  1. tomups-7201 0 Reputation points
    2024-10-27T13:34:13.2633333+00:00

    I have the same problem.

    The trick I did was to go to the Chat playground and inspect the network requests when sending a message - you can see the endpoint used that way.

    User's image

    It will most likely have this format:

    https://<resource>.openai.azure.com/openai/deployments/<deployment name>/chat/completions?api-version=2024-08-01-preview

    The API version might be different for you depending on the fine-tuned model, so check the network request to make sure.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.