Fail to deploy the fine-tuned model on LLama 2

Chen, Xiaoyi 0 Reputation points
2024-02-29T22:11:19.2533333+00:00

We successfully fine-tuned the LLama-2-7b but we cannot deploy it. Errors after about 5 min when deploying the model. Can't seem to find much detail for the error. Our region is WestUS. The fine-tuning is completed: User's image

But deployment failed: User's image

Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,766 questions
{count} votes

1 answer

Sort by: Most helpful
  1. romungi-MSFT 44,661 Reputation points Microsoft Employee
    2024-03-05T04:14:48.8033333+00:00

    @Chen, Xiaoyi There should be a tab to show the logs with more details like below from ML studio endpoints page.

    User's image

    You can also report this error through ML studio feedback smiley icon on the top right hand side. Thanks!!

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.