Not able to deploy cohere model

Question

I create a new AI project but I'm not able to deploy some models from the marketplace as I always get a 500 error.

Can anyone have a look into this?

Answer 1

Philipp Serrer Greetings & Welcome to Microsoft Q&A forum!

I create a new AI project but I'm not able to deploy some models from the marketplace as I always get a 500 error.

How exactly are you deploying the models? Where are you seeing this issue?
Are you using Azure AI Studio? Please share more details for further assistance.

For Cohere family models, the pay-as-you-go model deployment offering is only available with AI hubs created in available regions.

Also, you need to check on the Role and resource type -

• An Azure AI hub resource.
• An Azure AI project in Azure AI Studio.
• Azure role-based access controls are used to grant access to operations in Azure AI Studio. To perform the steps in this article, your user account must be assigned the Azure AI Developer role on the resource group. For more information on permissions, see Role-based access control in Azure AI Studio.

Also, see How to use Cohere Embed V3 models with Azure AI Studio and Region availability for models in serverless API endpoints for more information.