Getting an error in deployment of Model as a service

Question

Model deployment for Llama 3.1 8B

We are facing issues as below while trying to deploy a Llama 3.1 8B model as Model as a service Serverless API (pay as you go) plan.
Cannot create marketplace subscription Cannot create Azure Marketplace subscription.

Any help appreciated.

Answer 1

Hi @Aaloka Anant,

Thank you for reaching out to Microsoft Q&A forum!

It seems that Azure AI Studio's model catalog offers different ways to deploy models, including using managed compute or serverless API (Model-as-a-Service) with pay-as-you-go billing. You're trying to deploy the Llama 3.1 8B model as a serverless API, but you're encountering issues with Azure Marketplace subscription creation.

Make ensure that your Azure subscription supports the necessary regional availability and billing account setup. Serverless API deployments are only available to users whose Azure subscription belongs to a billing account in a supported country where the model provider has made the offer available. Additionally, check if the Hub/Project is in a region where the Llama 3.1 8B model is available for deployment. Ensure your Azure Marketplace subscription is aligned with the marketplace terms for third-party models and that your Azure account is correctly set up for pay-as-you-go billing.

If network issues or public access settings are causing problems, review and adjust the public network access flag for your AI Studio hub and verify that your networking configuration allows communication with the model service. You may also want to explore deploying the model with Managed Compute, which offers more control over networking and virtual machine quotas.

For more info: Model catalog and collections in Azure AI Studio.

I hope you understand. Thank you.