[Azure AI Studio] Error when deploying Mistral AI model. Download failed

Question

Ha Vu, SF-G-2 30

Hello all, I am trying to deploy the mistral language model in Azure AI Studio. But I get following error: User's image

Could you help me? EDIT: This error applies for any model in the azure studio catalog

BR

romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2024-01-15T14:31:42.89+00:00

@Ha Vu, SF-G-2 Are there any restrictions on the storage account that is used in this case? As it fails to download, I think this could be a permission issue with the storage account linked to the studio resource.
Ha Vu, SF-G-2 30 Reputation points

2024-01-16T08:10:41.9166667+00:00

Yes, the storage account can only be accessed from selected VPC and IPs and I can't change that
Ha Vu, SF-G-2 30 Reputation points

2024-01-17T08:47:17.3266667+00:00

Yes, thanks. It works now. Is there an microsoft article or code sample, which shows how to use real time endpoints models?
romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2024-01-17T09:31:15.9833333+00:00

@Ha Vu, SF-G-2 I think you can use this document from Azure ML, invoking an endpoint. As per Azure AI studio documentation once the deployment is complete it should provide a consume section on deployment details page to consume the endpoint.
romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2024-01-30T13:58:26.18+00:00

@Ha Vu, SF-G-2 Did you get a chance to review below suggestion? Thanks!!

1 answer

romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2024-01-15T14:31:42.89+00:00

@Ha Vu, SF-G-2 Are there any restrictions on the storage account that is used in this case? As it fails to download, I think this could be a permission issue with the storage account linked to the studio resource.
Ha Vu, SF-G-2 30 Reputation points

2024-01-16T08:10:41.9166667+00:00

Yes, the storage account can only be accessed from selected VPC and IPs and I can't change that
Ha Vu, SF-G-2 30 Reputation points

2024-01-17T08:47:17.3266667+00:00

Yes, thanks. It works now. Is there an microsoft article or code sample, which shows how to use real time endpoints models?
romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2024-01-17T09:31:15.9833333+00:00

@Ha Vu, SF-G-2 I think you can use this document from Azure ML, invoking an endpoint. As per Azure AI studio documentation once the deployment is complete it should provide a consume section on deployment details page to consume the endpoint.
romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2024-01-30T13:58:26.18+00:00

@Ha Vu, SF-G-2 Did you get a chance to review below suggestion? Thanks!!

Answer 1

romungi-MSFT 48,906 Microsoft Employee Moderator

@Ha Vu, SF-G-2 Could you please look at the following page to check under which scenario your setup would fall? I think you need to configure a managed virtual network to allow only approved outbound and check if it works.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.