Azure AI Studio New Index fail Error while getting storage with MSI

Berry, Kylie 10 Reputation points
2024-05-02T18:23:53.63+00:00

I have created a project in Azure AI studio. I was hoping to do a chat with the Company handbook type of chatbot. All of the videos make it seems as simple as dropping your data in.

The handbook is a PDF and I have uploaded into the data section of the Azure AI Studio project. When I go to try and create an index (from the index tab in the Azure AI Studio project) from this PDF, it will run for 2 hours or so and then will tell me it failed due to error while getting storage with MSI. This error is in the LLM: Crack, Chunk, Embed step.

This seems like it is maybe a role issue since it is having issue getting to storage, but there is not a specific error code or anything.

The data lives within the project in the Azure AI studio. It is a single PDF. The PDF is 3.39 MB. I have done no processing or formatting of the PDF.

The Azure AI Search is basic tier, but was created just for this project so it is open currently.

When I look at the resource that the Hub lives in project has the following roles in the resource:

  • Contributor for the resource group
  • Contributor for the Azure AI Services

The Azure AI services resource has

  • Search Index Data Reader on the with the search service
  • Search Service Contributor with the search service
  • Storage Blob Data Contributor

The search service has the following roles

  • Storage blob data contributor
  • storage account contributor
  • contributor
  • Cognitive services Open AI Contributor

I have the following roles

  • Azure AI Developer
  • Azure AI inference Deployment Operator
  • AzureML Data Scientist
  • Cognitive services contributor
  • Cognitive services OpenAI Contributor
  • Search Index Data Contributor
  • Search service Contributor
  • Storage Blob data Contributor
  • Key Vault Administrator and Secrets officer

Is there some sort of permission that I am missing? Or am I miss interpreting the error message that I am getting.

Any help would be appreciated.

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
799 questions
{count} votes

1 answer

Sort by: Most helpful
  1. romungi-MSFT 43,366 Reputation points Microsoft Employee
    2024-05-03T05:06:55.0766667+00:00

    @Berry, Kylie I think the error indicates a permission issue where the compute did not get access to the storage account. Have you used a serverless compute or the compute that was created from the studio? If you chose compute instance then make sure the compute has MI attached and it is created by the same user who is the owner of the project.

    W.r.t search service, you can switch to standard tier and back after retrying the scenario just to eliminate any issues with the search service hitting its limits. Thanks!!

    0 comments No comments