Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
3,279 questions
Issue with Automatic Index Update in Azure OpenAI Studio Using BLOB Storage
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 30%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETS%3C/text%3E%3C/svg%3E)
tsuzuki-s
60
Reputation points
I want to create a Retrieval-Augmented Generation (RAG) system using Azure OpenAI, Azure AI Search, and a Storage Account. When selecting the data source as Blob Storage in OpenAI Studio, the index should automatically update when documents are added or deleted within the storage.
However, when I add documents to the storage later, the index connected to the chat playground in OpenAI Studio does not update. I set the update interval to 5 minutes, but the index not connected to OpenAI Studio is being updated instead.
{count} votes
-
romungi-MSFT 47,531 Reputation points Microsoft Employee2024-05-21T15:39:17.3133333+00:00 @tsuzuki-s If the setup is done from the studio where the storage account and the search index is selected, the indexer schedule is only as per the below screenshot.
-
tsuzuki-s 60 Reputation points
2024-05-30T08:39:32.16+00:00 According to the official document, it is required to set index schedule other than "Once" if you want to upload the indexes automatically.
After the data ingestion is set to a cadence other than once, Azure AI Search indexers will be created with a schedule equivalent to
0.5 * the cadence specified. This means that at the specified cadence, the indexers will pull, reprocess, and index the documents that were added or modified from the storage container. This process ensures that the updated data gets preprocessed and indexed in the final index at the desired cadence automatically. To update your data, you only need to upload the additional documents from the Azure portal. From the portal, select Storage Account > Containers. Select the name of the original container, then Upload. The index will pick up the files automatically after the scheduled refresh period. The intermediate assets created in the Azure AI Search resource won't be cleaned up after ingestion to allow for future runs. These assets are:
Sign in to comment
Sign in to answer