Azure web app's blob storage updated with new files. How do I refresh the CognitiveSearch index used in the app to reflect the new data?

Question

Hello,

I recently deployed a web app through Azure's AIStudio interface. After initially adding files via the UI to set up a custom training index, I added more files to that blob through the Azure Dashboard.

Now, I need guidance on updating the index that the web app was deployed with so that it's aware of the new files.

Alternatively, if I were to create a new index, how can I integrate that into my web app without having to create a new one?

Best regards,
Sean

Answer 1

You can either write an Azure Function which will get triggered whenever a new blob is created/updated or try to use default Azure Cognitive Indexer.

The idea is to extract the content of the blob and push to your existing index. After that, changes will be available and your dashboard will display the latest changes.

You can find more information about the Azure Cognitive Indexer in here:

https://learn.microsoft.com/en-us/azure/search/search-indexer-overview

Azure functions with Blob Trigger in here:

https://learn.microsoft.com/en-us/azure/azure-functions/functions-bindings-storage-blob-trigger?tabs=python-v2%2Cin-process&pivots=programming-language-csharp#example

and here's a sample of how to add data to an existing Azure Cognitive Search index:

https://learn.microsoft.com/en-us/azure/search/search-indexer-tutorial#in-programcs

Answer 2

@Sean Swanson, Following-up on this, you need to create a Index data from Azure Blob Storage with a schedule and point to the OpenAI existing created index. By following the steps outlined in the doc, you may leverage the indexers (add new) from the Portal or use API or SDK to accomplish this task.