Automatically update Azure AI search indexes from BLOB storage for use in Azure AI studio - RAG pattern queries

CTO.care 35 Reputation points
2024-05-14T16:03:05.1033333+00:00

Hello,

I'm currently using Azure AI studio to upload PDF files to a BLOB store, create an index, and then query this data using Chat GPT 3.5 and the RAG pattern without any coding. It is working great!

However, I'm trying to set up the architecture to update the Azure AI Search index automatically whenever the data source changes. The desired behavior is when I add or remove a file from the BLOB storage, the answers from the LLM are up to date based on the new data.

I have tried creating an index and an indexer for my data directly in Azure AI search. In Azure search, I'm doing an "Import and vectorize" action and linking this to the Azure AI studio playground using the Chat GPT3.5 model. But, I get an error when I try to send a prompt in the playground.

(Validation error at #/data_sources/0/AzureCognitiveSearch/parameters/fieldsMapping/contentFields/0: Input should be a valid string

A quick search indicates that this could be a field mapping issue. Any pointers here on how to remedy this would be appreciated.

I've also tried incrementing the index version manually in AI studio, which works. But, if there was some way to automate this process, it would also solve my problem.

End result I'm looking for is to create my own chat client and use the same API (completions) as the playground.

Thanks in advance

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
757 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,307 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,452 questions
{count} votes