Azure Open AI your data is losing after session closed

Question

I'm trying to use my own data as input data source to Azure Open AI model and it's getting deleted after closing session. I'm using Azure Blob Storage(Preview) as dataset source and uploading it.

I could see the index every time when I'm trying to assign but losing the connection between OpenAI data source and index. Is there any ET/roadmap to fix this?

Answer 1

Donepudi, Naveen Kumar Greetings & Welcome to Microsoft Q&A forum!

I'm trying to use my own data as input data source to Azure Open AI model and it's getting deleted after closing session. I'm using Azure Blob Storage(Preview) as dataset source and uploading it.

I understand that you are facing issues with your own data source getting deleted after closing the session.

Note that, Azure Open AI Add Your Data feature is currently a preview feature.

This is by design. We don't store any configurations today. We are trying to develop a feature which would allow saving all these states, but right now, as soon as the session ends, the settings are lost. 

Your actual data source like Cognitive search, storage resource and the search index will not be deleted in the background.

Our Product team is actively working to make this to happen as soon as possible, so it´s on the current roadmap for Azure OpenAI, but there is no exact ETA we can share at this moment.

The workaround suggested is to reuse the Search Index created during the first configuration when you need to use this feature.

Alternatively, You can try to Chat with Azure OpenAI models using your own data via the preferred programming language from your app as shown here.

Also, keep an eye on the What's new in Azure OpenAI Service for latest updates.

Hope this clarifies. Do let me know if you have any further queries.

If the response helped, please do click Accept Answer and Yes for was this answer helpful.

Answer 2

Workaround is to use the model API, and when performing the request you can pass in the details of your AI search resource and key so it knows to use those as data sources.

Here is the documentation on how an App would go about it:

https://learn.microsoft.com/en-us/azure/ai-foundry/tutorials/copilot-sdk-build-rag#get-documents