Differentiate between the index and automatic index created by azure open ai 'own data' feature

lakshmi 751

Is there any way in which we can differentiate between the index which we created from the azure open ai and the one which created automatically while indexing.

We are using Ai search document Nuget package for accessing the data in ai search and we are able to get the index, indexer and data source details. This data holds the index that has created from language service when we used custom question answering project for QnA, the index which we created from Open ai and the extra index which is automatically getting created.

We wanted to differentiate between the index that is created from azure open ai. Is there any properties available to segregate between the indexes

SnehaAgrawal-MSFT 21,771 Reputation points

2024-06-25T04:48:52.58+00:00

@lakshmi Apologies for late response here! Could you please elaborate on the two processes you are referring to? Could you provide more detail on the automatic and the manual process? Any screen shot or document would be helpful.
lakshmi 751 Reputation points

2024-06-28T06:53:02.3466667+00:00

Automatic index creation is done from Open AI studio

While configuring Add your data in open ai studio, 1 index will be created with the name which we provided in 'index name' field and as we have selected daily schedule it will create an indexer also. Once after the whole configuration and index creation if we go and see ai search index tab , we will be able to see 2 index 'openaiindex' and 'openaiindex-chunk'.

We wanted to segregate between the open ai index which we created and the other index which got created by themselves while open ai configuraion
SnehaAgrawal-MSFT 21,771 Reputation points

2024-07-01T16:56:05.9266667+00:00

@lakshmi Thanks for reply! Could you elaborate on what do you meant by ‘segregate’?

Openaiindex-chunk is the correct index to use with the LLM.
lakshmi 751 Reputation points

2024-07-03T05:54:04.3466667+00:00

We wanted to list all the indexes which has create from Open ai studio.

So, while fetching the indexes from ai search we are getting both the indexes correct index we used in open ai and the other index which is created automatically.

So we wanted filter out open ai created index.

Also is it possible to get the storage account from which the index is created. When we checked the AI search, what we understood is the 'Openaiindex-chunk' is poiting to the data source where the documents are chunked and stored. the automatically created index points to the actual container where the documents is stored.
SnehaAgrawal-MSFT 21,771 Reputation points

2024-07-04T05:50:50.8233333+00:00

@lakshmi That will not produce quality results; however you can do it. You simply need to. 'Add Data' of type AI Search and select the index without the -chuck in the Wizard flow.

Share via

Differentiate between the index and automatic index created by azure open ai 'own data' feature

Your answer