Azure OpenAI does not seem to be able to access data from a StringCollection

Nate York 35

I am using Azure OpenAI, Bringing my data and using an Azure AI Search Index. My "Documents" is a taxonomy, one of the fields is for multiple synonyms (other names) for that 'document' node.

The playground does not seem to have knowledge of the terms in that field, and the only thing I can tell that is different from other content fields, that are working, is that this is the only StringCollection type field. Is this the case that OpenAI is not able to use that field type for retrieval?

Thanks for any help!

Saurabh Sharma 23,751 Reputation points Microsoft Employee

2024-02-10T00:57:45.05+00:00

Hi @Nate York
Welcome to Microsoft Q&A! Thanks for posting the question.

Can you please verify that the StringCollection field is being indexed correctly, you can try running a search query using the REST API or the Azure portal. If the search results returned by the index include documents that contain values in the StringCollection field, then you can be sure that the field is being indexed correctly.

If you're still having trouble getting the expected results, you may want to check if the StringCollection field is marked as searchable in the index definition. If the field is not marked as searchable, then it will not be included in the search results. You can check in your Azure Search Index under "Fields" section on Azure portal. (see screenshot below) Can you share the Type of your document node field as well. Thanks Saurabh
Nate York 35 Reputation points

2024-02-10T04:50:59.6966667+00:00

Thank you for the reply!

Yes the field is searchable in the Portal or API. I can search on one of the terms in that field and it is found, but when I point the Chat at that index it does not know about their content.

I am mapping that field as content at the beginning of the BYOD process
Saurabh Sharma 23,751 Reputation points Microsoft Employee

2024-02-10T05:55:06.88+00:00

@Nate York Ok, got it. Can you share the "Type" of your document node field. Also, is it possible to share a sample structure of the node data so that I can investigate it further. Thanks Saurabh
Nate York 35 Reputation points

2024-02-12T18:52:19.7733333+00:00

Thank you
Nate York 35 Reputation points

2024-02-12T18:55:27.5866667+00:00
Thank you for your help!

The DocumentType is Int32

Here is a sample of the return from a search in the Portal, OtherTerms is the field I am having trouble using Azure OpenAI searching or returning data from even though it is searchable in the portal .

"DocumentType": 4, "DocumentKey": "X_XXXXXX", "OtherTerms": [ "garlic flavour", "garlic flavor oil", "garlic flavored oil", ],
Saurabh Sharma 23,751 Reputation points Microsoft Employee

2024-02-13T19:13:39.8333333+00:00

@Nate York I am checking this internally and get back to you on the same. Thanks Saurabh
Nate York 35 Reputation points

2024-02-15T17:18:17.8733333+00:00

Many thanks Saurabh!
Nate York 35 Reputation points

2024-02-22T23:38:50.9166667+00:00

Greetings @Saurabh Sharma I was just checking to see if there had been any further information on this ticket? Thanks!
Abhishek Madas 0 Reputation points

2024-04-17T22:53:24.9533333+00:00

I can confirm this as I was trying to access the imageTags collection from azure openai and it’s not able to read it.