Azure Web Application and ChatPlayground giving different responses?

Question

Hi,

I am working on Azure AI Search. I want to use Web Application/Chat Playground for Q/A from bunch of documents at a time. I have created azure ai search service with Basic tier package for West US Region. After this, I created skillset using Text Split Skill. Then, I have created index called azureblob-index where fields are:

1.) content (Retrievable, Searchable)

2.) metadata_storage_name (Retrievable)

3.) metadata_storage_path (Retrievable, Filterable)

4.) metadata_author (Retrievable, Filterable, Facetable, Searchable)

5.) metadata_title (Retrievable, Filterable, Facetable, Searchable)

6.) metadata_creation_date (Retrievable, Filterable, Sortable, Facetable)

7.) language (Retrievable, Filterable, Facetable, Searchable)

8.) split_text (Retrievable, Searchable)

9.) keywords (Retrievable, Searchable)

10.) summary (Retrievable, Searchable)

11.) section_titles (Retrievable, Searchable)

12.) metadata_file_type (Retrievable, Filterable, Facetable, Searchable)

13.) merged_content (Filterable, Searchable)

14.) text (Retrievable, Searchable)

15.) layoutText (Retrievable, Searchable)

After this, I have created semantic configurations where fields are:

Title_field: metadata_title

Content fields: content, merged_content

Keyword fields: keywords

After this, I have created chat playground using bring your own data. When I am asking questions, then chat playground is giving response which is not very accurate or sometimes not even matching to the question that is asked. Also, sometimes it does not give any answer by stating that this question is out of my domain/scope. But again if I ask same question after like 10-15 seconds, then I am getting answer for that question for which earlier I got out of domain/scope message. Sometimes, it gives correct answer. Same happens in the web application. Also, sometimes references in the chat playground and web application doesn't even match while question being same.

Can anyone suggest why this is happening.

Answer 1

Hello

Thank you for posting in Microsoft Community forum.

Based on the description, I understand your question is related to Azure.

Since there are no engineers dedicated to Azure in this forum. in order to be able to get a quick and effective handling of your issue, I recommend that you repost your question in the Q&A forum, where there will be a dedicated engineer to give you a professional and effective reply.

Here is the link for Q&A forum.

Questions - Microsoft Q&A

Click the "Ask a Question" button in the upper right corner to post your question and select any tags related to your productions.

Thank you for your understanding and support. If you have any question or concern, please feel free to let us know.

Have a nice day.

Best Regards,

Molly

Answer 2

Thank you for this info. I'll post it in the mentioned forum.