Azure OpenAI and Azure Webapp are showing different results

Question

I am testing Azure Chat with your data and deployed a web app model from azure git repo (https://github.com/microsoft/sample-app-aoai-chatGPT). But the result from webapp is different from Chat playground. It can't find all the info in the webapp. Below is one example in the screenshots.

Webapp:

Chat playground:

I am guessing it something to do with the .env file? Below how many search parameters are configured.

# Chat with data: common settings
DATASOURCE_TYPE="azure_search"
SEARCH_TOP_K=5
SEARCH_STRICTNESS=3
SEARCH_ENABLE_IN_DOMAIN=True
# Chat with data: Azure AI Search
AZURE_SEARCH_SERVICE="XXX"
AZURE_SEARCH_INDEX="XXX"
AZURE_SEARCH_KEY="XXX"
AZURE_SEARCH_SEMANTIC_SEARCH_CONFIG="my-semantic-config"
AZURE_SEARCH_INDEX_IS_PRECHUNKED=True
AZURE_SEARCH_TOP_K=5
AZURE_SEARCH_ENABLE_IN_DOMAIN=True
AZURE_SEARCH_CONTENT_COLUMNS=["content"]
AZURE_SEARCH_FILENAME_COLUMN="filepath"
AZURE_SEARCH_TITLE_COLUMN="title"
AZURE_SEARCH_URL_COLUMN=
AZURE_SEARCH_VECTOR_COLUMNS=["contentVector","titleVector"]
AZURE_SEARCH_QUERY_TYPE="vectorSemanticHybrid"
AZURE_SEARCH_PERMITTED_GROUPS_COLUMN=
AZURE_SEARCH_STRICTNESS=3

I've tried AZURE_SEARCH_VECTOR_COLUMNS changing like below. All same results. Also, same for AZURE_SEARCH_CONTENT_COLUMNS, without the list.

AZURE_SEARCH_VECTOR_COLUMNS=contentVector|titleVector
AZURE_SEARCH_VECTOR_COLUMNS=contentVector, titleVector

Any help would be appreciated. Thank you!

Answer 1

Below are the updated search parameters that worked.

# Chat with data: common settings
DATASOURCE_TYPE="AzureCognitiveSearch"
SEARCH_TOP_K=5
SEARCH_STRICTNESS=3
SEARCH_ENABLE_IN_DOMAIN=True
# Chat with data: Azure AI Search
AZURE_SEARCH_SERVICE="XXX"
AZURE_SEARCH_INDEX="XXX"
AZURE_SEARCH_KEY="XXX"
AZURE_SEARCH_SEMANTIC_SEARCH_CONFIG="my-semantic-config"
AZURE_SEARCH_INDEX_IS_PRECHUNKED=True
AZURE_SEARCH_TOP_K=5
AZURE_SEARCH_ENABLE_IN_DOMAIN=True
AZURE_SEARCH_CONTENT_COLUMNS="content"
AZURE_SEARCH_FILENAME_COLUMN="filepath"
AZURE_SEARCH_TITLE_COLUMN="title"
AZURE_SEARCH_URL_COLUMN=
AZURE_SEARCH_VECTOR_COLUMNS=contentVector|titleVector
AZURE_SEARCH_QUERY_TYPE="vectorSemanticHybrid"
AZURE_SEARCH_PERMITTED_GROUPS_COLUMN=
AZURE_SEARCH_STRICTNESS=3