Share via

Azure OpenAI and Azure Webapp are showing different results

Sikder Tahsin Al Amin 155 Reputation points
2024-07-23T21:03:52.84+00:00

I am testing Azure Chat with your data and deployed a web app model from azure git repo (https://github.com/microsoft/sample-app-aoai-chatGPT). But the result from webapp is different from Chat playground. It can't find all the info in the webapp. Below is one example in the screenshots.

Webapp:

User's image

Chat playground:

User's image

I am guessing it something to do with the .env file? Below how many search parameters are configured.

# Chat with data: common settings
DATASOURCE_TYPE="azure_search"
SEARCH_TOP_K=5
SEARCH_STRICTNESS=3
SEARCH_ENABLE_IN_DOMAIN=True
# Chat with data: Azure AI Search
AZURE_SEARCH_SERVICE="XXX"
AZURE_SEARCH_INDEX="XXX"
AZURE_SEARCH_KEY="XXX"
AZURE_SEARCH_SEMANTIC_SEARCH_CONFIG="my-semantic-config"
AZURE_SEARCH_INDEX_IS_PRECHUNKED=True
AZURE_SEARCH_TOP_K=5
AZURE_SEARCH_ENABLE_IN_DOMAIN=True
AZURE_SEARCH_CONTENT_COLUMNS=["content"]
AZURE_SEARCH_FILENAME_COLUMN="filepath"
AZURE_SEARCH_TITLE_COLUMN="title"
AZURE_SEARCH_URL_COLUMN=
AZURE_SEARCH_VECTOR_COLUMNS=["contentVector","titleVector"]
AZURE_SEARCH_QUERY_TYPE="vectorSemanticHybrid"
AZURE_SEARCH_PERMITTED_GROUPS_COLUMN=
AZURE_SEARCH_STRICTNESS=3

I've tried AZURE_SEARCH_VECTOR_COLUMNS changing like below. All same results. Also, same for AZURE_SEARCH_CONTENT_COLUMNS, without the list.

AZURE_SEARCH_VECTOR_COLUMNS=contentVector|titleVector
AZURE_SEARCH_VECTOR_COLUMNS=contentVector, titleVector

Any help would be appreciated. Thank you!

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
865 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,642 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Sikder Tahsin Al Amin 155 Reputation points
    2024-07-24T21:47:50.0633333+00:00

    Below are the updated search parameters that worked.

    # Chat with data: common settings
DATASOURCE_TYPE="
SEARCH_TOP_K=5
SEARCH_STRICTNESS=3
SEARCH_ENABLE_IN_DOMAIN=True
# Chat with data: Azure AI Search
AZURE_SEARCH_SERVICE="XXX"
AZURE_SEARCH_INDEX="XXX"
AZURE_SEARCH_KEY="XXX"
AZURE_SEARCH_SEMANTIC_SEARCH_CONFIG="my-semantic-config"
AZURE_SEARCH_INDEX_IS_PRECHUNKED=True
AZURE_SEARCH_TOP_K=5
AZURE_SEARCH_ENABLE_IN_DOMAIN=True
AZURE_SEARCH_CONTENT_COLUMNS="content"
AZURE_SEARCH_FILENAME_COLUMN="filepath"
AZURE_SEARCH_TITLE_COLUMN="title"
AZURE_SEARCH_URL_COLUMN=
AZURE_SEARCH_VECTOR_COLUMNS=contentVector|titleVector
AZURE_SEARCH_QUERY_TYPE="vectorSemanticHybrid"
AZURE_SEARCH_PERMITTED_GROUPS_COLUMN=
AZURE_SEARCH_STRICTNESS=3
    0 comments