How to capture the Retrieval context dynamically

Adrian Paulo Cascante 0 Reputation points
2025-01-07T18:56:30.89+00:00

Given this statement

Retrieval Measures the quality of search without ground truth. It focuses on how relevant the context chunks (encoded as a string) are to address a query and how the most relevant context chunks are surfaced at the top of the list.

If i want to evaluate using the RetrievalEvaluator, how can I capture or fetch the context chunks needed for the evaluation? Can you show me an example

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,097 questions
{count} votes

1 answer

Sort by: Most helpful
  1. AshokPeddakotla-MSFT 35,971 Reputation points Moderator
    2025-01-08T08:53:55.84+00:00

    Adrian Paulo Cascante Greetings & Welcome to Microsoft Q&A forum!

    Did you check RetrievalEvaluator Class and Azure AI Evaluation client library for Python - version 1.1.0 already?

    Do let me know if that helps.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.