Retrieving Evaluation Metrics from Azure AI Studio using C#

Saravan S 0 Reputation points
2024-03-14T12:38:34.7533333+00:00

I am working on fetching evaluation metrics like groundedness and coherence from Azure AI Studio using C#. The Microsoft documentation provides Python code, but I couldn't find equivalent C# examples. I have tried using the Metrics library for C#, but it didn't meet my expectations.

I would appreciate any guidance or code examples in C# that could help me retrieve these metrics from Azure AI Studio. If you have experience with similar tasks or know of any C# libraries that support this, please share your insights. I am specifically looking for technical solutions and code examples.

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
716 questions
Azure AI Metrics Advisor
Azure AI Metrics Advisor
An Azure artificial intelligence analytics service that proactively monitors metrics and diagnoses issues.
80 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,174 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,386 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Grmacjon-MSFT 16,101 Reputation points
    2024-03-14T22:29:25.8633333+00:00

    @Saravan S AFAIK , there's no official C# library or direct API call currently available to fetch evaluation metrics like groundedness and coherence from Azure AI Studio as of today.

    An alternative solution is exploring Azure Machine Learning Studio (AML Studio). While Azure AI Studio focuses on a user-friendly interface, AML Studio offers a more developer-centric experience.If your experiments are already deployed as web services in AML Studio, you can potentially access evaluation metrics through its REST API.The AML Studio API supports C# libraries like Microsoft.Azure.MachineLearning.Client. You'd need to explore the specific API calls to retrieve the desired metrics. Reference for AML Studio API can be found here: https://learn.microsoft.com/en-us/azure/machine-learning/?view=azureml-api-2

    Best,

    Grace

    0 comments