Evaluating generative AI applications

Module
9 Units

Beginner

Developer

Azure

Learn the fundamental concepts of evaluating generative AI applications.

Learning objectives

By the end of this module, you're able to:

Apply best practices for choosing evaluation data
Understood the purpose of and types of synthetic data for evaluation
Comprehend the scope of the built-in metrics
Choose the appropriate metrics based on your AI system use case
Understand how to interpret evaluation results

Prerequisites

An Azure subscription – Create one for free
Familiarity with Azure and the Azure portal

Get started with Azure

Choose the Azure account that's right for you. Pay as you go or try Azure free for up to 30 days. Sign up.

Introduction min
Evaluate generative AI min
The role of data in evaluations min
Choose and utilize metrics min
Custom prompt-based evaluators min
Interpret evaluation results min
Common pitfalls in result interpretation min
Module assessment min
Summary min