Getting UserError for Codespaces for Evaluation for Risk Safety under the Azure Open AI Leaning Path for Evaluations.

Question

EvaluationException: (UserError) RAI service is unavailable in this region, or you lack the necessary permissions to access the AI project. Status Code: 530 Visit https://aka.ms/azsdk/python/evaluation/safetyevaluator/troubleshoot to troubleshoot this issue.

Answer 1

Shourya Addepalli Greetings!

EvaluationException: (UserError) RAI service is unavailable in this region, or you lack the necessary permissions to access the AI project. Status Code: 530 Visit https://aka.ms/azsdk/python/evaluation/safetyevaluator/troubleshoot to troubleshoot this issue.

As error suggests that, did you check the available regions?

In which region you are trying?
Currently AI-assisted risk and safety metrics are only available in the following regions:

Also, make sure that you have necessary role permissions assigned yourself.
AFAIK, Contributor role is currently required to run safety evaluations.
See Role-based access control in Azure AI Foundry portal for the available roles.

Do let me know if that helps or have any further queries.