RedTeam SDK: ProtectedMaterial, CodeVulnerability, and UngroundedAttributes Testing

Question

In the RedTeam SDK, I can see that the following categories have been added:

ProtectedMaterial 200

CodeVulnerability 389

UngroundedAttributes 200

How can I test these against my model? What does ProtectedMaterial 200, CodeVulnerability 389, and UngroundedAttributes 200 mean, and what kind of prompt should I use to test them on my model?

Answer 1

Hi Karthickumar Karuppiah,

To use ProtectedMaterial 200,CodeVulnerability 389,UngroundedAttributes 200.

In your code add the risk categories as shown below:

red_team_agent = RedTeam(
    azure_ai_project=azure_ai_project,
    credential=credential,
    risk_categories=[
        RiskCategory.ProtectedMaterial,
        RiskCategory.CodeVulnerability,
        RiskCategory.UngroundedAttributes
    ],
    num_objectives=2,  # Number of attack prompts per risk category (customize as needed)
)

A prompt is not required, as the SDK will take care of that
Feel free to accept this as an answer.

Thank you for reaching out to The Microsoft Q&A Portal.