Share via

IndirectAttackEvaluator Class

  • Reference

Note

This is an experimental class, and may change at any time. Please see https://aka.ms/azuremlexperimental for more information.

A Cross-Domain Prompt Injection Attack (XPIA) jailbreak evaluator.

Detect whether cross domain injected attacks are present in your AI system's response. Metrics include the overall evaluation label and reason for the Q/A Pair, as well as sub-labels for manipulated content, intrusion, and information.

Constructor

IndirectAttackEvaluator(credential, azure_ai_project, eval_last_turn: bool = False)

Parameters

Name Description
credential
Required
TokenCredential

The credential for connecting to Azure AI project. Required
azure_ai_project
Required
AzureAIProject

The scope of the Azure AI project. It contains subscription id, resource group, and project name.
eval_last_turn

Set to True to evaluate only the most recent exchange in the dialogue, focusing on the latest user inquiry and the assistant's corresponding response. Defaults to False

Default value: False