Share via

HateUnfairnessEvaluator Class

  • Reference

Note

This is an experimental class, and may change at any time. Please see https://aka.ms/azuremlexperimental for more information.

Initialize a hate-unfairness evaluator for hate unfairness score.

Usage


   azure_ai_project = {
       "subscription_id": "<subscription_id>",
       "resource_group_name": "<resource_group_name>",
       "project_name": "<project_name>",
   }
   eval_fn = HateUnfairnessEvaluator(azure_ai_project)
   result = eval_fn(query="What is the capital of France?", response="Paris.")

Output format


   {
       "hate_unfairness": "High",
       "hate_unfairness_score": 6.5,
       "hate_unfairness_reason": "Some reason"
   }

Constructor

HateUnfairnessEvaluator(credential, azure_ai_project, eval_last_turn: bool = False)

Parameters

Name Description
credential
Required
TokenCredential

The credential for connecting to Azure AI project. Required
azure_ai_project
Required
AzureAIProject

The scope of the Azure AI project. It contains subscription id, resource group, and project name.
eval_last_turn
Default value: False