0 / 0

Contains all evaluation metric

Last updated: May 08, 2025
Contains all evaluation metric

The contains all metric measures whether the rows in the prediction contain all of the specified keywords.

Metric details

Contains all is a content validation metric that uses string-based functions to analyze and validate generated LLM output text. The metric is available only when you use the Python SDK to calculate evaluation metrics.

Scope

The contains all metric evaluates generative AI assets only.

  • Types of AI assets: Prompt templates
  • Generative AI tasks:
    • Text summarization
    • Content generation
    • Question answering
    • Entity extraction
    • Retrieval augmented generation (RAG)
  • Supported languages: English

Scores and values

The contains all metric score indicates whether all of the specified keywords are found in the prediction rows.

  • Range of values: 0.0-1.0
  • Ratios:
    • At 0: None of the specified keywords are found in the rows
    • At 1: All of the specified keywords are found in the row

Settings

  • Thresholds:
    • Lower limit: 0
    • Upper limit: 1

Parent topic: Evaluation metrics