0 / 0

Is JSON evaluation metric

Last updated: May 08, 2025
Is JSON evaluation metric

The Is JSON metric measures whether the rows in the prediction contains valid JSON syntax.

Metric details

Is JSON is a content validation metric that uses string-based functions to analyze and validate generated LLM output text. The metric is available only when you use the Python SDK to calculate evaluation metrics.

Scope

The is JSON metric evaluates generative AI assets only.

  • Types of AI assets: Prompt templates
  • Generative AI tasks:
    • Text summarization
    • Content generation
    • Question answering
    • Entity extraction
    • Retrieval augmented generation (RAG)
  • Supported languages: English

Scores and values

The is JSON metric score indicates whether the prediction rows contain valid JSON syntax.

  • Range of values: 0.0-1.0
  • Ratios:
    • At 0: The prediction rows do not contain valid JSON syntax.
    • At 1: The prediction rows contain valid JSON syntax.

Settings

  • Thresholds:
    • Lower limit: 0
    • Upper limit: 1

Parent topic: Evaluation metrics