AI dictionary

Judge Model

A model used to score, compare, or critique other model outputs.

Plain English

One AI grades another AI's work.

Example

A judge model checks if an answer is grounded in the supplied document chunks.

Why it matters

Judge models scale evaluation, but they can be biased or fooled, so they need calibration.