Skip to content

AI Glossary · Metrics

What is LLM as a Judge?

LLM as a Judge

LLM-as-a-judge uses a language model to assess an output, comparison, or agent run against stated criteria. It can scale evaluation, but its verdicts need validation against the task and trusted reference judgments.

Also known as: LLM-as-a-judge, model-graded evaluation, AI judge

· Updated · Chain of Thought

AI Evaluation & Reliability

  • 4 explainers
  • 7 episodes
  • 1 guest clip
  • 1 source

A judge can score an answer against a reference, choose between two candidates, or inspect an agent trace. Its input should include the evidence needed for that judgment. A polished final response alone cannot establish that a tool action succeeded.

Zheng and colleagues’ MT-Bench study reports useful agreement with human preferences in its setting and documents position and verbosity biases. It also tested self-enhancement bias, a judge favoring its own answers, but says its limited data can’t determine whether the models show it. That result is not a universal accuracy guarantee for judges.

Example: test a judge on approved and rejected support answers, including subtly incorrect policy claims. Count false approvals as well as overall agreement. For pairwise comparisons, swap answer order and inspect whether the decision changes.

Our comparison guide covers the choice between model and human review. Hamel Husain’s episode 37 discussion at 8:23 emphasizes starting with actual failures. Galileo sponsored the show when episode 37 aired; co-host Atindriyo Sanyal, Galileo’s CTO, is introduced at 0:35. Use those failure categories to write a specific rubric, then validate the judge on held-out examples.

Agreement can hide false approvals

An invented validation set: 100 support answers labeled by a domain expert, 80 approved and 20 rejected. The judge agrees with the expert on 90 of them. That sounds strong. Now split the 10 disagreements: in 8, the judge approved an answer the expert rejected; in 2, it rejected one the expert approved.

Expert approvedExpert rejected
Judge approved788
Judge rejected212

Overall agreement is 90/100 = 90%. But the judge passed 8 of the 20 bad answers, a 40% false-approval rate on exactly the cases the judge exists to catch. Report both numbers, and set the bar by what a passed bad answer costs you.

Hear it from the guest

“One of the things that's important with LLM as a judge is that you can trust the LLM as a judge. And to trust LLM as a judge, you have to compare it to some human labels.”

Quotes lightly edited to remove filler words.

Sources

  • Zheng et al.: Judging LLM-as-a-Judge — Primary study of agreement with human preferences. Documents position and verbosity biases; its self-enhancement test was inconclusive on its limited data. Checked November 7, 2026.

Go deeper

  • Hamel Husain: validating an LLM judge article

    Label a sample with a domain expert, separate prompt examples from held-out cases, and inspect false approvals. Live judge experiments need model access and may incur costs.

From the conversation