AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

Legal Agent Benchmark

The Legal Agent Benchmark (LAB) is Harvey's open-source benchmark for evaluating AI agents on complex, long-horizon legal work. Tasks are scored under an all-pass standard against expert-curated rubrics, where a task passes only if every required rubric criterion (facts, conclusions, citations, structure, and analytical moves) passes.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 13

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Claude Fable 50.133Not recordedNot recorded2026-06-09 · model_announcementLLM Stats
Claude Opus 50.117Not recordedNot recorded2026-07-24 · model_announcementLLM Stats
Claude Opus 4.70.071Not recordedNot recorded2026-04-16 · model_announcementLLM Stats
Claude Sonnet 50.058Not recordedNot recorded2026-06-30 · model_announcementLLM Stats
Claude Sonnet 4.60.054Not recordedNot recorded2026-02-17 · model_announcementLLM Stats
Claude Opus 4.60.042Not recordedNot recorded2026-02-05 · model_announcementLLM Stats
GPT-5.50.021Not recordedNot recorded2026-04-23 · model_announcementLLM Stats
Gemini 3.5 Flash0.008Not recordedNot recorded2026-05-19 · model_announcementLLM Stats
GPT-5.40.004Not recordedNot recorded2026-03-05 · model_announcementLLM Stats
GPT-5.4 mini0.0Not recordedNot recorded2026-03-17 · model_announcementLLM Stats
Gemini 3.1 Flash-Lite0.0Not recordedNot recorded2026-03-03 · model_announcementLLM Stats
Gemini 3.1 Pro0.0Not recordedNot recorded2026-02-19 · model_announcementLLM Stats
Gemini 3 Flash0.0Not recordedNot recorded2025-12-17 · model_announcementLLM Stats