AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

AGIEval

A human-centric benchmark for evaluating foundation models on standardized exams including college entrance exams (Gaokao, SAT), law school admission tests (LSAT), math competitions, lawyer qualification tests, and civil service exams. Contains 20 tasks (18 multiple-choice, 2 cloze) designed to assess understanding, knowledge, reasoning, and calculation abilities in real-world academic and professional contexts.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 10

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Mistral Small 3 24B Base0.658Not recordedNot recorded2025-01-30 · model_announcementLLM Stats
Ministral 3 (14B Base 2512)0.648Not recordedNot recorded2025-12-04 · model_announcementLLM Stats
Ministral 3 (8B Base 2512)0.591Not recordedNot recorded2025-12-04 · model_announcementLLM Stats
Hermes 3 70B0.5618Not recordedNot recorded2024-08-15 · model_announcementLLM Stats
Gemma 2 27B0.551Not recordedNot recorded2024-06-27 · model_announcementLLM Stats
Gemma 2 9B0.528Not recordedNot recorded2024-06-27 · model_announcementLLM Stats
Ministral 3 (3B Base 2512)0.511Not recordedNot recorded2025-12-04 · model_announcementLLM Stats
Granite 3.3 8B Base0.493Not recordedNot recorded2025-04-16 · model_announcementLLM Stats
Ministral 8B Instruct0.483Not recordedNot recorded2024-10-16 · model_announcementLLM Stats
ERNIE 4.50.285Not recordedNot recorded2025-06-25 · model_announcementLLM Stats