AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

ARC-E

ARC-E (AI2 Reasoning Challenge - Easy Set) is a subset of grade-school level, multiple-choice science questions that requires knowledge and reasoning capabilities. Part of the AI2 Reasoning Challenge dataset containing 5,197 questions that test scientific reasoning and factual knowledge. The Easy Set contains questions that are answerable by retrieval-based and word co-occurrence algorithms, making them more accessible than the Challenge Set.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 8

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Gemma 2 27B0.886Not recordedNot recorded2024-06-27 · model_announcementLLM Stats
Gemma 2 9B0.88Not recordedNot recorded2024-06-27 · model_announcementLLM Stats
Hermes 3 70B0.8295Not recordedNot recorded2024-08-15 · model_announcementLLM Stats
Gemma 3n E4B0.816Not recordedNot recorded2025-06-26 · model_announcementLLM Stats
Gemma 3n E4B Instructed LiteRT Preview0.816Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
Gemma 3n E2B0.758Not recordedNot recorded2025-06-26 · model_announcementLLM Stats
Gemma 3n E2B Instructed LiteRT (Preview)0.758Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
ERNIE 4.50.607Not recordedNot recorded2025-06-25 · model_announcementLLM Stats