AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

OpenBookQA

OpenBookQA is a question-answering dataset modeled after open book exams for assessing human understanding. It contains 5,957 multiple-choice elementary-level science questions that probe understanding of 1,326 core science facts and their application to novel situations, requiring combination of open book facts with broad common knowledge through multi-hop reasoning.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 5

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Phi-3.5-MoE-instruct0.896Not recordedNot recorded2024-08-23 · model_announcementLLM Stats
Phi 4 Mini0.792Not recordedNot recorded2025-02-01 · model_announcementLLM Stats
Phi-3.5-mini-instruct0.792Not recordedNot recorded2024-08-23 · model_announcementLLM Stats
Mistral NeMo Instruct0.606Not recordedNot recorded2024-07-18 · model_announcementLLM Stats
Hermes 3 70B0.494Not recordedNot recorded2024-08-15 · model_announcementLLM Stats