AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
OpenBookQA is a question-answering dataset modeled after open book exams for assessing human understanding. It contains 5,957 multiple-choice elementary-level science questions that probe understanding of 1,326 core science facts and their application to novel situations, requiring combination of open book facts with broad common knowledge through multi-hop reasoning.
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| Phi-3.5-MoE-instruct | 0.896 | Not recorded | Not recorded | 2024-08-23 · model_announcement | LLM Stats |
| Phi 4 Mini | 0.792 | Not recorded | Not recorded | 2025-02-01 · model_announcement | LLM Stats |
| Phi-3.5-mini-instruct | 0.792 | Not recorded | Not recorded | 2024-08-23 · model_announcement | LLM Stats |
| Mistral NeMo Instruct | 0.606 | Not recorded | Not recorded | 2024-07-18 · model_announcement | LLM Stats |
| Hermes 3 70B | 0.494 | Not recorded | Not recorded | 2024-08-15 · model_announcement | LLM Stats |