AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

TriviaQA

A large-scale reading comprehension dataset containing over 650K question-answer-evidence triples. TriviaQA includes 95K question-answer pairs authored by trivia enthusiasts and independently gathered evidence documents (six per question on average) that provide high quality distant supervision for answering the questions. The dataset features relatively complex, compositional questions with considerable syntactic and lexical variability, requiring cross-sentence reasoning to find answers.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 18

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Kimi K2 Base0.851Not recordedNot recorded2025-07-11 · model_announcementLLM Stats
Gemma 2 27B0.837Not recordedNot recorded2024-06-27 · model_announcementLLM Stats
MiMo-V2.5-Pro0.813Not recordedNot recorded2026-04-27 · model_announcementLLM Stats
Mistral Small 3.1 24B Base0.805Not recordedNot recorded2025-03-17 · model_announcementLLM Stats
Mistral Small 3.1 24B Instruct0.805Not recordedNot recorded2025-03-17 · model_announcementLLM Stats
Mistral Small 3 24B Base0.8032Not recordedNot recorded2025-01-30 · model_announcementLLM Stats
Granite 3.3 8B Base0.7818Not recordedNot recorded2025-04-16 · model_announcementLLM Stats
Gemma 2 9B0.766Not recordedNot recorded2024-06-27 · model_announcementLLM Stats
Ministral 3 (14B Base 2512)0.749Not recordedNot recorded2025-12-04 · model_announcementLLM Stats
Mistral Large 30.749Not recordedNot recorded2025-09-01 · model_announcementLLM Stats
Mistral NeMo Instruct0.738Not recordedNot recorded2024-07-18 · model_announcementLLM Stats
Gemma 3n E4B0.702Not recordedNot recorded2025-06-26 · model_announcementLLM Stats
Gemma 3n E4B Instructed LiteRT Preview0.702Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
Ministral 3 (8B Base 2512)0.681Not recordedNot recorded2025-12-04 · model_announcementLLM Stats
Ministral 8B Instruct0.655Not recordedNot recorded2024-10-16 · model_announcementLLM Stats
Gemma 3n E2B0.608Not recordedNot recorded2025-06-26 · model_announcementLLM Stats
Gemma 3n E2B Instructed LiteRT (Preview)0.608Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
Ministral 3 (3B Base 2512)0.592Not recordedNot recorded2025-12-04 · model_announcementLLM Stats