AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
TruthfulQA
TruthfulQA is a benchmark to measure whether language models are truthful in generating answers to questions. It comprises 817 questions that span 38 categories, including health, law, finance and politics. The questions are crafted such that some humans would answer falsely due to a false belief or misconception, testing models' ability to avoid generating false answers learned from human texts.
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- Not recorded
- Benchmark release
- Not recorded
- Collected
- 2026-08-17
- Modality
- text
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 18
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| MAI-Thinking-1 | 0.88 | Not recorded | Not recorded | 2026-06-02 · model_announcement | LLM Stats |
| Phi-3.5-MoE-instruct | 0.775 | Not recorded | Not recorded | 2024-08-23 · model_announcement | LLM Stats |
| Granite 3.3 8B Instruct | 0.6686 | Not recorded | Not recorded | 2025-04-16 · model_announcement | LLM Stats |
| Phi 4 Mini | 0.664 | Not recorded | Not recorded | 2025-02-01 · model_announcement | LLM Stats |
| Phi-3.5-mini-instruct | 0.64 | Not recorded | Not recorded | 2024-08-23 · model_announcement | LLM Stats |
| Hermes 3 70B | 0.6329 | Not recorded | Not recorded | 2024-08-15 · model_announcement | LLM Stats |
| Llama 3.1 Nemotron 70B Instruct | 0.5863 | Not recorded | Not recorded | 2024-10-01 · model_announcement | LLM Stats |
| Qwen2.5 14B Instruct | 0.584 | Not recorded | Not recorded | 2024-09-19 · model_announcement | LLM Stats |
| Jamba 1.5 Large | 0.583 | Not recorded | Not recorded | 2024-08-22 · model_announcement | LLM Stats |
| IBM Granite 4.0 Tiny Preview | 0.581 | Not recorded | Not recorded | 2025-05-02 · model_announcement | LLM Stats |
| Qwen2.5 32B Instruct | 0.578 | Not recorded | Not recorded | 2024-09-19 · model_announcement | LLM Stats |
| Command R+ | 0.563 | Not recorded | Not recorded | 2024-08-30 · model_announcement | LLM Stats |
| Qwen2 72B Instruct | 0.548 | Not recorded | Not recorded | 2024-07-23 · model_announcement | LLM Stats |
| Qwen2.5-Coder 32B Instruct | 0.542 | Not recorded | Not recorded | 2024-09-19 · model_announcement | LLM Stats |
| Jamba 1.5 Mini | 0.541 | Not recorded | Not recorded | 2024-08-22 · model_announcement | LLM Stats |
| Granite 3.3 8B Base | 0.5215 | Not recorded | Not recorded | 2025-04-16 · model_announcement | LLM Stats |
| Qwen2.5-Coder 7B Instruct | 0.506 | Not recorded | Not recorded | 2024-09-19 · model_announcement | LLM Stats |
| Mistral NeMo Instruct | 0.503 | Not recorded | Not recorded | 2024-07-18 · model_announcement | LLM Stats |