AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
MedXpertQA
A comprehensive benchmark to evaluate expert-level medical knowledge and advanced reasoning, featuring 4,460 questions spanning 17 specialties and 11 body systems. Includes both text-only and multimodal subsets with expert-level exam questions incorporating diverse medical images and rich clinical information.
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- Not recorded
- Benchmark release
- Not recorded
- Collected
- 2026-08-17
- Modality
- multimodal
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 12
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| Muse Spark | 0.784 | Not recorded | Not recorded | 2026-04-08 · model_announcement | LLM Stats |
| Qwen3.5-122B-A10B | 0.673 | Not recorded | Not recorded | 2026-02-24 · model_announcement | LLM Stats |
| Qwen3.5-27B | 0.624 | Not recorded | Not recorded | 2026-02-24 · model_announcement | LLM Stats |
| Qwen3.5-35B-A3B | 0.614 | Not recorded | Not recorded | 2026-02-24 · model_announcement | LLM Stats |
| Gemma 4 31B | 0.613 | Not recorded | Not recorded | 2026-04-02 · model_announcement | LLM Stats |
| Gemma 4 26B-A4B | 0.581 | Not recorded | Not recorded | 2026-04-02 · model_announcement | LLM Stats |
| DiffusionGemma 26B-A4B | 0.49 | Not recorded | Not recorded | 2026-06-10 · model_announcement | LLM Stats |
| Gemma 4 12B | 0.487 | Not recorded | Not recorded | 2026-05-23 · model_announcement | LLM Stats |
| MAI-Thinking-1 | 0.43 | Not recorded | Not recorded | 2026-06-02 · model_announcement | LLM Stats |
| Gemma 4 E4B | 0.287 | Not recorded | Not recorded | 2026-04-02 · model_announcement | LLM Stats |
| Gemma 4 E2B | 0.235 | Not recorded | Not recorded | 2026-04-02 · model_announcement | LLM Stats |
| MedGemma 4B IT | 0.188 | Not recorded | Not recorded | 2025-05-20 · model_announcement | LLM Stats |