AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
MM-MT-Bench
A multi-turn LLM-as-a-judge evaluation benchmark for testing multimodal instruction-tuned models' ability to follow user instructions in multi-turn dialogues and answer open-ended questions in a zero-shot manner.
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- Not recorded
- Benchmark release
- Not recorded
- Collected
- 2026-08-17
- Modality
- multimodal
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 17
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| Mistral Large 3 | 84.9 | Not recorded | Not recorded | 2025-09-01 · model_announcement | LLM Stats |
| Qwen3 VL 235B A22B Instruct | 8.5 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 235B A22B Thinking | 8.5 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 32B Instruct | 8.4 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 32B Thinking | 8.3 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 30B A3B Instruct | 8.1 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 8B Thinking | 8.0 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 30B A3B Thinking | 7.9 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 4B Thinking | 7.7 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 8B Instruct | 7.7 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 4B Instruct | 7.5 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Pixtral Large | 0.74 | Not recorded | Not recorded | 2024-11-18 · model_announcement | LLM Stats |
| Pixtral-12B | 0.605 | Not recorded | Not recorded | 2024-09-17 · model_announcement | LLM Stats |
| MiniStral 3 (14B Instruct 2512) | 0.0849 | Not recorded | Not recorded | 2025-12-04 · model_announcement | LLM Stats |
| Ministral 3 (8B Instruct 2512) | 0.0808 | Not recorded | Not recorded | 2025-12-04 · model_announcement | LLM Stats |
| Ministral 3 (3B Instruct 2512) | 0.0783 | Not recorded | Not recorded | 2025-12-04 · model_announcement | LLM Stats |
| Qwen2.5-Omni-7B | 0.06 | Not recorded | Not recorded | 2025-03-27 · model_announcement | LLM Stats |