AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
VideoMME w/o sub.
Video-MME is a comprehensive evaluation benchmark for multi-modal large language models in video analysis. It features 900 videos across 6 primary visual domains with 30 subfields, ranging from 11 seconds to 1 hour in duration, with 2,700 question-answer pairs. The benchmark evaluates MLLMs' capabilities in processing sequential visual data and multi-modal content including video frames, subtitles, and audio.
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- Not recorded
- Benchmark release
- Not recorded
- Collected
- 2026-08-17
- Modality
- multimodal
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 10
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| Qwen3.5-122B-A10B | 0.839 | Not recorded | Not recorded | 2026-02-24 · model_announcement | LLM Stats |
| Qwen3.5-27B | 0.828 | Not recorded | Not recorded | 2026-02-24 · model_announcement | LLM Stats |
| Qwen3.6-35B-A3B | 0.825 | Not recorded | Not recorded | 2026-04-16 · model_announcement | LLM Stats |
| Qwen3.5-35B-A3B | 0.825 | Not recorded | Not recorded | 2026-02-24 · model_announcement | LLM Stats |
| Qwen3 VL 235B A22B Instruct | 0.792 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 235B A22B Thinking | 0.79 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 32B Thinking | 0.773 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen2.5 VL 72B Instruct | 0.733 | Not recorded | Not recorded | 2025-01-26 · model_announcement | LLM Stats |
| Qwen2.5 VL 32B Instruct | 0.705 | Not recorded | Not recorded | 2025-02-28 · model_announcement | LLM Stats |
| Qwen2.5 VL 7B Instruct | 0.651 | Not recorded | Not recorded | 2025-01-26 · model_announcement | LLM Stats |