AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
OSWorld
OSWorld: The first-of-its-kind scalable, real computer environment for multimodal agents, supporting task setup, execution-based evaluation, and interactive learning across Ubuntu, Windows, and macOS with 369 computer tasks involving real web and desktop applications, OS file I/O, and multi-application workflows
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- Not recorded
- Benchmark release
- Not recorded
- Collected
- 2026-08-17
- Modality
- multimodal
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 20
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| Seed 2.1 Pro | 0.788 | Not recorded | Not recorded | 2026-06-24 · model_announcement | LLM Stats |
| Seed 2.1 Turbo | 0.764 | Not recorded | Not recorded | 2026-06-24 · model_announcement | LLM Stats |
| Claude Opus 4.6 | 0.727 | Not recorded | Not recorded | 2026-02-05 · model_announcement | LLM Stats |
| Claude Sonnet 4.6 | 0.725 | Not recorded | Not recorded | 2026-02-17 · model_announcement | LLM Stats |
| Qwen3 VL 235B A22B Instruct | 0.667 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Claude Opus 4.5 | 0.663 | Not recorded | Not recorded | 2025-11-24 · model_announcement | LLM Stats |
| GLM-5V-Turbo | 0.623 | Not recorded | Not recorded | 2026-04-02 · model_announcement | LLM Stats |
| Claude Sonnet 4.5 | 0.614 | Not recorded | Not recorded | 2025-09-29 · model_announcement | LLM Stats |
| Claude Haiku 4.5 | 0.507 | Not recorded | Not recorded | 2025-10-15 · model_announcement | LLM Stats |
| Qwen3 VL 32B Thinking | 0.41 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 235B A22B Thinking | 0.381 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 8B Thinking | 0.339 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 8B Instruct | 0.339 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 32B Instruct | 0.326 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 4B Thinking | 0.314 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 30B A3B Thinking | 0.306 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 30B A3B Instruct | 0.303 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 4B Instruct | 0.262 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen2.5 VL 72B Instruct | 0.0883 | Not recorded | Not recorded | 2025-01-26 · model_announcement | LLM Stats |
| Qwen2.5 VL 32B Instruct | 0.0592 | Not recorded | Not recorded | 2025-02-28 · model_announcement | LLM Stats |