AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

OSWorld-Verified

OSWorld-Verified is a verified subset of OSWorld, a scalable real computer environment for multimodal agents supporting task setup, execution-based evaluation, and interactive learning across Ubuntu, Windows, and macOS.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 24

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen3.8 Max0.861Not recordedNot recorded2026-08-02 · model_announcementLLM Stats
Claude Fable 50.85Not recordedNot recorded2026-06-09 · model_announcementLLM Stats
Qwen3.8-27B0.843Not recordedNot recorded2026-08-14 · model_announcementLLM Stats
Claude Opus 4.80.834Not recordedNot recorded2026-05-28 · model_announcementLLM Stats
Gemini 3.6 Flash0.83Not recordedNot recorded2026-07-21 · model_announcementLLM Stats
Claude Sonnet 50.812Not recordedNot recorded2026-06-30 · model_announcementLLM Stats
Muse Spark 1.10.808Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
Claude Mythos Preview0.796Not recordedNot recorded2026-04-07 · model_announcementLLM Stats
GPT-5.50.787Not recordedNot recorded2026-04-23 · model_announcementLLM Stats
Gemini 3.5 Flash0.784Not recordedNot recorded2026-05-19 · model_announcementLLM Stats
Claude Opus 4.70.78Not recordedNot recorded2026-04-16 · model_announcementLLM Stats
GPT-5.40.75Not recordedNot recorded2026-03-05 · model_announcementLLM Stats
Gemini 3.5 Flash-Lite0.74Not recordedNot recorded2026-07-21 · model_announcementLLM Stats
Qwen3.7-Plus0.733Not recordedNot recorded2026-05-31 · model_announcementLLM Stats
Kimi K2.60.731Not recordedNot recorded2026-04-20 · model_announcementLLM Stats
GPT-5.4 mini0.721Not recordedNot recorded2026-03-17 · model_announcementLLM Stats
MiniMax M30.7006Not recordedNot recorded2026-06-01 · model_announcementLLM Stats
Muse Glimmer-30B0.659Not recordedNot recorded2026-08-10 · model_announcementLLM Stats
GPT-5.3 Codex0.647Not recordedNot recorded2026-02-05 · model_announcementLLM Stats
Qwen3.6 Plus0.625Not recordedNot recorded2026-04-02 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.58Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.5-27B0.562Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.545Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
GPT-5.4 nano0.39Not recordedNot recorded2026-03-17 · model_announcementLLM Stats