AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

OSWorld 2.0

OSWorld 2.0 is a benchmark of 108 long-horizon, real-world computer-use workflows spanning everyday and professional tasks. Each task is an end-to-end workflow that takes human users a median of about 1.6 hours, scored with a binary-completion metric, and targets challenges such as dynamic environments, cross-source reasoning, and implicit-state inference.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 5

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Claude Opus 50.706Not recordedNot recorded2026-07-24 · model_announcementLLM Stats
GPT-5.6 Sol0.626Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
GPT-5.6 Terra0.502Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
Gemini 3.7 Flash0.479Not recordedNot recorded2026-08-13 · model_announcementLLM Stats
GPT-5.6 Luna0.456Not recordedNot recorded2026-07-09 · model_announcementLLM Stats