AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

Android Control Low_EM

Android control benchmark evaluating autonomous agents on mobile device interaction tasks with low exact match scoring criteria

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 3

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen2.5 VL 72B Instruct0.937Not recordedNot recorded2025-01-26 · model_announcementLLM Stats
Qwen2.5 VL 32B Instruct0.933Not recordedNot recorded2025-02-28 · model_announcementLLM Stats
Qwen2.5 VL 7B Instruct0.914Not recordedNot recorded2025-01-26 · model_announcementLLM Stats