AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

CharadesSTA

Charades-STA is a benchmark dataset for temporal activity localization via language queries, extending the Charades dataset with sentence temporal annotations. It contains 12,408 training and 3,720 testing segment-sentence pairs from videos with natural language descriptions and precise temporal boundaries for localizing activities based on language queries.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 12

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen3 VL 235B A22B Instruct0.648Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Instruct0.635Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 235B A22B Thinking0.635Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Thinking0.628Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Thinking0.627Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Instruct0.612Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Thinking0.599Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Thinking0.59Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Instruct0.56Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Instruct0.555Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen2.5 VL 32B Instruct0.542Not recordedNot recorded2025-02-28 · model_announcementLLM Stats
Qwen2.5 VL 7B Instruct0.436Not recordedNot recorded2025-01-26 · model_announcementLLM Stats