AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MMAU

A massive multi-task audio understanding and reasoning benchmark comprising 10,000 carefully curated audio clips paired with human-annotated natural language questions spanning speech, environmental sounds, and music. Requires expert-level knowledge and complex reasoning across 27 distinct skills.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 3

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Inkling-Small0.77Not recordedNot recorded2026-07-30 · model_announcementLLM Stats
Nova 2 Omni0.753Not recordedNot recorded2025-12-02 · model_announcementLLM Stats
Qwen2.5-Omni-7B0.656Not recordedNot recorded2025-03-27 · model_announcementLLM Stats