AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

OpenCompass Hub

MMAR

We introduce MMAR, a new benchmark comprising 1,000 meticulously curated audio-question-answer triplets, designed to evaluate the deep reasoning capabilities of Audio-Language Models (ALMs) across massive multi-disciplinary tasks.

Evaluation context and evidence

Source
OpenCompass Hub
Publisher
上海交通大学
Benchmark release
2025-05-11
Collected
2026-08-18
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 0

This source record has no numeric results in our collection. That does not mean a score of zero or that no public results exist. Consult the original resources above.