AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MRCR v2

MRCR v2 (Multi-Round Coreference Resolution version 2) is an enhanced version of the synthetic long-context reasoning task. It extends the original MRCR framework with improved evaluation criteria and additional complexity for testing models' ability to maintain attention and reasoning across extended contexts.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 3

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen3.7-Plus0.917Not recordedNot recorded2026-05-31 · model_announcementLLM Stats
DiffusionGemma 26B-A4B0.32Not recordedNot recorded2026-06-10 · model_announcementLLM Stats
Gemini 2.5 Flash-Lite0.166Not recordedNot recorded2025-06-17 · model_announcementLLM Stats