AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MRCR 1M

MRCR 1M is a variant of the Multi-Round Coreference Resolution benchmark designed for testing extremely long context capabilities with approximately 1 million tokens. It evaluates models' ability to maintain reasoning and attention across ultra-long conversations.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 4

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
DeepSeek-V4-Pro-Max0.835Not recordedNot recorded2026-04-23 · model_announcementLLM Stats
DeepSeek-V4-Flash-Max0.787Not recordedNot recorded2026-04-23 · model_announcementLLM Stats
DeepSeek-V4-Flash-04230.769Not recordedNot recorded2026-04-23 · model_announcementLLM Stats
Gemini 2.0 Flash-Lite0.58Not recordedNot recorded2025-02-05 · model_announcementLLM Stats