AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

FRAMES

Factuality, Retrieval, And reasoning MEasurement Set - a unified evaluation dataset of 824 challenging multi-hop questions for testing retrieval-augmented generation systems across factuality, retrieval accuracy, and reasoning capabilities, requiring integration of 2-15 Wikipedia articles per question

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 2

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Kimi K2-Thinking-09050.87Not recordedNot recorded2025-09-05 · model_announcementLLM Stats
DeepSeek-V30.733Not recordedNot recorded2024-12-25 · model_announcementLLM Stats