AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

FlenQA

Flexible Length Question Answering dataset for evaluating the impact of input length on reasoning performance of language models, featuring True/False questions embedded in contexts of varying lengths (250-3000 tokens) across three reasoning tasks: Monotone Relations, People In Rooms, and simplified Ruletaker

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 2

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Phi 4 Reasoning Plus0.979Not recordedNot recorded2025-04-30 · model_announcementLLM Stats
Phi 4 Reasoning0.977Not recordedNot recorded2025-04-30 · model_announcementLLM Stats