AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

Model reports

IFEval

Verifiable-constraint subset only; does not measure answer quality.

Evaluation context and evidence

Source
Model reports
Publisher
Not recorded
Benchmark release
2023-11-14
Collected
Not recorded
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 4

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
DeepSeek-R183.3percentPrompt Strict2025-01-22 · document_publicationDeepSeek-R1
DeepSeek-V386.1percentPrompt Strict2024-12-27 · document_publicationDeepSeek-V3
Qwen3.5-397B-A17B92.6percentthinking (temp 0.6, top_p 0.95, top_k 20)2026-02-16 · document_publicationQwen3.5-397B-A17B
Qwen3-235B-A22B (Thinking)83.4percentstrict prompt2025-05-14 · document_publicationQwen3