AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

IFBench

Instruction Following Benchmark evaluating model's ability to follow complex instructions

Evaluation context and evidence

Source
LLM Stats
Publisher
Allen Institute for AI
Benchmark release
2025-07-03
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 34

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen3.8 Max0.828Not recordedNot recorded2026-08-02 · model_announcementLLM Stats
Inkling-Small0.822Not recordedNot recorded2026-07-30 · model_announcementLLM Stats
Nemotron 3 Ultra (550B A55B)0.817Not recordedNot recorded2026-06-04 · model_announcementLLM Stats
Hermes 3 70B0.8121Not recordedNot recorded2024-08-15 · model_announcementLLM Stats
Nova 2 Pro0.802Not recordedNot recorded2025-12-02 · model_announcementLLM Stats
Qwen3.8-27B0.795Not recordedNot recorded2026-08-14 · model_announcementLLM Stats
Qwen3.7-Plus0.791Not recordedNot recorded2026-05-31 · model_announcementLLM Stats
Qwen3.7 Max0.791Not recordedNot recorded2026-05-19 · model_announcementLLM Stats
Muse Glimmer-30B0.77Not recordedNot recorded2026-08-10 · model_announcementLLM Stats
Qwen3.5-27B0.765Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.5-397B-A17B0.765Not recordedNot recorded2026-02-16 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.761Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
MAI-Code-1-Flash0.75Not recordedNot recorded2026-06-02 · model_announcementLLM Stats
Qwen3.6 Plus0.742Not recordedNot recorded2026-04-02 · model_announcementLLM Stats
Command A+0.74Not recordedNot recorded2026-05-20 · model_announcementLLM Stats
Nemotron 3 Super (120B A12B)0.7256Not recordedNot recorded2026-03-11 · model_announcementLLM Stats
Nemotron 3.5 Lightning (30B A3B)0.7188Not recordedNot recorded2026-08-11 · model_announcementLLM Stats
Mercury 20.71Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Nova 2 Lite0.708Not recordedNot recorded2025-12-02 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.702Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
MiniMax M2.10.7Not recordedNot recorded2025-12-23 · model_announcementLLM Stats
GPT OSS 120B High0.695Not recordedNot recorded2025-08-05 · model_announcementLLM Stats
MAI-Thinking-10.69Not recordedNot recorded2026-06-02 · model_announcementLLM Stats
Mistral Medium 3.50.69Not recordedNot recorded2026-04-29 · model_announcementLLM Stats
Nova 2 Omni0.687Not recordedNot recorded2025-12-02 · model_announcementLLM Stats
K-EXAONE-236B-A23B0.673Not recordedNot recorded2025-12-31 · model_announcementLLM Stats
Qwen3.5-9B0.645Not recordedNot recorded2026-03-02 · model_announcementLLM Stats
Qwen3.5-4B0.592Not recordedNot recorded2026-03-02 · model_announcementLLM Stats
LFM2.5-2.6B0.5917Not recordedNot recorded2026-08-04 · model_announcementLLM Stats
Mistral Small 40.48Not recordedNot recorded2026-03-16 · model_announcementLLM Stats
Qwen3.5-2B0.413Not recordedNot recorded2026-03-02 · model_announcementLLM Stats
Nova 2 Sonic0.375Not recordedNot recorded2025-12-02 · model_announcementLLM Stats
LFM2.5-VL-3B0.258Not recordedNot recorded2026-08-12 · model_announcementLLM Stats
Qwen3.5-0.8B0.21Not recordedNot recorded2026-03-02 · model_announcementLLM Stats