AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

IFEval

Instruction-Following Evaluation (IFEval) benchmark for large language models, focusing on verifiable instructions with 25 types of instructions and around 500 prompts containing one or more verifiable constraints

Evaluation context and evidence

Source
LLM Stats
Publisher
Google
Benchmark release
2023-11-14
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 67

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen3.5-27B0.95Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.7-Plus0.946Not recordedNot recorded2026-05-31 · model_announcementLLM Stats
Qwen3.7 Max0.943Not recordedNot recorded2026-05-19 · model_announcementLLM Stats
Qwen3.6 Plus0.943Not recordedNot recorded2026-04-02 · model_announcementLLM Stats
o3-mini0.939Not recordedNot recorded2025-01-30 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.934Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Claude 3.7 Sonnet0.932Not recordedNot recorded2025-02-24 · model_announcementLLM Stats
Qwen3.5-397B-A17B0.926Not recordedNot recorded2026-02-16 · model_announcementLLM Stats
Llama 3.3 70B Instruct0.921Not recordedNot recorded2024-12-06 · model_announcementLLM Stats
Nova Pro0.921Not recordedNot recorded2024-11-20 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.919Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.5-9B0.915Not recordedNot recorded2026-03-02 · model_announcementLLM Stats
Gemma 3 27B0.904Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Nemotron Nano 9B v20.903Not recordedNot recorded2025-08-18 · model_announcementLLM Stats
Gemma 3 4B0.902Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Qwen3.5-4B0.898Not recordedNot recorded2026-03-02 · model_announcementLLM Stats
Kimi K2-Instruct-09050.898Not recordedNot recorded2025-09-05 · model_announcementLLM Stats
Kimi K2 Instruct0.898Not recordedNot recorded2025-07-11 · model_announcementLLM Stats
Nova Lite0.897Not recordedNot recorded2024-11-20 · model_announcementLLM Stats
LongCat-Flash-Chat0.8965Not recordedNot recorded2025-08-29 · model_announcementLLM Stats
Llama 3.1 Nemotron Ultra 253B v10.8945Not recordedNot recorded2025-04-07 · model_announcementLLM Stats
Qwen3-Next-80B-A3B-Thinking0.889Not recordedNot recorded2025-09-10 · model_announcementLLM Stats
Gemma 3 12B0.889Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Qwen3-235B-A22B-Instruct-25070.887Not recordedNot recorded2025-07-22 · model_announcementLLM Stats
Llama 3.1 405B Instruct0.886Not recordedNot recorded2024-07-23 · model_announcementLLM Stats
Qwen3 VL 235B A22B Thinking0.882Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
GPT-4.50.882Not recordedNot recorded2025-02-27 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.878Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Thinking0.878Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3-235B-A22B-Thinking-25070.878Not recordedNot recorded2025-07-25 · model_announcementLLM Stats
Qwen3-Next-80B-A3B-Instruct0.876Not recordedNot recorded2025-09-10 · model_announcementLLM Stats
Llama 3.1 70B Instruct0.875Not recordedNot recorded2024-07-23 · model_announcementLLM Stats
GPT-4.10.874Not recordedNot recorded2025-04-14 · model_announcementLLM Stats
Kimi-k1.50.872Not recordedNot recorded2025-01-20 · model_announcementLLM Stats
Nova Micro0.872Not recordedNot recorded2024-11-20 · model_announcementLLM Stats
DeepSeek-V30.861Not recordedNot recorded2024-12-25 · model_announcementLLM Stats
Qwen3 VL 30B A3B Instruct0.858Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Phi 4 Reasoning Plus0.849Not recordedNot recorded2025-04-30 · model_announcementLLM Stats
Sarvam-105B0.848Not recordedNot recorded2026-03-06 · model_announcementLLM Stats
Qwen3 VL 32B Instruct0.847Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
GPT-4.1 mini0.841Not recordedNot recorded2025-04-14 · model_announcementLLM Stats
Qwen2.5 72B Instruct0.841Not recordedNot recorded2024-09-19 · model_announcementLLM Stats
QwQ-32B0.839Not recordedNot recorded2025-03-05 · model_announcementLLM Stats
Qwen3 VL 8B Instruct0.837Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Phi 4 Reasoning0.834Not recordedNot recorded2025-04-30 · model_announcementLLM Stats
Qwen3 VL 8B Thinking0.832Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Mistral Small 3 24B Instruct0.829Not recordedNot recorded2025-01-30 · model_announcementLLM Stats
Qwen3 VL 4B Thinking0.826Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
LFM2.5-VL-3B0.823Not recordedNot recorded2026-08-12 · model_announcementLLM Stats
Qwen3 VL 4B Instruct0.823Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Thinking0.817Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
GPT-4o0.81Not recordedNot recorded2024-08-06 · model_announcementLLM Stats
Llama 3.1 8B Instruct0.804Not recordedNot recorded2024-07-23 · model_announcementLLM Stats
Gemma 3 1B0.802Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Llama 3.1 Nemotron Nano 8B V10.793Not recordedNot recorded2025-03-18 · model_announcementLLM Stats
Qwen3.5-2B0.786Not recordedNot recorded2026-03-02 · model_announcementLLM Stats
Llama 3.2 3B Instruct0.774Not recordedNot recorded2024-09-25 · model_announcementLLM Stats
MiniCPM-SALA0.7634Not recordedNot recorded2026-02-11 · model_announcementLLM Stats
North Micro Vision Instruct0.749Not recordedNot recorded2026-08-12 · model_announcementLLM Stats
Granite 3.3 8B Base0.7482Not recordedNot recorded2025-04-16 · model_announcementLLM Stats
Granite 3.3 8B Instruct0.7482Not recordedNot recorded2025-04-16 · model_announcementLLM Stats
GPT-4.1 nano0.745Not recordedNot recorded2025-04-14 · model_announcementLLM Stats
Qwen2.5 7B Instruct0.712Not recordedNot recorded2024-09-19 · model_announcementLLM Stats
IBM Granite 4.0 Tiny Preview0.63Not recordedNot recorded2025-05-02 · model_announcementLLM Stats
Phi 40.63Not recordedNot recorded2024-12-12 · model_announcementLLM Stats
Pixtral-12B0.613Not recordedNot recorded2024-09-17 · model_announcementLLM Stats
Qwen3.5-0.8B0.44Not recordedNot recorded2026-03-02 · model_announcementLLM Stats

Related records in other sources