AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MM IF-Eval

A challenging multimodal instruction-following benchmark that includes both compose-level constraints for output responses and perception-level constraints tied to input images, with comprehensive evaluation pipeline.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 2

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
LFM2.5-VL-3B0.606Not recordedNot recorded2026-08-12 · model_announcementLLM Stats
Pixtral-12B0.527Not recordedNot recorded2024-09-17 · model_announcementLLM Stats