AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

Social IQa

The first large-scale benchmark for commonsense reasoning about social situations. Contains 38,000 multiple choice questions probing emotional and social intelligence in everyday situations, testing commonsense understanding of social interactions and theory of mind reasoning about the implied emotions and behavior of others.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 9

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Phi-3.5-MoE-instruct0.78Not recordedNot recorded2024-08-23 · model_announcementLLM Stats
Phi-3.5-mini-instruct0.747Not recordedNot recorded2024-08-23 · model_announcementLLM Stats
Phi 4 Mini0.725Not recordedNot recorded2025-02-01 · model_announcementLLM Stats
Gemma 2 27B0.537Not recordedNot recorded2024-06-27 · model_announcementLLM Stats
Gemma 2 9B0.534Not recordedNot recorded2024-06-27 · model_announcementLLM Stats
Gemma 3n E4B0.5Not recordedNot recorded2025-06-26 · model_announcementLLM Stats
Gemma 3n E4B Instructed LiteRT Preview0.5Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
Gemma 3n E2B0.488Not recordedNot recorded2025-06-26 · model_announcementLLM Stats
Gemma 3n E2B Instructed LiteRT (Preview)0.488Not recordedNot recorded2025-05-20 · model_announcementLLM Stats