AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

OpenCompass Hub

SIQA

SIQA is a social interaction question answering task, which requires to select the most reasonable behavior based on the given scenario and three possible subsequent behaviors. This task is designed to test the model's knowledge in social commonsense. This dataset consists of 38,963 training samples, 1,951 development samples and 1,960 test samples, all on English text.

Evaluation context and evidence

Source
OpenCompass Hub
Publisher
Not recorded
Benchmark release
2019-09-09
Collected
2026-08-18
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 0

This source record has no numeric results in our collection. That does not mean a score of zero or that no public results exist. Consult the original resources above.