AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

OpenCompass Hub

PIQA

PIQA is a physical interaction question answering task, which requires to select the most reasonable solution based on the given scenario and two possible solutions. This task is designed to test the model's knowledge in physical commonsense. This dataset consists of 16k training samples, 800 development samples and 2k test samples, all on English text.

Evaluation context and evidence

Source
OpenCompass Hub
Publisher
Not recorded
Benchmark release
2019-11-26
Collected
2026-08-18
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 0

This source record has no numeric results in our collection. That does not mean a score of zero or that no public results exist. Consult the original resources above.