Six Navers Lab / Einsia benchmarks and the work they test
Compare the tasks, scoring and evidence behind six Einsia benchmarks, with complete Radar detail pages and original references.
Claire Radar
PAIR-Bench evaluates code improvement by transforming incorrect programs into more correct ones through feedback-guided refinement. It uses progressive hinting with failure-region and hint-depth controls to measure repair of targeted failures, generalization beyond the hint, preservation of correct behavior, and required assistance.
Numeric results have not been collected for this source record. Use the paper, code or dataset below to check the task and experiments; this does not imply that the original work contains no results.
Catalog collected on 2026-10-14; resources and fields reflect that saved source.
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
This source record has no numeric results in our collection. That does not mean a score of zero or that no public results exist. Consult the original resources above.