Six Navers Lab / Einsia benchmarks and the work they test
Compare the tasks, scoring and evidence behind six Einsia benchmarks, with complete Radar detail pages and original references.
Model reports
About 32.2K general-science claims, balanced across Supported, Refuted and Not-Enough-Info, generated automatically from SciQ crowd-sourced exam questions by the Multi2Claim pipeline (EACL 2023). Annotators judged a quarter of claims answerable without the evidence, so part of a score can come from world knowledge rather than verification. Only 50 examples are public; the full set is on request.
Numeric results have not been collected for this source record. Use the paper, code or dataset below to check the task and experiments; this does not imply that the original work contains no results.
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
This source record has no numeric results in our collection. That does not mean a score of zero or that no public results exist. Consult the original resources above.