Six Navers Lab / Einsia benchmarks and the work they test
Compare the tasks, scoring and evidence behind six Einsia benchmarks, with complete Radar detail pages and original references.
Model reports
ZeroBench
Challenging visual reasoning benchmark designed to be impossible for frontier models at release; evaluates complex reasoning over images.
Evidence available for this benchmark
This source record contains 1 numeric observations. The source distinguishes 1 model identities or configurations. A model may appear more than once; check the version, tools and run budget before comparing. Read results and row-level evidence →
- Reported metric
- accuracy
- Recorded unit
- percent
- Metric direction
- higher is better
Start with these resources
Cited documents and dates (2)
Recorded attention
Observed on: 2026-10-12
- GitHub stars
- 71
- Hugging Face paper upvotes
- 43
jonathan-roberts1/zerobench · View source snapshot
Dated attention observations, not live counts or benchmark scores.
Evaluation context and evidence
- Source
- Model reports
- Publisher
- Not recorded
- Benchmark release
- 2025-02-13
- Collected
- Not recorded
- Modality
- Not recorded
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Reported results 1
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| Seed2.0 Pro | 12.0 | percent | accuracy on main and sub questions | 2026-02-14 · document_publication | Seed2.0 (Pro / Lite / Mini) |