Six Navers Lab / Einsia benchmarks and the work they test
Compare the tasks, scoring and evidence behind six Einsia benchmarks, with complete Radar detail pages and original references.
Model reports
MultiChallenge
Multi-turn instruction retention, graded by an LLM judge.
Evidence available for this benchmark
This source record contains 3 numeric observations. The source distinguishes 3 model identities or configurations. A model may appear more than once; check the version, tools and run budget before comparing. Read results and row-level evidence →
- Reported metric
- accuracy
- Recorded unit
- percent
- Metric direction
- higher is better
Start with these resources
Cited documents and dates (1)
Recorded attention
Observed on: 2026-10-10
- GitHub stars
- 98
- Hugging Face paper upvotes
- 1
Dated attention observations, not live counts or benchmark scores.
Evaluation context and evidence
- Source
- Model reports
- Publisher
- Not recorded
- Benchmark release
- 2025-01-29
- Collected
- Not recorded
- Modality
- Not recorded
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Reported results 3
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| Seed2.0 Pro | 68.3 | percent | as printed in Table 3 (Large Models) | 2026-02-14 · document_publication | Seed2.0 (Pro / Lite / Mini) |
| Seed2.0 Lite | 63.2 | percent | as printed in Table 4 (Efficient Models) | 2026-02-14 · document_publication | Seed2.0 (Pro / Lite / Mini) |
| Seed2.0 Mini | 61.1 | percent | as printed in Table 4 (Efficient Models) | 2026-02-14 · document_publication | Seed2.0 (Pro / Lite / Mini) |