AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
A high-difficulty benchmark purpose-built to comprehensively evaluate LLM agents on the Chinese web, consisting of 289 multi-hop questions spanning 11 diverse domains including Film & TV, Technology, Medicine, and History. Questions are reverse-engineered from short, objective, and easily verifiable answers, requiring sophisticated reasoning and information reconciliation beyond basic retrieval. The benchmark addresses linguistic, infrastructural, and censorship-related complexities in Chinese web environments.
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| Qwen3.5-397B-A17B | 0.703 | Not recorded | Not recorded | 2026-02-16 · model_announcement | LLM Stats |
| Qwen3.5-122B-A10B | 0.699 | Not recorded | Not recorded | 2026-02-24 · model_announcement | LLM Stats |
| Qwen3.5-35B-A3B | 0.695 | Not recorded | Not recorded | 2026-02-24 · model_announcement | LLM Stats |
| LongCat-Flash-Thinking-2601 | 0.69 | Not recorded | Not recorded | 2026-01-14 · model_announcement | LLM Stats |
| GLM-4.7 | 0.666 | Not recorded | Not recorded | 2025-12-22 · model_announcement | LLM Stats |
| DeepSeek-V3.2 (Thinking) | 0.65 | Not recorded | Not recorded | 2025-12-01 · model_announcement | LLM Stats |
| DeepSeek-V3.2 | 0.65 | Not recorded | Not recorded | 2025-12-01 · model_announcement | LLM Stats |
| Kimi K2-Thinking-0905 | 0.623 | Not recorded | Not recorded | 2025-09-05 · model_announcement | LLM Stats |
| Qwen3.5-27B | 0.621 | Not recorded | Not recorded | 2026-02-24 · model_announcement | LLM Stats |
| DeepSeek-V3.1 | 0.492 | Not recorded | Not recorded | 2025-01-10 · model_announcement | LLM Stats |
| MiniMax M2 | 0.485 | Not recorded | Not recorded | 2025-10-27 · model_announcement | LLM Stats |
| DeepSeek-V3.2-Exp | 0.479 | Not recorded | Not recorded | 2025-09-29 · model_announcement | LLM Stats |
| DeepSeek-R1-0528 | 0.357 | Not recorded | Not recorded | 2025-05-28 · model_announcement | LLM Stats |