AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

BrowseComp-zh

A high-difficulty benchmark purpose-built to comprehensively evaluate LLM agents on the Chinese web, consisting of 289 multi-hop questions spanning 11 diverse domains including Film & TV, Technology, Medicine, and History. Questions are reverse-engineered from short, objective, and easily verifiable answers, requiring sophisticated reasoning and information reconciliation beyond basic retrieval. The benchmark addresses linguistic, infrastructural, and censorship-related complexities in Chinese web environments.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 13

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen3.5-397B-A17B0.703Not recordedNot recorded2026-02-16 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.699Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.695Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
LongCat-Flash-Thinking-26010.69Not recordedNot recorded2026-01-14 · model_announcementLLM Stats
GLM-4.70.666Not recordedNot recorded2025-12-22 · model_announcementLLM Stats
DeepSeek-V3.2 (Thinking)0.65Not recordedNot recorded2025-12-01 · model_announcementLLM Stats
DeepSeek-V3.20.65Not recordedNot recorded2025-12-01 · model_announcementLLM Stats
Kimi K2-Thinking-09050.623Not recordedNot recorded2025-09-05 · model_announcementLLM Stats
Qwen3.5-27B0.621Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
DeepSeek-V3.10.492Not recordedNot recorded2025-01-10 · model_announcementLLM Stats
MiniMax M20.485Not recordedNot recorded2025-10-27 · model_announcementLLM Stats
DeepSeek-V3.2-Exp0.479Not recordedNot recorded2025-09-29 · model_announcementLLM Stats
DeepSeek-R1-05280.357Not recordedNot recorded2025-05-28 · model_announcementLLM Stats