AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

Model reports

BrowseComp

Live web. The result depends on what the internet contained on the day of the run.

Evaluation context and evidence

Source
Model reports
Publisher
Not recorded
Benchmark release
2025-04-10
Collected
Not recorded
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 9

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
DeepSeek-V4-Pro80.4percentthink high, pass@12026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Pro83.4percentthink max, pass@12026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Flash73.2percentthink max, pass@12026-06-25 · document_publicationDeepSeek-V4
Gemini 3.1 Pro85.9percentThinking (High), Search + Python + Browse2026-02-19 · document_publicationGemini 3.1 Pro
Kimi K391.2percentreasoning=max2026-06-13 · document_publicationKimi K3
Qwen3.5-397B-A17B78.6percentthinking (temp 0.6, top_p 0.95, top_k 20), discard-all context strategy2026-02-16 · document_publicationQwen3.5-397B-A17B
Qwen3.5-397B-A17B69.0percentthinking (temp 0.6, top_p 0.95, top_k 20), simple context-folding2026-02-16 · document_publicationQwen3.5-397B-A17B
GLM-5.168.0percentno context management, as reported2026-04-03 · document_publicationGLM-5.1
GLM-562.0percentno context management, retain most recent 5 turns2026-02-11 · document_publicationGLM-5