AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

BrowseComp

BrowseComp is a benchmark comprising 1,266 questions that challenge AI agents to persistently navigate the internet in search of hard-to-find, entangled information. The benchmark measures agents' ability to exercise persistence in information gathering, demonstrate creativity in web navigation, and find concise, verifiable answers. Despite the difficulty of the questions, BrowseComp is simple and easy-to-use, as predicted answers are short and easily verifiable against reference answers.

Evaluation context and evidence

Source
LLM Stats
Publisher
OpenAI
Benchmark release
2025-04-10
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 62

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Kimi K30.912Not recordedNot recorded2026-07-16 · model_announcementLLM Stats
Claude Opus 50.908Not recordedNot recorded2026-07-24 · model_announcementLLM Stats
GPT-5.6 Sol0.904Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
GPT-5.5 Pro0.901Not recordedNot recorded2026-04-23 · model_announcementLLM Stats
GPT-5.6 Terra0.875Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
Claude Mythos Preview0.869Not recordedNot recorded2026-04-07 · model_announcementLLM Stats
Kimi K2.60.863Not recordedNot recorded2026-04-20 · model_announcementLLM Stats
Seed 2.1 Pro0.862Not recordedNot recorded2026-06-24 · model_announcementLLM Stats
Gemini 3.1 Pro0.859Not recordedNot recorded2026-02-19 · model_announcementLLM Stats
Seed 2.1 Turbo0.849Not recordedNot recorded2026-06-24 · model_announcementLLM Stats
Claude Sonnet 50.847Not recordedNot recorded2026-06-30 · model_announcementLLM Stats
GPT-5.50.844Not recordedNot recorded2026-04-23 · model_announcementLLM Stats
Claude Opus 4.80.843Not recordedNot recorded2026-05-28 · model_announcementLLM Stats
Hy30.842Not recordedNot recorded2026-07-06 · model_announcementLLM Stats
Claude Opus 4.60.84Not recordedNot recorded2026-02-05 · model_announcementLLM Stats
MiniMax M30.8352Not recordedNot recorded2026-06-01 · model_announcementLLM Stats
DeepSeek-V4-Pro-Max0.834Not recordedNot recorded2026-04-23 · model_announcementLLM Stats
GPT-5.6 Luna0.833Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
GPT-5.40.827Not recordedNot recorded2026-03-05 · model_announcementLLM Stats
Claude Opus 4.70.793Not recordedNot recorded2026-04-16 · model_announcementLLM Stats
GLM-5.10.793Not recordedNot recorded2026-04-07 · model_announcementLLM Stats
GPT-5.2 Pro0.779Not recordedNot recorded2025-12-11 · model_announcementLLM Stats
Inkling-Small0.774Not recordedNot recorded2026-07-30 · model_announcementLLM Stats
Seed 2.0 Pro0.773Not recordedNot recorded2026-02-14 · model_announcementLLM Stats
MiniMax M2.50.763Not recordedNot recorded2026-02-12 · model_announcementLLM Stats
GLM-50.759Not recordedNot recorded2026-02-11 · model_announcementLLM Stats
Kimi K2.50.749Not recordedNot recorded2026-01-27 · model_announcementLLM Stats
Claude Sonnet 4.60.747Not recordedNot recorded2026-02-17 · model_announcementLLM Stats
DeepSeek-V4-Flash-Max0.732Not recordedNot recorded2026-04-23 · model_announcementLLM Stats
Qwen3.5-397B-A17B0.69Not recordedNot recorded2026-02-16 · model_announcementLLM Stats
Step-3.5-Flash0.69Not recordedNot recorded2026-02-02 · model_announcementLLM Stats
GPT-5.20.658Not recordedNot recorded2025-12-11 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.638Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
MiniMax M2.10.62Not recordedNot recorded2025-12-23 · model_announcementLLM Stats
Qwen3.5-27B0.61Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.61Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Kimi K2-Thinking-09050.602Not recordedNot recorded2025-09-05 · model_announcementLLM Stats
MiMo-V2-Flash0.583Not recordedNot recorded2025-12-16 · model_announcementLLM Stats
LongCat-Flash-Thinking-26010.566Not recordedNot recorded2026-01-14 · model_announcementLLM Stats
GPT-50.549Not recordedNot recorded2025-08-07 · model_announcementLLM Stats
DeepSeek-V4-Flash-04230.535Not recordedNot recorded2026-04-23 · model_announcementLLM Stats
GLM-4.70.52Not recordedNot recorded2025-12-22 · model_announcementLLM Stats
o4-mini0.515Not recordedNot recorded2025-04-16 · model_announcementLLM Stats
DeepSeek-V3.20.514Not recordedNot recorded2025-12-01 · model_announcementLLM Stats
DeepSeek-V3.2 (Thinking)0.514Not recordedNot recorded2025-12-01 · model_announcementLLM Stats
o30.497Not recordedNot recorded2025-04-16 · model_announcementLLM Stats
Sarvam-105B0.495Not recordedNot recorded2026-03-06 · model_announcementLLM Stats
Solar Pro 40.492Not recordedNot recorded2026-08-06 · model_announcementLLM Stats
Mistral Medium 3.50.486Not recordedNot recorded2026-04-29 · model_announcementLLM Stats
GLM-4.60.451Not recordedNot recorded2025-09-30 · model_announcementLLM Stats
Grok 4 Fast0.449Not recordedNot recorded2025-08-28 · model_announcementLLM Stats
Nemotron 3 Ultra (550B A55B)0.444Not recordedNot recorded2026-06-04 · model_announcementLLM Stats
MiniMax M20.44Not recordedNot recorded2025-10-27 · model_announcementLLM Stats
GLM-4.7-Flash0.428Not recordedNot recorded2026-01-19 · model_announcementLLM Stats
DeepSeek-V3.2-Exp0.401Not recordedNot recorded2025-09-29 · model_announcementLLM Stats
Nemotron 3.5 Lightning (30B A3B)0.3697Not recordedNot recorded2026-08-11 · model_announcementLLM Stats
Sarvam-30B0.355Not recordedNot recorded2026-03-06 · model_announcementLLM Stats
Nemotron 3 Super (120B A12B)0.3128Not recordedNot recorded2026-03-11 · model_announcementLLM Stats
DeepSeek-V3.10.3Not recordedNot recorded2025-01-10 · model_announcementLLM Stats
GLM-4.50.264Not recordedNot recorded2025-07-28 · model_announcementLLM Stats
GLM-4.5-Air0.213Not recordedNot recorded2025-07-28 · model_announcementLLM Stats
DeepSeek-R1-05280.089Not recordedNot recorded2025-05-28 · model_announcementLLM Stats