AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

BBH

Big-Bench Hard (BBH) is a suite of 23 challenging tasks selected from BIG-Bench for which prior language model evaluations did not outperform the average human-rater. These tasks require multi-step reasoning across diverse domains including arithmetic, logical reasoning, reading comprehension, and commonsense reasoning. The benchmark was designed to test capabilities believed to be beyond current language models and focuses on evaluating complex reasoning skills including temporal understanding, spatial reasoning, causal understanding, and deductive logical reasoning.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 12

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen3 235B A22B0.8887Not recordedNot recorded2025-04-29 · model_announcementLLM Stats
MiMo-V2.5-Pro0.884Not recordedNot recorded2026-04-27 · model_announcementLLM Stats
Nova Pro0.869Not recordedNot recorded2024-11-20 · model_announcementLLM Stats
Qwen2.5 32B Instruct0.845Not recordedNot recorded2024-09-19 · model_announcementLLM Stats
DeepSeek-V2.50.843Not recordedNot recorded2024-05-08 · model_announcementLLM Stats
Nova Lite0.824Not recordedNot recorded2024-11-20 · model_announcementLLM Stats
Qwen2 72B Instruct0.824Not recordedNot recorded2024-07-23 · model_announcementLLM Stats
MiniCPM-SALA0.8155Not recordedNot recorded2026-02-11 · model_announcementLLM Stats
Nova Micro0.795Not recordedNot recorded2024-11-20 · model_announcementLLM Stats
Qwen2.5 14B Instruct0.782Not recordedNot recorded2024-09-19 · model_announcementLLM Stats
Hermes 3 70B0.6782Not recordedNot recorded2024-08-15 · model_announcementLLM Stats
ERNIE 4.50.304Not recordedNot recorded2025-06-25 · model_announcementLLM Stats