AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
Vending-Bench 2
Vending-Bench 2 tests longer horizon planning capabilities by evaluating how well AI models can manage a simulated vending machine business over extended periods. The benchmark measures a model's ability to maintain consistent tool usage and decision-making for a full simulated year of operation, driving higher returns without drifting off task.
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- Not recorded
- Benchmark release
- Not recorded
- Collected
- 2026-08-17
- Modality
- text
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 4
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| Claude Opus 4.6 | 8017.59 | Not recorded | Not recorded | 2026-02-05 · model_announcement | LLM Stats |
| GLM-5.1 | 5634.41 | Not recorded | Not recorded | 2026-04-07 · model_announcement | LLM Stats |
| Gemini 3 Pro | 5478.16 | Not recorded | Not recorded | 2025-11-18 · model_announcement | LLM Stats |
| Gemini 3 Flash | 3635.0 | Not recorded | Not recorded | 2025-12-17 · model_announcement | LLM Stats |