AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
BenchCAD
BenchCAD is a benchmark for programmatic CAD reasoning built from 17,900 execution-verified CadQuery programs spanning 106 industrial part families, roughly half anchored to real ISO, DIN, EN, ASME, and IEC specification tables. It decomposes CAD capability into matched tasks; the Vision2Code task requires models to generate CadQuery code from multi-view renders, scored by voxel IoU against the reference geometry.
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- Not recorded
- Benchmark release
- Not recorded
- Collected
- 2026-08-17
- Modality
- multimodal
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 4
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| GPT-5.6 Sol | 0.706 | Not recorded | Not recorded | 2026-07-09 · model_announcement | LLM Stats |
| GPT-5.6 Luna | 0.631 | Not recorded | Not recorded | 2026-07-09 · model_announcement | LLM Stats |
| GPT-5.6 Terra | 0.623 | Not recorded | Not recorded | 2026-07-09 · model_announcement | LLM Stats |
| Claude Sonnet 5 | 0.373 | Not recorded | Not recorded | 2026-06-30 · model_announcement | LLM Stats |