AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

OpenCompass Hub

SVAMP

SVAMP includes one-unknown arithmetic word problems with grade level up to 4 by applying simple variations over word problems in an existing dataset. SVAMP further highlights the brittle nature of existing models when trained on these benchmark datasets.

Evaluation context and evidence

Source
OpenCompass Hub
Publisher
Microsoft Research India
Benchmark release
2021-04-15
Collected
2026-08-18
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 0

This source record has no numeric results in our collection. That does not mean a score of zero or that no public results exist. Consult the original resources above.