AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

Multilingual MGSM (CoT)

Multilingual Grade School Math (MGSM) benchmark evaluates language models' chain-of-thought reasoning abilities across ten typologically diverse languages. Contains 250 grade-school math problems manually translated from GSM8K dataset into languages including Bengali and Swahili.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 3

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Llama 3.1 405B Instruct0.916Not recordedNot recorded2024-07-23 · model_announcementLLM Stats
Llama 3.1 70B Instruct0.869Not recordedNot recorded2024-07-23 · model_announcementLLM Stats
Llama 3.1 8B Instruct0.689Not recordedNot recorded2024-07-23 · model_announcementLLM Stats