AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MT-Bench

MT-Bench is a challenging multi-turn benchmark that measures the ability of large language models to engage in coherent, informative, and engaging conversations. It uses strong LLMs as judges for scalable and explainable evaluation of multi-turn dialogue capabilities.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 12

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Hermes 3 70B8.99Not recordedNot recorded2024-08-15 · model_announcementLLM Stats
Qwen2.5 72B Instruct0.935Not recordedNot recorded2024-09-19 · model_announcementLLM Stats
Llama-3.3 Nemotron Super 49B v10.917Not recordedNot recorded2025-03-18 · model_announcementLLM Stats
DeepSeek-V2.50.902Not recordedNot recorded2024-05-08 · model_announcementLLM Stats
Qwen2.5 7B Instruct0.875Not recordedNot recorded2024-09-19 · model_announcementLLM Stats
Mistral Large 20.863Not recordedNot recorded2024-07-24 · model_announcementLLM Stats
Qwen2 7B Instruct0.841Not recordedNot recorded2024-07-23 · model_announcementLLM Stats
Mistral Small 3 24B Instruct0.835Not recordedNot recorded2025-01-30 · model_announcementLLM Stats
Ministral 8B Instruct0.83Not recordedNot recorded2024-10-16 · model_announcementLLM Stats
Llama 3.1 Nemotron Nano 8B V10.81Not recordedNot recorded2025-03-18 · model_announcementLLM Stats
Pixtral-12B0.768Not recordedNot recorded2024-09-17 · model_announcementLLM Stats
Llama 3.1 Nemotron 70B Instruct0.0899Not recordedNot recorded2024-10-01 · model_announcementLLM Stats