AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

Translation en→Set1 COMET22

COMET-22 is an ensemble machine translation evaluation metric combining a COMET estimator model trained with Direct Assessments and a multitask model that predicts sentence-level scores and word-level OK/BAD tags. It demonstrates improved correlations compared to state-of-the-art metrics and increased robustness to critical errors.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 3

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Nova Pro0.891Not recordedNot recorded2024-11-20 · model_announcementLLM Stats
Nova Lite0.888Not recordedNot recorded2024-11-20 · model_announcementLLM Stats
Nova Micro0.885Not recordedNot recorded2024-11-20 · model_announcementLLM Stats