Model reports

Evaluation Agent

原始来源英文简介

A promptable evaluation framework rather than a fixed test set: it plans its own queries per model, so two runs need not ask the same questions. It does report numbers -- an average score per round and the per-prompt scores behind it -- but each is measured over the handful of prompts that run chose for that model, so they describe the run rather than a scale models can be ranked on.