AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

Artificial Analysis

AA-AnalystAgent

Quantitative analysis on spreadsheets & documents

Evidence available for this benchmark

This source record contains 30 numeric observations. The source distinguishes 30 model identities or configurations. A model may appear more than once; check the version, tools and run budget before comparing. Read results and row-level evidence →

Metric direction
higher is better

Start with these resources

Cited documents and dates (1)

Catalog collected on 2026-08-25; resources and fields reflect that saved source.

Evaluation context and evidence

Source
Artificial Analysis
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-25
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Reported results 30

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Gemini 3.7 Flash (high)0.6Not recordedNot recorded2026-08-13 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, Max Effort)0.5375Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
GPT-5.5 (xhigh)0.5Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)0.4875Not recordedNot recorded2026-06-09 · model_announcementArtificial Analysis
GPT-5.6 Sol (max)0.475Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Sonnet 5 (Adaptive Reasoning, Max Effort)0.4625Not recordedNot recorded2026-06-30 · model_announcementArtificial Analysis
Gemini 3.5 Flash (high)0.45Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
Claude Opus 4.8 (Adaptive Reasoning, Max Effort)0.45Not recordedNot recorded2026-05-28 · model_announcementArtificial Analysis
Claude Opus 4.7 (Adaptive Reasoning, Max Effort)0.4375Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
Gemini 3.1 Pro Preview0.4125Not recordedNot recorded2026-02-19 · model_announcementArtificial Analysis
Grok 4.6 (high)0.4125Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Kimi K3 (max)0.3875Not recordedNot recorded2026-07-16 · model_announcementArtificial Analysis
Grok 4.5 (high)0.35Not recordedNot recorded2026-07-08 · model_announcementArtificial Analysis
Inkling Small0.275Not recordedNot recorded2026-07-30 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Reasoning, Max Effort)0.25Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Inkling (xhigh)0.2375Not recordedNot recorded2026-07-15 · model_announcementArtificial Analysis
MiMo-V2.5-Pro0.2Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)0.2Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
Qwen3.7 Max0.1875Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Reasoning, Max Effort)0.1875Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Reasoning)0.15Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
GPT-5.4 mini (xhigh)0.15Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Mistral Medium 3.50.125Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
MiniMax-M2.70.1125Not recordedNot recorded2026-03-18 · model_announcementArtificial Analysis
MiniMax-M30.1Not recordedNot recorded2026-06-01 · model_announcementArtificial Analysis
Gemini 3.1 Flash-Lite0.0875Not recordedNot recorded2026-03-03 · model_announcementArtificial Analysis
Grok 4.3 (high)0.0875Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
GPT-5.5 (Non-reasoning)0.075Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Nemotron 3 Ultra 550B A55B (Reasoning)0.0625Not recordedNot recorded2026-06-04 · model_announcementArtificial Analysis
Mistral Small 4 (Reasoning)0.0125Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis