| GPT-6 Luna | 20.0 | percent | all evolved requirements disclosed at opening; acceptance, online gates and permissions retained; single-run Table 4 ablation; medium effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| Claude Fable 5.1 | 39.0 | percent | progressive disclosure; high effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| Claude Haiku 5.5 | 11.0 | percent | progressive disclosure; high effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| Claude Opus 5.5 | 39.0 | percent | progressive disclosure; high effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| Claude Sonnet 5.5 | 26.0 | percent | progressive disclosure; high effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| GPT-6 Astra | 45.0 | percent | progressive disclosure; high effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| GPT-6.1 Sol | 38.0 | percent | progressive disclosure; high effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| Gemini 3.8 Flash | 17.0 | percent | progressive disclosure; high effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| Gemini 4 Argon | 23.0 | percent | progressive disclosure; high effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| Grok 4.7 | 24.0 | percent | progressive disclosure; high effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| GLM-5.3 | 22.0 | percent | progressive disclosure; high effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified; textual-only grading (original dagger footnote) | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| DeepSeek V4.1 | 5.0 | percent | progressive disclosure; max effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| GLM-5.3 Flash | 15.0 | percent | progressive disclosure; max effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| GPT-6 Astra | 48.0 | percent | progressive disclosure; max effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| GPT-6 Sol | 18.0 | percent | progressive disclosure; max effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| Claude Opus 5.5 | 40.0 | percent | progressive disclosure; medium effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| GPT-6 Astra | 38.0 | percent | progressive disclosure; medium effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| GPT-6 Luna | 19.0 | percent | progressive disclosure; medium effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| GPT-6.1 Sol | 31.0 | percent | progressive disclosure; medium effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| Gemini 3.8 Flash | 17.0 | percent | progressive disclosure; medium effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| Gemini 4 Argon | 19.0 | percent | progressive disclosure; medium effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| Grok 4.6 | 17.0 | percent | progressive disclosure; medium effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| Qwen 3.8 27B | 6.0 | percent | progressive disclosure; medium effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| Qwen 3.8 Flash Next | 1.0 | percent | progressive disclosure; medium effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| Kimi-K3 | 6.0 | percent | progressive disclosure; mixed effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified; mixed original settings and high-effort repairs | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| GPT-5.5 | 18.0 | percent | progressive disclosure; xhigh effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| GPT-5.6 Terra | 34.0 | percent | progressive disclosure; xhigh effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| GPT-6 Astra | 45.0 | percent | progressive disclosure; xhigh effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |
| GPT-6.1 Sol | 42.0 | percent | progressive disclosure; xhigh effort; 100 assigned Lite task-persona pairs; native completion AND all mandatory persona requirements; every non-pass including errors/unexecuted is zero; source-specific scaffold, Harbor 0.23.0/Docker; GPT-6 Luna medium user simulator and judge; source budget/runtime revision applies, exact per-run timing revision and execution dates unspecified | 2026-11-03 · document_publication | PersonaCodeBench · original v1 evaluation |