AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

SEC-bench Pro

SEC-bench Pro is a self-evolving software-security benchmark that measures agent bug hunting on critical, high-complexity systems. It instantiates validated vulnerabilities across the V8 and SpiderMonkey JavaScript engines as reproducible vulnerability-discovery and proof-of-concept-generation tasks with oracle-based validation.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 3

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
GPT-5.6 Sol0.712Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
GPT-5.6 Terra0.577Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
GPT-5.6 Luna0.489Not recordedNot recorded2026-07-09 · model_announcementLLM Stats