Coding benchmarks
Understand code generation, repository repair and software engineering evaluations before comparing model results.
199 source recordsExplore AI evaluations by capability and domain. Topics can overlap; sharing a topic does not make two scores comparable.
Understand code generation, repository repair and software engineering evaluations before comparing model results.
199 source recordsRead evaluations of GUI grounding, browser actions and complete desktop or mobile workflows.
18 source recordsDistinguish correct tool calls from successful multi-step work, and read results as evaluations of a configured system.
301 source recordsFind out which combinations of images, text, audio or video a benchmark actually evaluates.
372 source recordsRead reasoning results through the problem type, permitted tools and definition of a correct answer.
674 source recordsDistinguish accepting a long input from reliably retrieving, combining and summarizing information inside it.
81 source recordsInterpret translation, instruction following and text quality results in the language and task where they were measured.
164 source recordsSeparate harmful compliance, unnecessary refusal and reliability failures when interpreting safety evaluations.
64 source recordsDistinguish CTF solving, vulnerability reproduction, exploit capability and secure coding results.
10 source recordsUnderstand financial document questions, numerical reasoning and evidence retrieval without confusing them with investment performance.
32 source recordsDistinguish medical knowledge questions from clinical documentation, communication and decision-support evaluations.
56 source recordsSeparate scientific knowledge, quantitative reasoning and research code when choosing an evaluation.
88 source recordsMAKE SENSE OF THE SCORES
Start with the work you want an AI system to do. Then check the task definition, scoring rule and evaluation setup. Coding, cybersecurity, computer use and specialist-domain benchmarks answer different questions; a score is useful only with its source and context.
Explore the twelve benchmark topics
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
A practical sequence for checking task versions, metrics, tools, budgets, uncertainty and reporting sources.
Match your agent's job to a verifiable outcome, then build a small evaluation portfolio that covers its distinct failure modes.