AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

AI benchmark topics

Explore AI evaluations by capability and domain. Topics can overlap; sharing a topic does not make two scores comparable.

Coding benchmarks

Understand code generation, repository repair and software engineering evaluations before comparing model results.

199 source records

Computer use benchmarks

Read evaluations of GUI grounding, browser actions and complete desktop or mobile workflows.

18 source records

Tools and agents benchmarks

Distinguish correct tool calls from successful multi-step work, and read results as evaluations of a configured system.

301 source records

Multimodal benchmarks

Find out which combinations of images, text, audio or video a benchmark actually evaluates.

372 source records

Reasoning and math benchmarks

Read reasoning results through the problem type, permitted tools and definition of a correct answer.

674 source records

Long context benchmarks

Distinguish accepting a long input from reliably retrieving, combining and summarizing information inside it.

81 source records

Language benchmarks

Interpret translation, instruction following and text quality results in the language and task where they were measured.

164 source records

Cybersecurity benchmarks

Distinguish CTF solving, vulnerability reproduction, exploit capability and secure coding results.

10 source records

Finance benchmarks

Understand financial document questions, numerical reasoning and evidence retrieval without confusing them with investment performance.

32 source records

Medical benchmarks

Distinguish medical knowledge questions from clinical documentation, communication and decision-support evaluations.

56 source records

Science benchmarks

Separate scientific knowledge, quantitative reasoning and research code when choosing an evaluation.

88 source records

MAKE SENSE OF THE SCORES

Find the right evaluation for your task

Start with the work you want an AI system to do. Then check the task definition, scoring rule and evaluation setup. Coding, cybersecurity, computer use and specialist-domain benchmarks answer different questions; a score is useful only with its source and context.

Explore the twelve benchmark topics