AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
THE BENCHMARK DIRECTORY
AI benchmarks
Explore 1,286 AI benchmark source records, compare reported model results in context and follow the original evidence.
MAKE SENSE OF THE SCORES
Find the right evaluation for your task
Start with the work you want an AI system to do. Then check the task definition, scoring rule and evaluation setup. Coding, cybersecurity, computer use and specialist-domain benchmarks answer different questions; a score is useful only with its source and context.
Explore the twelve benchmark topics
How to compare AI benchmark scores without mixing protocols
A practical sequence for checking task versions, metrics, tools, budgets, uncertainty and reporting sources.
Choose benchmarks for coding, cybersecurity and computer use agents
Match your agent's job to a verifiable outcome, then build a small evaluation portfolio that covers its distinct failure modes.
Browse the directory
- A-BenchOpenCompass Hub
- A-OKVQAOpenCompass Hub
- AA-AnalystAgentArtificial Analysis
- AA-BriefcaseArtificial Analysis
- AA-BriefcaseLLM Stats
- AA-IndexLLM Stats
- AA-LCRArtificial Analysis
- AA-LCRLLM Stats
- AA-LCRModel reports
- AA-Omniscience AccuracyArtificial Analysis
- AA-Omniscience IndexLLM Stats
- AA-Omniscience Non-Hallucination RateArtificial Analysis