AI 评测,从数据到方法。BY EQUALITY MACHINE

THE BENCHMARK DIRECTORY / 评测标准索引

AI 评测标准索引

任务定义、模型成绩,
以及它们背后的方法与来源。

3,772 条来源记录 / 5 个目录来源

浏览目录3,772 条记录

下载完整目录 ↓
名称排序 · 来源记录
Claire Radar

2d-fet-bench

Field-effect transistor (FET) layouts on exfoliated two-dimensional flakes are typically drawn by hand for each flake, placing contacts and gates to match its position and outline in optical micrographs.

推理与数学
Claire Radar

360CityArena

360CityArena evaluates embodied agents in a photorealistic virtual urban environment built from 360-degree video of Tokyo's Akihabara district. It includes 175 tasks across environment understanding, path reasoning, and spatial reasoning, testing localization, landmark search,…

待分类
论文 · 代码详情
Claire Radar

3DCodeBench

3DCodeBench evaluates vision-language model agents on procedural 3D modeling by converting text and image references into Blender Python code. It includes 212 object categories with ground-truth scripts, and scores outputs on executability, image similarity (SigLIP-2/DINOv3),…

编程 / 多模态
论文 · 代码详情
Claire Radar

4DSynth-Nav

Evaluates embodied agents on interactive navigation tasks in procedurally generated 4D environments with independently tunable difficulty axes.

待分类
Claire Radar

5-Dialects-BN

Evaluation object not clearly defined; abstract mentions alignment of Romanized transliteration with dialectal text, Standard Bangla, English, and subjectivity labels across five Bangla regional varieties, but no explicit task or scoring setup is provided.

待分类
Claire Radar

A Large-Scale Dataset and Benchmark

InteractBind provides a large-scale dataset of ~100k protein-ligand pairs with fine-grained binding-site localization tasks and interaction maps for six non-covalent interaction types, plus affinity and similarity-controlled splits.

科学
Claire Radar

A Real-World CAD Segmentation Benchmark

CAD segmentation datasets are predominantly synthetic or automatically labelled, leaving it unclear how well existing methods transfer to real-world engineering tasks.

待分类
OpenCompass Hub

A-Bench

A-Bench是一个旨在诊断 LMMs 是否擅长评估 AIGIs 的基准,从 16 个文本到图像模型中采样了 2,864 个 AIGIs,每个都与由人类专家标注的问题-答案配对。

多模态
论文 · 代码 · 数据集详情
OpenCompass Hub

A-OKVQA

A-OKVQA用于评估多模态大模型的常识及推理能力,由25K个不同的问题组成,需要对图像中描述的场景进行某种形式的常识性推理来回答。

多模态 / 推理与数学
论文 · 代码详情
Claire Radar

A3S-Bench

A3S-Bench is an executable security test suite for evaluating autonomous agents across multi-turn scenarios and agent-level risks using an action-grounded oracle.

工具与智能体
论文 · 代码详情
每个来源保留独立记录;关联评测也保留各自的证据与口径。未收录成绩的评测仍可检索。