AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

BFCL v2

Berkeley Function Calling Leaderboard (BFCL) v2 is a comprehensive benchmark for evaluating large language models' function calling capabilities. It features 2,251 question-function-answer pairs with enterprise and OSS-contributed functions, addressing data contamination and bias through live, user-contributed scenarios. The benchmark evaluates AST accuracy, executable accuracy, irrelevance detection, and relevance detection across multiple programming languages (Python, Java, JavaScript) and includes complex real-world function calling scenarios with multi-lingual prompts.

评测信息与证据

来源
LLM Stats
发布者
未收录
评测发布日期
未收录
采集日期
2026-08-17
模态
text

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 5

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Llama 3.3 70B Instruct0.773未收录未收录2024-12-06 · model_announcementLLM Stats
Llama 3.1 Nemotron Ultra 253B v10.741未收录未收录2025-04-07 · model_announcementLLM Stats
Llama-3.3 Nemotron Super 49B v10.737未收录未收录2025-03-18 · model_announcementLLM Stats
Llama 3.2 3B Instruct0.67未收录未收录2024-09-25 · model_announcementLLM Stats
Llama 3.1 Nemotron Nano 8B V10.636未收录未收录2025-03-18 · model_announcementLLM Stats