AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

Gorilla Benchmark API Bench

APIBench, a comprehensive dataset of over 11,000 instruction-API pairs from HuggingFace, TorchHub, and TensorHub APIs for evaluating language models' ability to generate accurate API calls.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 3

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Llama 3.1 405B Instruct0.353Not recordedNot recorded2024-07-23 · model_announcementLLM Stats
Llama 3.1 70B Instruct0.297Not recordedNot recorded2024-07-23 · model_announcementLLM Stats
Llama 3.1 8B Instruct0.082Not recordedNot recorded2024-07-23 · model_announcementLLM Stats