AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

OpenCompass Hub

CLEVER

CLEVER is a benchmark suite for end-to-end code generation and formal verification in Lean 4, adapted from the HumanEval dataset. It requires models to generate implementations, formal specifications, and proofs—all verifiable by Lean's type checker, moving beyond test-case-driven evaluation.

Evaluation context and evidence

Source
OpenCompass Hub
Publisher
University of Texas at Austin ,etc
Benchmark release
2025-05-20
Collected
2026-08-18
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 0

This source record has no numeric results in our collection. That does not mean a score of zero or that no public results exist. Consult the original resources above.