AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

OpenCompass Hub

AMBROSIA

AMBROSIA is a new benchmark for recognizing and interpreting ambiguous requests in text-to-SQL. It contains questions showcasing three different types of ambiguity (scope ambiguity, attachment ambiguity, and vagueness), their interpretations, and corresponding SQL queries.

Evaluation context and evidence

Source
OpenCompass Hub
Publisher
University of Edinburgh
Benchmark release
2024-06-27
Collected
2026-08-18
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 0

This source record has no numeric results in our collection. That does not mean a score of zero or that no public results exist. Consult the original resources above.