AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

ECLeKTic

A multilingual closed-book question answering dataset that evaluates cross-lingual knowledge transfer in large language models across 12 languages, using knowledge-seeking questions based on Wikipedia articles that exist only in one language

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 8

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Gemma 3n E4B Instructed0.19Not recordedNot recorded2025-06-26 · model_announcementLLM Stats
Gemma 3 27B0.167Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Gemma 3 12B0.103Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Gemma 3 4B0.046Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Gemma 3n E2B Instructed0.025Not recordedNot recorded2025-06-26 · model_announcementLLM Stats
Gemma 3n E2B Instructed LiteRT (Preview)0.025Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
Gemma 3n E4B Instructed LiteRT Preview0.019Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
Gemma 3 1B0.014Not recordedNot recorded2025-03-12 · model_announcementLLM Stats