AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

nolima

Background on NoLiMa’s long-context retrieval task; this community entry does not specify a verified protocol or version.

Cited research guide; original source measurements remain independent.

Why literal matching is insufficient

The original research minimizes lexical overlap between a question and a relevant fact hidden in a long context. Models must recover the association rather than copy a matching phrase.

NoLiMa: research background — original paper

Compare the same context lengths

Read accuracy as a function of context length, including a short-context baseline. Advertised context capacity does not establish reliable retrieval at that length.

NoLiMa: research background — original paper

Original code and data

The authors release needles, haystacks and evaluation code. Use the repository to inspect prompts and the construction process.

NoLiMa: research background — authors’ project

Community entry limitation

The collected community record has no paper link or run configuration. This is educational background, not confirmation that its measurements reproduce the original NoLiMa setup. No scores are transferred.

NoLiMa: research background — original paper

Data source and credit: LLM Stats

Evidence available for this benchmark

Numeric results have not been collected for this source record. Use the paper, code or dataset below to check the task and experiments; this does not imply that the original work contains no results.

Start with these resources

Cited documents and dates (1)

Catalog collected on 2026-08-17; resources and fields reflect that saved source.

Recorded attention

Observed on: 2026-10-13

GitHub stars
205
Hugging Face paper upvotes
16

adobe-research/nolima · View source snapshot

Dated attention observations, not live counts or benchmark scores.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Reported results 0

This source record has no numeric results in our collection. That does not mean a score of zero or that no public results exist. Consult the original resources above.