AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

Claire Radar

VitaBench

VitaBench 2.0 evaluates personalized and proactive agent behavior in long-term, multi-session user interactions across food delivery, in-store consumption, and online travel domains. Tasks are per-user sequences of subtasks requiring agents to infer, utilize, and update user preferences from fragmented interaction history, with an extensible memory interface for controlled comparison across memory architectures.

Evidence available for this benchmark

Numeric results have not been collected for this source record. Use the paper, code or dataset below to check the task and experiments; this does not imply that the original work contains no results.

Start with these resources

Cited documents and dates (1)

Catalog collected on 2026-10-14; resources and fields reflect that saved source.

Recorded attention

Observed on: 2026-10-13

GitHub stars
71
Hugging Face paper upvotes
17
Star change · 30 days before observation
+3

meituan-longcat/vitabench-2.0 · View source snapshot

Dated attention observations, not live counts or benchmark scores.

Evaluation context and evidence

Source
Claire Radar
Publisher
Not recorded
Benchmark release
2026-05-26
Collected
2026-10-14
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Reported results 0

This source record has no numeric results in our collection. That does not mean a score of zero or that no public results exist. Consult the original resources above.