MemArena: An Ego-Centric Benchmark for On-Device Agentic Personal Memory Assistants at Scale
NeurIPS 2026, Evaluations and Datasets Track
A single-world conversational benchmark generated by the MASim multi-agent simulator: 50 agents over 15 days, 10.3M tokens, and six evaluation dimensions, used to test memory backends and open-weight models on-device.