VibeLifeBench: Can Your Life Agent Be Proactive and Persistent in a Living World?
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Large language model (LLM) agents are increasingly deployed as personal assistants. Existing evaluations, however, mostly use short, self-contained requests in static environments. Everyday life assistance is different. A task runs for weeks rather than minutes. The world keeps changing while the agent is not being prompted. Many constraints are never stated outright. An agent that merely answers the request in front of it will fail at such a task. What is needed instead is an agent that stays proactive and consistent. It decides on its own when to act, when to ask, and when to stay silent. It notices changes that nobody announced. It keeps one plan coherent from the first day to the last. No current benchmark measures this. We introduce VibeLifeBench, a benchmark of 200 long-horizon tasks across ten everyday-life domains. Each task is a scripted multi-week timeline in a simulated world of 22 mock services. The world advances on its own clock, and many of its changes are silent, so only an agent that re-inspects the world discovers them. Every task is graded by fine-grained, weighted checks that read only what the agent actually left behind, covering the end state, the timeliness of its actions, and whether it upheld the implicit constraints. We evaluate seven frontier models. All of them score low, which shows how far current agents are from assisting with real life. We will open-source all tasks, environments, and the evaluation framework.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 15 of its 20 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
15 of 20 references.
Closest ancestors · 5
Same direction, newest first
- 2026UniClawBench: A Universal Benchmark for Proactive Agents on Real-World Tasks9 Jul
- 2026Workspace-Bench 1.0: Benchmarking AI Agents on Workspace Tasks with Large-Scale File Dependencies5 May
- 2026ClawMark: A Living-World Benchmark for Multi-Turn, Multi-Day, Multimodal Coworker Agents26 Apr
- 2026ClawArena: Benchmarking AI Agents in Evolving Information Environments5 Apr
- 2025CostBench: Evaluating Multi-Turn Cost-Optimal Planning and Adaptation in Dynamic Environments for LLM Tool-Use Agents4 Nov
Other references · 10
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 158
- 2024SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agentscited by 133
- 2025LifelongAgentBench: Evaluating LLM Agents as Lifelong Learnerscited by 78
- 2026DeepSWE: Measuring Frontier Coding Agents on Original, Long-Horizon Engineering Taskscited by 49
- 2026Continual Learning Bench: Evaluating Frontier AI Systems in Real-World Stateful Environmentscited by 17
- 2025PPTBench: Towards Holistic Evaluation of Large Language Models for PowerPoint Layout and Design Understandingcited by 14
- 2025R-Horizon: How Far Can Your Large Reasoning Model Really Go in Breadth and Depth?cited by 8
- 2026SWE-Milestone: Evaluating AI Agents on Continuous Software Evolutioncited by 8
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026VibeSearchBench: Benchmarking Long-horizon Proactive Search in the Wild
- 2026ProAgentBench: Evaluating LLM Agents for Proactive Assistance with Real-World Data
- 2026WorldBench: Culturally Grounded Benchmark for Multilingual Agents
- 2026π-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflows
- 2025VitaBench: Benchmarking LLM Agents with Versatile Interactive Tasks in Real-world Applications
- 2026LiveAgentBench: Comprehensive Benchmarking of Agentic Systems Across 104 Real-World Challenges
- 2026DynamicMCPBench: A Trace-Grounded, Effect-Scored Benchmark for LLM Agents over Live MCP Servers
- 2026Ask Now, Use Later: Benchmarking the Proactivity Gap in Long-Lived LLM Agents