Terrarium: Growing Personal Assistants via Scalable Synthesis of App Worlds
Not on the map. Why?
Abstract (arXiv)
Advances in large language models (LLMs) have brought the vision of a general-purpose personal assistant closer to reality. Such assistants could provide a unified natural-language interface to a broad ecosystem of applications. However, real-world applications do not readily support training at scale because access is often restricted and their state is difficult to reset. To address this challenge, we introduce Terrarium, a framework that synthesizes executable App Worlds from real-world application information, generates training task packages with evaluator-side rubrics from these worlds, and iteratively validates and refines both through agent rollouts. For App World synthesis, Terrarium organizes public Web information and in-application observations into structured app specifications that guide the construction of self-contained runtimes with callable operations and mutable, resettable state. For task synthesis, Terrarium constructs tasks grounded in App World state together with evaluator-side outcome rubrics that assess success without prescribing reference trajectories. We construct a training suite of 275 App Worlds and 13,344 tasks for outcome-based reinforcement learning across three Qwen3 model scales (4B, 8B, and 14B parameters). Across these scales, models trained with Terrarium outperform the corresponding Qwen3 models by an average of 18.34 percentage points on the τ2-bench and 10.94 percentage points on the AppWorld bench. These results suggest that app-grounded world and task synthesis offers a scalable path toward general-purpose assistants capable of operating across broad application ecosystems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 41 references that are in the map. First posted on arXiv 10 Oct 2026.
Builds on
30 of 41 references.
References · 30
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2023CogAgent: A Visual Language Model for GUI Agentscited by 704
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
- 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
18 more
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 567
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 563
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 417
- 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 295
- 2023AutoDroid: LLM-powered Task Automation in Androidcited by 184
- 2023RestGPT: Connecting Large Language Models with Real-World RESTful APIscited by 135
- 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorialscited by 130
- 2024AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Callscited by 124
- 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environmentscited by 72
- 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learningcited by 66
- 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
- 2025Towards General Agentic Intelligence via Environment Scalingcited by 54
- 2025AgentSynth: Scalable Task Generation for Generalist Computer-Use Agentscited by 46
- 2025REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websitescited by 45
- 2025Procedural Environment Generation for Tool-Use Agentscited by 24
- 2026Safe and Scalable Web Agent Learning via Recreated Websitescited by 11
- 2026UI-Oceanus: Scaling GUI Agents with Synthetic Environmental Dynamicscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AppWorld-UL: Benchmarking Diverse Agent-User Interactions for Tool-Use
- 2026Claw-Anything: Benchmarking Always-On Personal Assistants with Broader Access to User's Digital World
- 2026APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents
- 2026Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User Interfaces
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents
- 2026π-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflows
- 2026PSPA-Bench: A Personalized Benchmark for Smartphone GUI Agent
- 2026ClawGym: A Scalable Framework for Building Effective Claw Agents