Beyond Scaling: Agents Are Heading to the Edge
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
The bottleneck of useful agentic intelligence has shifted from compressing world knowledge into a single model to executing a coordinated system. This position paper argues that personal-agent architecture must move to the edge because the core properties of agentic intelligence tasks, particularly their structural coupling with high-fidelity local context and the need for zero-latency execution loops, do not sit well with cloud-centric designs. We develop this claim through three structural shifts. First, the Prefrontal Turn: the main marginal lever of capability has moved from pre-training scale to framework-level executive control. Such control must remain physically close to the environment of action if the agent is to preserve cognitive alignment. Second, the Data-Geography Paradox, the ``dark matter'' of agentic data (local file hierarchies, real-time sensor streams, and transient OS states) degrades, disappears, or loses meaning once prepared for cloud transmission, thereby cutting the agent off from ground-truth context. Third, the interaction-alignment loop, the only economically and ecologically sustainable source of agentic refinement data is the high-fidelity implicit preference signal produced through real-time local interaction. Third, the interaction-alignment loop, the only economically and ecologically sustainable source of agentic refinement data is the high-fidelity implicit preference signal produced through real-time local interaction. We conclude with falsifiable predictions for the next deployment cycle of personal agents.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 45 of its 72 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
45 of 72 references.
Closest ancestors · 11
Same direction, newest first
- 2026WideSeek-R1: Exploring Width Scaling for Broad Information Seeking via Multi-Agent Reinforcement Learning4 Feb
- 2025Small Language Models are the Future of Agentic AI2 Jun
- 2024Distributed Mixture-of-Agents for Edge Inference with Large Language Models30 Dec
- 2024Language Agents as Optimizable Graphs26 Feb
- 2023Evaluating Language-Model Agents on Realistic Autonomous Tasks18 Dec
- 2023AgentTuning: Enabling Generalized Agent Abilities for LLMs19 Oct
- 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
- 2023Cognitive Architectures for Language Agents5 Sep
- 2023A Survey on Large Language Model based Autonomous Agents22 Aug
- 2023AgentBench: Evaluating LLMs as Agents7 Aug
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
Other references · 34
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
22 more
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2020Scaling Laws for Autoregressive Generative Modelingcited by 510
- 2023LaMP: When Large Language Models Meet Personalizationcited by 425
- 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 407
- 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 314
- 2023On the Planning Abilities of Large Language Models : A Critical Investigationcited by 308
- 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perceptioncited by 283
- 2019Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computingcited by 225
- 2024MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Casescited by 216
- 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 203
- 2023SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefillscited by 187
- 2023LLM in a flash: Efficient Large Language Model Inference with Limited Memorycited by 170
- 2023S-LoRA: Serving Thousands of Concurrent LoRA Adapterscited by 146
- 2024Seven Failure Points When Engineering a Retrieval Augmented Generation Systemcited by 138
- 2024On-Device Language Models: A Comprehensive Reviewcited by 101
- 2023Levels of AGI for Operationalizing Progress on the Path to AGIcited by 94
- 2024Octopus v2: On-device language model for super agentcited by 45
- 2023Distributed Inference and Fine-tuning of Large Language Models Over The Internetcited by 42
- 2024Model Swarms: Collaborative Search to Adapt LLM Experts via Swarm Intelligencecited by 27
- 2024LLM2Swarm: Robot Swarms that Responsively Reason, Plan, and Collaborate through LLMscited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026ComBodied Agents: a New Paradigm of Human-Centric Agentic AI11 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2025Towards a Science of Scaling Agent Systems
- 2026From Model Scaling to System Scaling: Scaling the Harness in Agentic AI
- 2026Grounded Scaling: Why Agentic AI Needs Deterministic Environments
- 2026Scalable Environments Drive Generalizable Agents
- 2026The Agentic Company OS: Substrate Inversion for Sustained Enterprise Agent Deployment
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gaps
- 2026Apodex 1.1: Scaling Agentic Intelligence for Complex Work