Adaptive and Resource-efficient Agentic AI Systems for Mobile and Embedded Devices: A Survey
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Foundation models have reshaped AI by unifying fragmented architectures into scalable backbones with multimodal reasoning and contextual adaptation. In parallel, the long-standing notion of AI agents, defined by the sensing-decision-action loop, is entering a new paradigm: with FMs as their cognitive core, agents transcend rule-based behaviors to achieve autonomy, generalization, and self-reflection. This dual shift is reinforced by real-world demands such as autonomous driving, robotics, virtual assistants, and GUI agents, as well as ecosystem advances in embedded hardware, edge computing, mobile deployment platforms, and communication protocols that together enable large-scale deployment. Yet this convergence collides with reality: while applications demand long-term adaptability and real-time interaction, mobile and edge deployments remain constrained by memory, energy, bandwidth, and latency. This creates a fundamental tension between the growing complexity of FMs and the limited resources of deployment environments. This survey provides the first systematic characterization of adaptive, resource-efficient agentic AI systems. We summarize enabling techniques into elastic inference, test-time adaptation, dynamic multimodal integration, and agentic AI applications, and identify open challenges in balancing accuracy-latency-communication trade-offs and sustaining robustness under distribution shifts. We further highlight future opportunities in algorithm-system co-design, cognitive adaptation, and collaborative edge deployment. By mapping FM structures, cognition, and hardware resources, this work establishes a unified perspective toward scalable, adaptive, and resource-efficient agentic AI. We believe this survey can help readers to understand the connections between enabling technologies while promoting further discussions on the fusion of agentic intelligence and intelligent agents.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 175 of its 370 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
175 of 370 references.
Closest ancestors · 1
Same direction, newest first
Other references · 174
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023GPT-4 Technical Reportcited by 18,132
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2022Emergent Abilities of Large Language Modelscited by 2,483
38 more
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,311
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,234
- 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
- 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,090
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
- 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 849
- 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 848
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2024DeepSeek-V3 Technical Reportcited by 724
- 2019Fast Transformer Decoding: One Write-Head is All You Needcited by 700
- 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 686
- 2024A Survey on Large Language Models for Code Generationcited by 646
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
- 2022PAL: Program-aided Language Modelscited by 635
- 2024KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cachecited by 604
- 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2019Patient Knowledge Distillation for BERT Model Compressioncited by 502
- 2024GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projectioncited by 447
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
- 2024PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funnelingcited by 420
- 2023Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruningcited by 408
- 2023UltraFeedback: Boosting Language Models with Scaled AI Feedbackcited by 394
- 2024LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Modelscited by 394
- 2025Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attentioncited by 391
- 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 369
- 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 361
- 2023SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verificationcited by 359
- 2023Adapting Language Models to Compress Contextscited by 350
- 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
- 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 337
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
50 most cited of 174 All 174 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025A Comprehensive Review of AI Agents: Transforming Possibilities in Technology and Beyond
- 2026Agentic Artificial Intelligence (AI): Architectures, Taxonomies, and Evaluation of Large Language Model Agents
- 2026Toward a Modular Architecture for Embedded AI Agent Systems at the Edge
- 2025Agentic AI for Mobile Network RAN Management and Optimization
- 2025AI Agents: Evolution, Architecture, and Real-World Applications
- 2026AI Agent Systems: Architectures, Applications, and Evaluation
- 2026The Path Ahead for Agentic AI: Challenges and Opportunities
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Survey