mlsanityData to 7 Oct 2026

Adaptive and Resource-efficient Agentic AI Systems for Mobile and Embedded Devices: A Survey

arXiv 2510.00078 ↗First posted 30 Sep 2025cs.LG cs.AI cs.DCcited by 2

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Foundation models have reshaped AI by unifying fragmented architectures into scalable backbones with multimodal reasoning and contextual adaptation. In parallel, the long-standing notion of AI agents, defined by the sensing-decision-action loop, is entering a new paradigm: with FMs as their cognitive core, agents transcend rule-based behaviors to achieve autonomy, generalization, and self-reflection. This dual shift is reinforced by real-world demands such as autonomous driving, robotics, virtual assistants, and GUI agents, as well as ecosystem advances in embedded hardware, edge computing, mobile deployment platforms, and communication protocols that together enable large-scale deployment. Yet this convergence collides with reality: while applications demand long-term adaptability and real-time interaction, mobile and edge deployments remain constrained by memory, energy, bandwidth, and latency. This creates a fundamental tension between the growing complexity of FMs and the limited resources of deployment environments. This survey provides the first systematic characterization of adaptive, resource-efficient agentic AI systems. We summarize enabling techniques into elastic inference, test-time adaptation, dynamic multimodal integration, and agentic AI applications, and identify open challenges in balancing accuracy-latency-communication trade-offs and sustaining robustness under distribution shifts. We further highlight future opportunities in algorithm-system co-design, cognitive adaptation, and collaborative edge deployment. By mapping FM structures, cognition, and hardware resources, this work establishes a unified perspective toward scalable, adaptive, and resource-efficient agentic AI. We believe this survey can help readers to understand the connections between enabling technologies while promoting further discussions on the fusion of agentic intelligence and intelligent agents.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 175 of its 370 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

175 of 370 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents13 Aug

Other references · 174

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  6. 2025Qwen2.5-VL Technical Reportcited by 5,418
  7. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  8. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  9. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  10. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  11. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  12. 2022Emergent Abilities of Large Language Modelscited by 2,483
38 more
  1. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
  2. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  3. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,311
  4. 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,234
  5. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
  6. 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,090
  7. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
  8. 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
  9. 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 849
  10. 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 848
  11. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
  12. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  13. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  14. 2024DeepSeek-V3 Technical Reportcited by 724
  15. 2019Fast Transformer Decoding: One Write-Head is All You Needcited by 700
  16. 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 686
  17. 2024A Survey on Large Language Models for Code Generationcited by 646
  18. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
  19. 2022PAL: Program-aided Language Modelscited by 635
  20. 2024KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cachecited by 604
  21. 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
  22. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  23. 2019Patient Knowledge Distillation for BERT Model Compressioncited by 502
  24. 2024GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projectioncited by 447
  25. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
  26. 2024PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funnelingcited by 420
  27. 2023Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruningcited by 408
  28. 2023UltraFeedback: Boosting Language Models with Scaled AI Feedbackcited by 394
  29. 2024LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Modelscited by 394
  30. 2025Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attentioncited by 391
  31. 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 369
  32. 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 361
  33. 2023SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verificationcited by 359
  34. 2023Adapting Language Models to Compress Contextscited by 350
  35. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
  36. 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
  37. 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 337
  38. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335

50 most cited of 174 All 174 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Comprehensive Review of AI Agents: Transforming Possibilities in Technology and Beyond
  2. 2026Agentic Artificial Intelligence (AI): Architectures, Taxonomies, and Evaluation of Large Language Model Agents
  3. 2026Toward a Modular Architecture for Embedded AI Agent Systems at the Edge
  4. 2025Agentic AI for Mobile Network RAN Management and Optimization
  5. 2025AI Agents: Evolution, Architecture, and Real-World Applications
  6. 2026AI Agent Systems: Architectures, Applications, and Evaluation
  7. 2026The Path Ahead for Agentic AI: Challenges and Opportunities
  8. 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Survey