NGENT: Next-Generation AI Agents Must Integrate Multi-Domain Abilities to Achieve Artificial General Intelligence
Not on the map. Why?
Abstract (arXiv)
This paper argues that the next generation of AI agent (NGENT) should integrate across-domain abilities to advance toward Artificial General Intelligence (AGI). Although current AI agents are effective in specialized tasks such as robotics, role-playing, and tool-using, they remain confined to narrow domains. We propose that future AI agents should synthesize the strengths of these specialized systems into a unified framework capable of operating across text, vision, robotics, reinforcement learning, emotional intelligence, and beyond. This integration is not only feasible but also essential for achieving the versatility and adaptability that characterize human intelligence. The convergence of technologies across AI domains, coupled with increasing user demand for cross-domain capabilities, suggests that such integration is within reach. Ultimately, the development of these versatile agents is a critical step toward realizing AGI. This paper explores the rationale for this shift, potential pathways for achieving it.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 39 of its 65 references that are in the map. First posted on arXiv 30 Apr 2025.
Builds on
39 of 65 references.
References · 39
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2024GPT-4o System Cardcited by 4,588
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023Code Llama: Open Foundation Models for Codecited by 2,139
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
27 more
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
- 2023CogAgent: A Visual Language Model for GUI Agentscited by 704
- 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
- 2023AppAgent: Multimodal Agents as Smartphone Userscited by 415
- 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 356
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
- 2023Tool Learning with Foundation Modelscited by 302
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perceptioncited by 293
- 2016Deep Reinforcement Learning for Dialogue Generationcited by 288
- 2024Tool Learning with Large Language Models: A Surveycited by 223
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 212
- 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 205
- 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 193
- 2024Large Multimodal Agents: A Surveycited by 105
- 2024ScreenAgent: A Vision Language Model-driven Computer Control Agentcited by 102
- 2023Explore, Select, Derive, and Recall: Augmenting LLM with Human-like Memory for Mobile Task Automationcited by 58
- 2023TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Systemscited by 39
- 2023Controlling Large Language Model-based Agents for Large-Scale Decision-Making: An Actor-Critic Approachcited by 38
- 2019Learning Agent Communication under Limited Bandwidth by Message Pruningcited by 31
- 2024PyBench: Evaluating LLM Agent on various real-world coding taskscited by 24
- 2021SEIHAI: A Sample-efficient Hierarchical AI for the MineRL Competitioncited by 20
- 2019Neighborhood Cognition Consistent Multi-Agent Reinforcement Learningcited by 17
- 2024ClickAgent: Enhancing UI Location Capabilities of Autonomous Agentscited by 11
- 2024CoSLight: Co-optimizing Collaborator Selection and Decision-making to Enhance Traffic Signal Controlcited by 7
- 2022Transformer in Transformer as Backbone for Deep Reinforcement Learningcited by 6
- 2023PDiT: Interleaving Perception and Decision-making Transformers for Deep Reinforcement Learningcited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025A Comprehensive Review of AI Agents: Transforming Possibilities in Technology and Beyond
- 2025Thinking Beyond Tokens: From Brain-Inspired Intelligence to Cognitive Foundations for Artificial General Intelligence and its Societal Impact
- 2025Embodied Intelligence: The Key to Unblocking Generalized Artificial Intelligence
- 2025AI Agents: Evolution, Architecture, and Real-World Applications
- 2026Position: Agentic AI System Is a Foreseeable Pathway to AGI
- 2025Beyond Pipelines: A Survey of the Paradigm Shift toward Model-Native Agentic AI
- 2025Unified Mind Model: Reimagining Autonomous Agents in the LLM Era
- 2024Unlocking the Wisdom of Large Language Models: An Introduction to The Path to Artificial General Intelligence