How Far Are We From AGI: Are LLMs All We Need?
Not on the map. Why?
Abstract (arXiv)
The evolution of artificial intelligence (AI) has profoundly impacted human society, driving significant advancements in multiple sectors. AGI, distinguished by its ability to execute diverse real-world tasks with efficiency and effectiveness comparable to human intelligence, reflects a paramount milestone in AI evolution. While existing studies have reviewed specific advancements in AI and proposed potential paths to AGI, such as large language models (LLMs), they fall short of providing a thorough exploration of AGI's definitions, objectives, and developmental trajectories. Unlike previous survey papers, this work goes beyond summarizing LLMs by addressing key questions about our progress toward AGI and outlining the strategies essential for its realization through comprehensive analysis, in-depth discussions, and novel insights. We start by articulating the requisite capability frameworks for AGI, integrating the internal, interface, and system dimensions. As the realization of AGI requires more advanced capabilities and adherence to stringent constraints, we further discuss necessary AGI alignment technologies to harmonize these factors. Notably, we emphasize the importance of approaching AGI responsibly by first defining the key levels of AGI progression, followed by the evaluation framework that situates the status quo, and finally giving our roadmap of how to reach the pinnacle of AGI. Moreover, to give tangible insights into the ubiquitous impact of the integration of AI, we outline existing challenges and potential pathways toward AGI in multiple domains. In sum, serving as a pioneering exploration into the current state and future trajectory of AGI, this paper aims to foster a collective comprehension and catalyze broader public discussions among researchers and practitioners on AGI.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 429 of its 700 references that are in the map. First posted on arXiv 16 May 2024.
Builds on
429 of 700 references.
References · 429
- 2023GPT-4 Technical Reportcited by 18,132
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023Visual Instruction Tuningcited by 7,792
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
38 more
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2023Let's Verify Step by Stepcited by 3,598
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023Mistral 7Bcited by 3,065
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2022Video Diffusion Modelscited by 2,280
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
50 most cited of 429 All 429 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 23; 2026: 5.
31 papers.
Sort:
By area:
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agentscited by 169
- 2025LLM-based Human Simulations Have Not Yet Been Reliablecited by 30
- 2024Multi-Layer Transformers Gradient Can be Approximated in Almost Linear Timecited by 22
- 2024Large Action Models: From Inception to Implementationcited by 18
- 2025High-Order Matching for One-Step Shortcut Diffusion Modelscited by 15
- 2025HiBench: Benchmarking LLMs Capability on Hierarchical Structure Reasoningcited by 12
- 2025LLM CHESS: Benchmarking Reasoning and Instruction-Following in LLMs through Chesscited by 12
- 2025Thinking Preference Optimizationcited by 8
- 2025Distributional AGI Safetycited by 8
- 2025Toward Embodied AGI: A Review of Embodied AI and the Road Aheadcited by 7
- 2025Automating Structural Engineering Workflows with Large Language Model Agentscited by 6
- 2025LogicReward: Incentivizing LLM Reasoning via Step-Wise Logical Supervisioncited by 6
19 more
- 2025RoboEgo System Card: An Omnimodal Model with Native Full Duplexitycited by 5
- 2026When Domains Interact: Asymmetric and Order-Sensitive Cross-Domain Effects in Reinforcement Learning for Reasoningcited by 5
- 2025HAMburger: Accelerating LLM Inference via Token Smashingcited by 4
- 2025Drivel-ology: Challenging LLMs with Interpreting Nonsense with Depthcited by 4
- 2025PersonalizedRouter: Personalized LLM Routing via Graph-based User Preference Modelingcited by 3
- 2024Towards Friendly AI: A Comprehensive Review and New Perspectives on Human-AI Alignmentcited by 2
- 2025Are Large Language Models Capable of Deep Relational Reasoning? Insights from DeepSeek-R1 and Benchmark Comparisonscited by 2
- 2025Research Superalignment Should Advance Now with Alternating Competence and Conformity Optimizationcited by 1
- 2025GeoThought: A Dataset for Enhancing Mathematical Geometry Reasoning in Vision-Language Modelscited by 1
- 2025Learning to Hear by Seeing: It's Time for Vision Language Models to Understand Artistic Emotion from Sight and Soundcited by 1
- 2025Engineering Sentiencecited by 0
- 2025Limitations on Accurate, Trusted, Human-level Reasoningcited by 0
- 2025On the Measure of a Model: From Intelligence to Generalitycited by 0
- 2025Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGIcited by 0
- 2025ResearchArcade: Graph Interface for Academic Taskscited by 0
- 2026Do Transformers Have the Ability for Periodicity Generalization?cited by 0
- 2026Position: Hippocampal Explicit Memory Is the Cornerstone for AGIcited by 0
- 2026AIMO Interpretability Challengecited by 0
- 2026Agent Error Dataset: Scaling 50,000 Error--Diagnosis Pairs for Failure Analysis and Error-Aware Post-Trainingcited by 0
- 2026Agent Error Dataset: Scaling 50,000 Error--Diagnosis Pairs for Failure Analysis and Error-Aware Post-Training30 Sep 2026
- 2026AIMO Interpretability Challenge15 Jul 2026
- 2026Position: Hippocampal Explicit Memory Is the Cornerstone for AGI5 Jun 2026
- 2026When Domains Interact: Asymmetric and Order-Sensitive Cross-Domain Effects in Reinforcement Learning for Reasoning1 Feb 2026
- 2026Do Transformers Have the Ability for Periodicity Generalization?30 Jan 2026
- 2025LogicReward: Incentivizing LLM Reasoning via Step-Wise Logical Supervision20 Dec 2025
- 2025Distributional AGI Safety18 Dec 2025
- 2025LLM CHESS: Benchmarking Reasoning and Instruction-Following in LLMs through Chess1 Dec 2025
- 2025ResearchArcade: Graph Interface for Academic Tasks27 Nov 2025
- 2025Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI23 Nov 2025
- 2025PersonalizedRouter: Personalized LLM Routing via Graph-based User Preference Modeling21 Nov 2025
- 2025Learning to Hear by Seeing: It's Time for Vision Language Models to Understand Artistic Emotion from Sight and Sound15 Nov 2025
19 more
- 2025On the Measure of a Model: From Intelligence to Generality14 Nov 2025
- 2025GeoThought: A Dataset for Enhancing Mathematical Geometry Reasoning in Vision-Language Models23 Oct 2025
- 2025Automating Structural Engineering Workflows with Large Language Model Agents13 Oct 2025
- 2025Limitations on Accurate, Trusted, Human-level Reasoning25 Sep 2025
- 2025Drivel-ology: Challenging LLMs with Interpreting Nonsense with Depth4 Sep 2025
- 2025Are Large Language Models Capable of Deep Relational Reasoning? Insights from DeepSeek-R1 and Benchmark Comparisons29 Jun 2025
- 2025Engineering Sentience25 Jun 2025
- 2025RoboEgo System Card: An Omnimodal Model with Native Full Duplexity2 Jun 2025
- 2025HAMburger: Accelerating LLM Inference via Token Smashing26 May 2025
- 2025Toward Embodied AGI: A Review of Embodied AI and the Road Ahead20 May 2025
- 2025Research Superalignment Should Advance Now with Alternating Competence and Conformity Optimization8 Mar 2025
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents3 Mar 2025
- 2025HiBench: Benchmarking LLMs Capability on Hierarchical Structure Reasoning2 Mar 2025
- 2025Thinking Preference Optimization17 Feb 2025
- 2025High-Order Matching for One-Step Shortcut Diffusion Models2 Feb 2025
- 2025LLM-based Human Simulations Have Not Yet Been Reliable15 Jan 2025
- 2024Towards Friendly AI: A Comprehensive Review and New Perspectives on Human-AI Alignment19 Dec 2024
- 2024Large Action Models: From Inception to Implementation13 Dec 2024
- 2024Multi-Layer Transformers Gradient Can be Approximated in Almost Linear Time23 Aug 2024
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agentscited by 169
- 2025HiBench: Benchmarking LLMs Capability on Hierarchical Structure Reasoningcited by 12
- 2025LLM CHESS: Benchmarking Reasoning and Instruction-Following in LLMs through Chesscited by 12
- 2025Thinking Preference Optimizationcited by 8
- 2025LogicReward: Incentivizing LLM Reasoning via Step-Wise Logical Supervisioncited by 6
- 2026When Domains Interact: Asymmetric and Order-Sensitive Cross-Domain Effects in Reinforcement Learning for Reasoningcited by 5
- 2025Are Large Language Models Capable of Deep Relational Reasoning? Insights from DeepSeek-R1 and Benchmark Comparisonscited by 2
- 2025GeoThought: A Dataset for Enhancing Mathematical Geometry Reasoning in Vision-Language Modelscited by 1
- 2026AIMO Interpretability Challengecited by 0
- 2026AIMO Interpretability Challenge15 Jul 2026
- 2026When Domains Interact: Asymmetric and Order-Sensitive Cross-Domain Effects in Reinforcement Learning for Reasoning1 Feb 2026
- 2025LogicReward: Incentivizing LLM Reasoning via Step-Wise Logical Supervision20 Dec 2025
- 2025LLM CHESS: Benchmarking Reasoning and Instruction-Following in LLMs through Chess1 Dec 2025
- 2025GeoThought: A Dataset for Enhancing Mathematical Geometry Reasoning in Vision-Language Models23 Oct 2025
- 2025Are Large Language Models Capable of Deep Relational Reasoning? Insights from DeepSeek-R1 and Benchmark Comparisons29 Jun 2025
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents3 Mar 2025
- 2025HiBench: Benchmarking LLMs Capability on Hierarchical Structure Reasoning2 Mar 2025
- 2025Thinking Preference Optimization17 Feb 2025
- 2025High-Order Matching for One-Step Shortcut Diffusion Modelscited by 15
- 2025HAMburger: Accelerating LLM Inference via Token Smashingcited by 4
- 2025HAMburger: Accelerating LLM Inference via Token Smashing26 May 2025
- 2025LLM-based Human Simulations Have Not Yet Been Reliablecited by 30
- 2024Multi-Layer Transformers Gradient Can be Approximated in Almost Linear Timecited by 22
- 2024Large Action Models: From Inception to Implementationcited by 18
- 2025Distributional AGI Safetycited by 8
- 2025Toward Embodied AGI: A Review of Embodied AI and the Road Aheadcited by 7
- 2025RoboEgo System Card: An Omnimodal Model with Native Full Duplexitycited by 5
- 2025Drivel-ology: Challenging LLMs with Interpreting Nonsense with Depthcited by 4
- 2025PersonalizedRouter: Personalized LLM Routing via Graph-based User Preference Modelingcited by 3
- 2024Towards Friendly AI: A Comprehensive Review and New Perspectives on Human-AI Alignmentcited by 2
- 2025Engineering Sentiencecited by 0
- 2025Limitations on Accurate, Trusted, Human-level Reasoningcited by 0
- 2025On the Measure of a Model: From Intelligence to Generalitycited by 0
12 most cited of 16 All 16 (JSON)
- 2026Position: Hippocampal Explicit Memory Is the Cornerstone for AGI5 Jun 2026
- 2026Do Transformers Have the Ability for Periodicity Generalization?30 Jan 2026
- 2025Distributional AGI Safety18 Dec 2025
- 2025ResearchArcade: Graph Interface for Academic Tasks27 Nov 2025
- 2025Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI23 Nov 2025
- 2025PersonalizedRouter: Personalized LLM Routing via Graph-based User Preference Modeling21 Nov 2025
- 2025On the Measure of a Model: From Intelligence to Generality14 Nov 2025
- 2025Limitations on Accurate, Trusted, Human-level Reasoning25 Sep 2025
- 2025Drivel-ology: Challenging LLMs with Interpreting Nonsense with Depth4 Sep 2025
- 2025Engineering Sentience25 Jun 2025
- 2025RoboEgo System Card: An Omnimodal Model with Native Full Duplexity2 Jun 2025
- 2025Toward Embodied AGI: A Review of Embodied AI and the Road Ahead20 May 2025
12 newest of 16 All 16 (JSON)