mlsanityData to 7 Oct 2026

How Far Are We From AGI: Are LLMs All We Need?

arXiv 2405.10313 ↗First posted 16 May 2024cs.AI cs.CL cs.CYcited by 31

Not on the map. Why?

Abstract (arXiv)

The evolution of artificial intelligence (AI) has profoundly impacted human society, driving significant advancements in multiple sectors. AGI, distinguished by its ability to execute diverse real-world tasks with efficiency and effectiveness comparable to human intelligence, reflects a paramount milestone in AI evolution. While existing studies have reviewed specific advancements in AI and proposed potential paths to AGI, such as large language models (LLMs), they fall short of providing a thorough exploration of AGI's definitions, objectives, and developmental trajectories. Unlike previous survey papers, this work goes beyond summarizing LLMs by addressing key questions about our progress toward AGI and outlining the strategies essential for its realization through comprehensive analysis, in-depth discussions, and novel insights. We start by articulating the requisite capability frameworks for AGI, integrating the internal, interface, and system dimensions. As the realization of AGI requires more advanced capabilities and adherence to stringent constraints, we further discuss necessary AGI alignment technologies to harmonize these factors. Notably, we emphasize the importance of approaching AGI responsibly by first defining the key levels of AGI progression, followed by the evaluation framework that situates the status quo, and finally giving our roadmap of how to reach the pinnacle of AGI. Moreover, to give tangible insights into the ubiquitous impact of the integration of AI, we outline existing challenges and potential pathways toward AGI in multiple domains. In sum, serving as a pioneering exploration into the current state and future trajectory of AGI, this paper aims to foster a collective comprehension and catalyze broader public discussions among researchers and practitioners on AGI.

Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 429 of its 700 references that are in the map. First posted on arXiv 16 May 2024.

Builds on

429 of 700 references.

References · 429

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  7. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  8. 2023Visual Instruction Tuningcited by 7,792
  9. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  10. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  11. 2020Scaling Laws for Neural Language Modelscited by 6,411
  12. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
38 more
  1. 2022Classifier-Free Diffusion Guidancecited by 5,717
  2. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  6. 2013Auto-Encoding Variational Bayescited by 3,980
  7. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  8. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  9. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  10. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  11. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  12. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  13. 2023Let's Verify Step by Stepcited by 3,598
  14. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  15. 2021Program Synthesis with Large Language Modelscited by 3,509
  16. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  17. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  18. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  19. 2020Longformer: The Long-Document Transformercited by 3,362
  20. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  21. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  22. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  23. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  24. 2023Mistral 7Bcited by 3,065
  25. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  26. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  27. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  28. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  29. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  30. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  31. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  32. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  33. 2022Emergent Abilities of Large Language Modelscited by 2,483
  34. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  35. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  36. 2022Video Diffusion Modelscited by 2,280
  37. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  38. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115

50 most cited of 429 All 429 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 23; 2026: 5.

31 papers.

Sort:

By area:

  1. 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agentscited by 169
  2. 2025LLM-based Human Simulations Have Not Yet Been Reliablecited by 30
  3. 2024Multi-Layer Transformers Gradient Can be Approximated in Almost Linear Timecited by 22
  4. 2024Large Action Models: From Inception to Implementationcited by 18
  5. 2025High-Order Matching for One-Step Shortcut Diffusion Modelscited by 15
  6. 2025HiBench: Benchmarking LLMs Capability on Hierarchical Structure Reasoningcited by 12
  7. 2025LLM CHESS: Benchmarking Reasoning and Instruction-Following in LLMs through Chesscited by 12
  8. 2025Thinking Preference Optimizationcited by 8
  9. 2025Distributional AGI Safetycited by 8
  10. 2025Toward Embodied AGI: A Review of Embodied AI and the Road Aheadcited by 7
  11. 2025Automating Structural Engineering Workflows with Large Language Model Agentscited by 6
  12. 2025LogicReward: Incentivizing LLM Reasoning via Step-Wise Logical Supervisioncited by 6
19 more
  1. 2025RoboEgo System Card: An Omnimodal Model with Native Full Duplexitycited by 5
  2. 2026When Domains Interact: Asymmetric and Order-Sensitive Cross-Domain Effects in Reinforcement Learning for Reasoningcited by 5
  3. 2025HAMburger: Accelerating LLM Inference via Token Smashingcited by 4
  4. 2025Drivel-ology: Challenging LLMs with Interpreting Nonsense with Depthcited by 4
  5. 2025PersonalizedRouter: Personalized LLM Routing via Graph-based User Preference Modelingcited by 3
  6. 2024Towards Friendly AI: A Comprehensive Review and New Perspectives on Human-AI Alignmentcited by 2
  7. 2025Are Large Language Models Capable of Deep Relational Reasoning? Insights from DeepSeek-R1 and Benchmark Comparisonscited by 2
  8. 2025Research Superalignment Should Advance Now with Alternating Competence and Conformity Optimizationcited by 1
  9. 2025GeoThought: A Dataset for Enhancing Mathematical Geometry Reasoning in Vision-Language Modelscited by 1
  10. 2025Learning to Hear by Seeing: It's Time for Vision Language Models to Understand Artistic Emotion from Sight and Soundcited by 1
  11. 2025Engineering Sentiencecited by 0
  12. 2025Limitations on Accurate, Trusted, Human-level Reasoningcited by 0
  13. 2025On the Measure of a Model: From Intelligence to Generalitycited by 0
  14. 2025Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGIcited by 0
  15. 2025ResearchArcade: Graph Interface for Academic Taskscited by 0
  16. 2026Do Transformers Have the Ability for Periodicity Generalization?cited by 0
  17. 2026Position: Hippocampal Explicit Memory Is the Cornerstone for AGIcited by 0
  18. 2026AIMO Interpretability Challengecited by 0
  19. 2026Agent Error Dataset: Scaling 50,000 Error--Diagnosis Pairs for Failure Analysis and Error-Aware Post-Trainingcited by 0