An Alternative Trajectory for Generative AI
Not on the map. Why?
Abstract (arXiv)
The generative artificial intelligence (AI) ecosystem is undergoing rapid transformations that threaten its sustainability. As models transition from research prototypes to high-traffic products, the energetic burden has shifted from one-time training to recurring, unbounded inference. This is exacerbated by reasoning models that inflate compute costs by orders of magnitude per query. The prevailing pursuit of artificial general intelligence through scaling of monolithic models is colliding with hard physical constraints: grid failures, water consumption, and diminishing returns on data scaling. This trajectory yields models with impressive factual recall but struggles in domains requiring in-depth reasoning, possibly due to insufficient abstractions in training data. Current large language models (LLMs) exhibit genuine reasoning depth only in domains like mathematics and coding, where rigorous, pre-existing abstractions provide structural grounding. In other fields, the current approach fails to generalize well. We propose an alternative trajectory based on domain-specific superintelligence (DSS). We argue for first constructing explicit symbolic abstractions (knowledge graphs, ontologies, and formal logic) to underpin synthetic curricula enabling small language models to master domain-specific reasoning without the model collapse problem typical of LLM-based synthetic data methods. Rather than a single generalist giant model, we envision "societies of DSS models": dynamic ecosystems where orchestration agents route tasks to distinct DSS back-ends. This paradigm shift decouples capability from size, enabling intelligence to migrate from energy-intensive data centers to secure, on-device experts. By aligning algorithmic progress with physical constraints, DSS societies move generative AI from an environmental liability to a sustainable force for economic empowerment.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 73 of its 167 references that are in the map. First posted on arXiv 14 Mar 2026.
Builds on
73 of 167 references.
References · 73
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Let's Verify Step by Stepcited by 3,789
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
38 more
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 548
- 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 503
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
- 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 407
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
- 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 309
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 287
- 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 238
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 154
- 2023Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Surveycited by 135
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 126
- 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 113
- 2021Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Basescited by 107
- 2025Gold-medalist Performance in Solving Olympiad Geometry with AlphaGeometry2cited by 97
- 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoningcited by 94
- 2025Medical Hallucinations in Foundation Models and Their Impact on Healthcarecited by 93
- 2017Logic Tensor Networks for Semantic Image Interpretationcited by 92
- 2025MasRouter: Learning to Route LLMs for Multi-Agent Systemscited by 88
- 2024Internet of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligencecited by 86
- 2025A Survey of AI Agent Protocolscited by 81
- 2020Domain-specific Knowledge Graphs: A surveycited by 68
- 2020The De-democratization of AI: Deep Learning and the Compute Divide in Artificial Intelligence Researchcited by 67
- 2024HoneyComb: A Flexible LLM-Based Agent System for Materials Sciencecited by 57
- 2025Scalable Vision Language Model Training via High Quality Data Curationcited by 55
- 2023When Brain-inspired AI Meets AGIcited by 54
- 2025Graph-R1: Towards Agentic GraphRAG Framework via End-to-end Reinforcement Learningcited by 52
- 2024Project Sid: Many-agent simulations toward AI civilizationcited by 49
- 2024Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologiescited by 47
- 2025Scaling Laws of Synthetic Data for Language Modelscited by 46
- 2025ChemAgent: Self-updating Library in Large Language Models Improves Chemical Reasoningcited by 41
- 2024BiomedRAG: A Retrieval Augmented Large Language Model for Biomedicinecited by 31
- 2023Discovering modular solutions that generalize compositionallycited by 23
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024SymbolicAI: A framework for logic-based approaches combining generative models and solvers
- 2024Evaluating the World Model Implicit in a Generative Model
- 2025From Reasoning to Learning: A Survey on Hypothesis Discovery and Rule Learning with Large Language Models
- 2025R-Zero: Self-Evolving Reasoning LLM from Zero Data
- 2023An Automated Survey of Generative Artificial Intelligence: Large Language Models, Architectures, Protocols, and Applications
- 2025General Intelligence Requires Reward-based Pretraining
- 2026Continually self-improving AI
- 2025Generalising from Self-Produced Data: Model Training Beyond Human Constraints