mlsanityData to 14 Oct 2026

Cultivating Machine Intelligence: The OMEGA Shift from Top-Down Optimization to Autopoietic Cognitive Ecologies

arXiv 2605.25062 ↗First posted 24 May 2026cs.NE cs.AIcited by 0

On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment

Abstract (arXiv)

The dominant artificial intelligence paradigm trains neural architectures via gradient descent against proxy objectives and reinforcement learning from human feedback. While remarkably capable, this top-down optimization inherently generates structural failure modes, including hallucination, sycophancy, reward hacking, and alignment fragility, which represent paradigmatic limitations rather than mere engineering defects. In response, we introduce RECLAIM (Recursive, Ecological, Cognitive, Lifelike, Adaptive, Intelligent Machine), a theoretical framework for cultivating intelligence through computational ecology rather than engineering it through strict optimization. The model is supported by four interlocking theoretical pillars. General Darwinism replaces gradients with blind variation and selective retention, while non-agentic emergence substitutes evaluative rewards with environmental physics to structurally prevent specification gaming against human intent. Concurrently, the Polya-Hebbian bridge applies Polya urn dynamics to Hebbian reinforcement for path-dependent specialization, and the free energy principle is integrated as environmental thermodynamics rather than as an agent objective. The architecture situates autopoietic units, bounded by Markov blankets and competing for finite computational energy, within a data ecology shaped by cognitive food chains and Red Queen arms races. This framework suggests the spontaneous emergence of dual-process cognition, sensory specialization, analogical reasoning, and intrinsic motivation as natural consequences of evolution under resource constraints. We conceptualize this paradigm transition as the OMEGA shift, representing a move from optimization and maximization to emergence through generative autopoiesis.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 21 of its 81 references that are in the map. First posted on arXiv 24 May 2026.

Builds on

21 of 81 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2017Deep reinforcement learning from human preferencescited by 3,912
  4. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  5. 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,194
  6. 2022Scaling Laws for Reward Model Overoptimizationcited by 1,095
  7. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  8. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
  9. 2017Evolution Strategies as a Scalable Alternative to Reinforcement Learningcited by 574
  10. 2015Illuminating search spaces by mapping elitescited by 425
  11. 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 266
  12. 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 258
9 more
  1. 2024Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?cited by 232
  2. 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 192
  3. 2020The Hardware Lotterycited by 160
  4. 2017Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learningcited by 150
  5. 2020Active inference on discrete state-spaces: a synthesiscited by 92
  6. 2019AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligencecited by 86
  7. 2018Lenia - Biology of Artificial Lifecited by 41
  8. 2022pymdp: A Python library for active inference in discrete state spacescited by 40
  9. 2024Automating the Search for Artificial Life with Foundation Modelscited by 20

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Illuminating the Three Dogmas of Reinforcement Learning under Evolutionary Light
  2. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems
  3. 2025Evolution and The Knightian Blindspot of Machine Learning
  4. 2022Designing Ecosystems of Intelligence from First Principles
  5. 2024JaxLife: An Open-Ended Agentic Simulator
  6. 2026Grounded Scaling: Why Agentic AI Needs Deterministic Environments
  7. 2026Remapping and navigation of an embedding space via error minimization: a fundamental organizational principle of cognition in natural and artificial systems
  8. 2026The Institutional Scaling Law: Non-Monotonic Fitness, Capability-Trust Divergence, and Symbiogenetic Scaling in Generative AI