mlsanityData to 7 Oct 2026

Foundations of a Developmental Design Paradigm for Integrated Continual Learning, Deliberative Behavior, and Comprehensibility

arXiv 2502.13935 ↗First posted 19 Feb 2025cs.CV cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Inherent limitations of contemporary machine learning systems in crucial areas -- importantly in continual learning, information reuse, comprehensibility, and integration with deliberate behavior -- are receiving increasing attention. To address these challenges, we introduce a system design, fueled by a novel learning approach conceptually grounded in principles of evolutionary developmental biology, that overcomes key limitations of current methods. Our design comprises three core components: The Modeller, a gradient-free learning mechanism inherently capable of continual learning and structural adaptation; a planner for goal-directed action over learned models; and a behavior encapsulation mechanism that can decompose complex behaviors into a hierarchical structure. We demonstrate proof-of-principle operation in a simple test environment. Additionally, we extend our modeling framework to higher-dimensional network-structured spaces, using MNIST for a shape detection task. Our framework shows promise in overcoming multiple major limitations of contemporary machine learning systems simultaneously and in an organic manner.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 91 references that are in the map. First posted on arXiv 19 Feb 2025.

Builds on

34 of 91 references.

References · 34

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  3. 2016Progressive Neural Networkscited by 1,332
  4. 2018Experience Replay for Continual Learningcited by 1,074
  5. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
  6. 2023Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Taskscited by 320
  7. 2018Deep Learning: A Critical Appraisalcited by 214
  8. 2016Modular Multitask Reinforcement Learning with Policy Sketchescited by 200
  9. 2020Multi-Task Reinforcement Learning with Soft Modularizationcited by 138
  10. 2020A Neural Dirichlet Process Mixture Model for Task-Free Continual Learningcited by 133
  11. 2016Learning Modular Neural Network Policies for Multi-Task and Multi-Robot Transfercited by 124
  12. 2018Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilizationcited by 104
22 more
  1. 2018On the Power of Over-parametrization in Neural Networks with Quadratic Activationcited by 102
  2. 2020Rethinking Experience Replay: a Bag of Tricks for Continual Learningcited by 94
  3. 2021A survey of Bayesian Network structure learningcited by 85
  4. 2019AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligencecited by 84
  5. 2024Continual Learning and Catastrophic Forgettingcited by 73
  6. 2022GradMax: Growing Neural Networks using Gradient Informationcited by 64
  7. 2017NeST: A Neural Network Synthesis Tool Based on a Grow-and-Prune Paradigmcited by 60
  8. 2021Recent Advances of Continual Learning in Computer Vision: An Overviewcited by 55
  9. 2020Object Files and Schemata: Factorizing Declarative and Procedural Knowledge in Dynamical Systemscited by 48
  10. 2025Neuro-Symbolic AI in 2024: A Systematic Reviewcited by 36
  11. 2019Reinforcement Learning with Competitive Ensembles of Information-Constrained Primitivescited by 30
  12. 2021Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environmentscited by 24
  13. 2024Towards Cognitive AI Systems: a Survey and Prospective on Neuro-Symbolic AIcited by 24
  14. 2022When, where, and how to add new neurons to ANNscited by 18
  15. 2017Efficient, Safe, and Probably Approximately Complete Learning of Action Modelscited by 16
  16. 2017Learning to Compose Skillscited by 15
  17. 2023Self-Expanding Neural Networkscited by 13
  18. 2015The evolutionary origins of hierarchycited by 9
  19. 2022A Survey on the Integration of Machine Learning with Sampling-based Motion Planningcited by 6
  20. 2023Continual Robot Learning using Self-Supervised Task Inferencecited by 5
  21. 2023FocusLearn: Fully-Interpretable, High-Performance Modular Neural Networks for Time Seriescited by 5
  22. 2024Directed Structural Adaptation to Overcome Statistical Conflicts and Enable Continual Learningcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.