Foundations of a Developmental Design Paradigm for Integrated Continual Learning, Deliberative Behavior, and Comprehensibility
Not on the map. Why?
Abstract (arXiv)
Inherent limitations of contemporary machine learning systems in crucial areas -- importantly in continual learning, information reuse, comprehensibility, and integration with deliberate behavior -- are receiving increasing attention. To address these challenges, we introduce a system design, fueled by a novel learning approach conceptually grounded in principles of evolutionary developmental biology, that overcomes key limitations of current methods. Our design comprises three core components: The Modeller, a gradient-free learning mechanism inherently capable of continual learning and structural adaptation; a planner for goal-directed action over learned models; and a behavior encapsulation mechanism that can decompose complex behaviors into a hierarchical structure. We demonstrate proof-of-principle operation in a simple test environment. Additionally, we extend our modeling framework to higher-dimensional network-structured spaces, using MNIST for a shape detection task. Our framework shows promise in overcoming multiple major limitations of contemporary machine learning systems simultaneously and in an organic manner.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 91 references that are in the map. First posted on arXiv 19 Feb 2025.
Builds on
34 of 91 references.
References · 34
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2016Progressive Neural Networkscited by 1,332
- 2018Experience Replay for Continual Learningcited by 1,074
- 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
- 2023Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Taskscited by 320
- 2018Deep Learning: A Critical Appraisalcited by 214
- 2016Modular Multitask Reinforcement Learning with Policy Sketchescited by 200
- 2020Multi-Task Reinforcement Learning with Soft Modularizationcited by 138
- 2020A Neural Dirichlet Process Mixture Model for Task-Free Continual Learningcited by 133
- 2016Learning Modular Neural Network Policies for Multi-Task and Multi-Robot Transfercited by 124
- 2018Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilizationcited by 104
22 more
- 2018On the Power of Over-parametrization in Neural Networks with Quadratic Activationcited by 102
- 2020Rethinking Experience Replay: a Bag of Tricks for Continual Learningcited by 94
- 2021A survey of Bayesian Network structure learningcited by 85
- 2019AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligencecited by 84
- 2024Continual Learning and Catastrophic Forgettingcited by 73
- 2022GradMax: Growing Neural Networks using Gradient Informationcited by 64
- 2017NeST: A Neural Network Synthesis Tool Based on a Grow-and-Prune Paradigmcited by 60
- 2021Recent Advances of Continual Learning in Computer Vision: An Overviewcited by 55
- 2020Object Files and Schemata: Factorizing Declarative and Procedural Knowledge in Dynamical Systemscited by 48
- 2025Neuro-Symbolic AI in 2024: A Systematic Reviewcited by 36
- 2019Reinforcement Learning with Competitive Ensembles of Information-Constrained Primitivescited by 30
- 2021Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environmentscited by 24
- 2024Towards Cognitive AI Systems: a Survey and Prospective on Neuro-Symbolic AIcited by 24
- 2022When, where, and how to add new neurons to ANNscited by 18
- 2017Efficient, Safe, and Probably Approximately Complete Learning of Action Modelscited by 16
- 2017Learning to Compose Skillscited by 15
- 2023Self-Expanding Neural Networkscited by 13
- 2015The evolutionary origins of hierarchycited by 9
- 2022A Survey on the Integration of Machine Learning with Sampling-based Motion Planningcited by 6
- 2023Continual Robot Learning using Self-Supervised Task Inferencecited by 5
- 2023FocusLearn: Fully-Interpretable, High-Performance Modular Neural Networks for Time Seriescited by 5
- 2024Directed Structural Adaptation to Overcome Statistical Conflicts and Enable Continual Learningcited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.