mlsanityData to 7 Oct 2026

Multi-Scale Structural Features for Continual, Comprehensible Visual Recognition in a Developmental Learning Framework

arXiv 2607.25531 ↗First posted 28 Jul 2026cs.LG cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Contemporary machine learning struggles to learn continually, reuse prior knowledge, and expose a comprehensible internal structure. A recently proposed developmental, gradient-free learning framework addresses these limitations by learning a discrete, topological model of its inputs through local variation and selection, yielding an inherent continual-learning guarantee: new observations refine existing structure without overwriting past knowledge, and without replay buffers or predefined task boundaries. Its extension to visual inputs demonstrated this principle on shape recognition, but relied on a feature representation of limited expressivity that capped recognition accuracy. We introduce a new visual feature representation that encodes shape structure across multiple scales, capturing edge and contour features together with their spatial relations, and integrate it with the network-refinement learning process; we further improve the learning dynamics and the read-out used to predict from the learned model. The study targets two-dimensional shape, with class-incremental MNIST as a controlled, interpretable benchmark in which continual-learning behavior can be measured directly. Our approach substantially increases accuracy over the prior representation, matching or exceeding replay- and regularisation-based baselines at comparable storage while storing no past data, and preserves the framework's defining behavior: earlier-learned classes are retained as new ones are introduced, with no destructive adaptation, and the learned representations remain human-interpretable. What separates the methods is retention: the baselines surrender most of a just-trained class within its own cycle and relearn it afterwards, which ours does not. The significance lies in the manner of learning. The system integrates information one sample at a time while provably preserving its responses to...

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 69 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

21 of 69 references.

References · 21

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  3. 2016Learning without Forgettingcited by 2,465
  4. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  5. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  6. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
  7. 2018Experience Replay for Continual Learningcited by 1,074
  8. 2021Learning to Prompt for Continual Learningcited by 938
  9. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
  10. 2017Dynamic Routing Between Capsulescited by 689
  11. 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
  12. 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 446
9 more
  1. 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
  2. 2016Expert Gate: Lifelong Learning with a Network of Expertscited by 369
  3. 2018Task-Free Continual Learningcited by 219
  4. 2021New Insights on Reducing Abrupt Representation Change in Online Continual Learningcited by 215
  5. 2024Continual Learning and Catastrophic Forgettingcited by 73
  6. 2020Incremental Learning via Rate Reductioncited by 31
  7. 2024F-OAL: Forward-only Online Analytic Learning with Fast Training and Low Memory Footprint in Class Incremental Learningcited by 12
  8. 2025Continual Reinforcement Learning via Autoencoder-Driven Task and New Environment Recognitioncited by 5
  9. 2025Foundations of a Developmental Design Paradigm for Integrated Continual Learning, Deliberative Behavior, and Comprehensibilitycited by 2

Built on by

Not cited yet.