Incremental Concept Formation over Visual Images Without Catastrophic Forgetting
Not on the map. Why?
Abstract (arXiv)
Deep neural networks have excelled in machine learning, particularly in vision tasks, however, they often suffer from catastrophic forgetting when learning new tasks sequentially. In this work, we introduce Cobweb4V, an alternative to traditional neural network approaches. Cobweb4V is a novel visual classification method that builds on Cobweb, a human like learning system that is inspired by the way humans incrementally learn new concepts over time. In this research, we conduct a comprehensive evaluation, showcasing Cobweb4Vs proficiency in learning visual concepts, requiring less data to achieve effective learning outcomes compared to traditional methods, maintaining stable performance over time, and achieving commendable asymptotic behavior, without catastrophic forgetting effects. These characteristics align with learning strategies in human cognition, positioning Cobweb4V as a promising alternative to neural network approaches.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 15 of its 44 references that are in the map. First posted on arXiv 26 Feb 2024.
Builds on
15 of 44 references.
References · 15
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2016Learning without Forgettingcited by 2,465
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,337
- 2016Progressive Neural Networkscited by 1,332
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
- 2017Continual Learning with Deep Generative Replaycited by 1,152
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2019Three scenarios for continual learningcited by 610
- 2018Progress & Compress: A scalable framework for continual learningcited by 516
3 more
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 2.
7 papers.
- 2024Cobweb: An Incremental and Hierarchical Model of Human-Like Category Learningcited by 5
- 2025Taxonomic Networks: A Representation for Neuro-Symbolic Pairingcited by 4
- 2025Deep Taxonomic Networks for Unsupervised Hierarchical Prototype Discoverycited by 4
- 2025Hierarchical Semantic Retrieval with Cobwebcited by 4
- 2025Explaining Robustness to Catastrophic Forgetting Through Incremental Concept Formationcited by 1
- 2026CobwebTM: Probabilistic Concept Formation for Lifelong and Hierarchical Topic Modelingcited by 0
- 2026Diffusion Models and Concept Formationcited by 0
- 2026Diffusion Models and Concept Formation11 Sep 2026
- 2026CobwebTM: Probabilistic Concept Formation for Lifelong and Hierarchical Topic Modeling15 Apr 2026
- 2025Explaining Robustness to Catastrophic Forgetting Through Incremental Concept Formation27 Oct 2025
- 2025Hierarchical Semantic Retrieval with Cobweb2 Oct 2025
- 2025Deep Taxonomic Networks for Unsupervised Hierarchical Prototype Discovery28 Sep 2025
- 2025Taxonomic Networks: A Representation for Neuro-Symbolic Pairing30 May 2025
- 2024Cobweb: An Incremental and Hierarchical Model of Human-Like Category Learning6 Mar 2024