mlsanityData to 7 Oct 2026

Incremental Concept Formation over Visual Images Without Catastrophic Forgetting

arXiv 2402.16933 ↗First posted 26 Feb 2024cs.LG cs.AI cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Deep neural networks have excelled in machine learning, particularly in vision tasks, however, they often suffer from catastrophic forgetting when learning new tasks sequentially. In this work, we introduce Cobweb4V, an alternative to traditional neural network approaches. Cobweb4V is a novel visual classification method that builds on Cobweb, a human like learning system that is inspired by the way humans incrementally learn new concepts over time. In this research, we conduct a comprehensive evaluation, showcasing Cobweb4Vs proficiency in learning visual concepts, requiring less data to achieve effective learning outcomes compared to traditional methods, maintaining stable performance over time, and achieving commendable asymptotic behavior, without catastrophic forgetting effects. These characteristics align with learning strategies in human cognition, positioning Cobweb4V as a promising alternative to neural network approaches.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 15 of its 44 references that are in the map. First posted on arXiv 26 Feb 2024.

Builds on

15 of 44 references.

References · 15

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  4. 2016Learning without Forgettingcited by 2,465
  5. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  6. 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,337
  7. 2016Progressive Neural Networkscited by 1,332
  8. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  9. 2017Continual Learning with Deep Generative Replaycited by 1,152
  10. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  11. 2019Three scenarios for continual learningcited by 610
  12. 2018Progress & Compress: A scalable framework for continual learningcited by 516
3 more
  1. 2015Recent Advances in Convolutional Neural Networkscited by 360
  2. 2022Convolutional Cobweb: A Model of Incremental Learning from 2D Imagescited by 10
  3. 2022Efficient Induction of Language Models Via Probabilistic Concept Formationcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 2.

7 papers.