Adaptive Growth: Real-time CNN Layer Expansion
Not on the map. Why?
Abstract (arXiv)
Deep Neural Networks (DNNs) have shown unparalleled achievements in numerous applications, reflecting their proficiency in managing vast data sets. Yet, their static structure limits their adaptability in ever-changing environments. This research presents a new algorithm that allows the convolutional layer of a Convolutional Neural Network (CNN) to dynamically evolve based on data input, while still being seamlessly integrated into existing DNNs. Instead of a rigid architecture, our approach iteratively introduces kernels to the convolutional layer, gauging its real-time response to varying data. This process is refined by evaluating the layer's capacity to discern image features, guiding its growth. Remarkably, our unsupervised method has outstripped its supervised counterparts across diverse datasets like MNIST, Fashion-MNIST, CIFAR-10, and CIFAR-100. It also showcases enhanced adaptability in transfer learning scenarios. By introducing a data-driven model scalability strategy, we are filling a void in deep learning, leading to more flexible and efficient DNNs suited for dynamic settings. Code:(https://github.com/YunjieZhu/Extensible-Convolutional-Layer-git-version).
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 38 references that are in the map. First posted on arXiv 6 Sep 2023.
Builds on
16 of 38 references.
References · 16
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,487
- 2016Progressive Neural Networkscited by 1,361
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,276
- 2020Meta-Learning in Neural Networks: A Surveycited by 950
- 2015An Introduction to Convolutional Neural Networkscited by 514
- 2016Expert Gate: Lifelong Learning with a Network of Expertscited by 372
- 2019Understanding the Limitations of CNN-based Absolute Camera Pose Regressioncited by 177
- 2020A Comprehensive Study of Class Incremental Learning Algorithms for Visual Taskscited by 107
- 2017A Simple Neural Attentive Meta-Learnercited by 23
4 more
- 2020Deep Multi-task Multi-label CNN for Effective Facial Attribute Classificationcited by 22
- 2019Knowledge transfer in deep block-modular neural networkscited by 14
- 2021Multi-label Classification via Adaptive Resonance Theory-based Clusteringcited by 7
- 2022Effective Audio Classification Network Based on Paired Inverse Pyramid Structure and Dense MLP Blockcited by 3
Built on by
Not cited yet.