CondenseNet: An Efficient DenseNet using Learned Group Convolutions
Not on the map. Why?
Abstract (arXiv)
Deep neural networks are increasingly used on mobile devices, where computational resources are limited. In this paper we develop CondenseNet, a novel network architecture with unprecedented efficiency. It combines dense connectivity with a novel module called learned group convolution. The dense connectivity facilitates feature re-use in the network, whereas learned group convolutions remove connections between layers for which this feature re-use is superfluous. At test time, our model can be implemented using standard group convolutions, allowing for efficient computation in practice. Our experiments show that CondenseNets are far more efficient than state-of-the-art compact convolutional networks such as MobileNets and ShuffleNets.
Key facts. Cited by 121 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 40; 2022: 25; 2023: 25; 2024: 18; 2025: 8; 2026: 4.
121 papers.
Sort:
By area:
- 2021Dynamic Neural Networks: A Surveycited by 405
- 2024The Unreasonable Ineffectiveness of the Deeper Layerscited by 219
- 2023Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networkscited by 129
- 2021State Entropy Maximization with Random Encoders for Efficient Explorationcited by 107
- 2021Weakly Supervised Object Localization and Detection: A Surveycited by 84
- 2022The Effects of Regularization and Data Augmentation are Class Dependentcited by 67
- 2022Dynamic Multimodal Fusioncited by 54
- 2021DeepReDuce: ReLU Reduction for Fast Private Inferencecited by 50
- 2022Online Continual Learning for Embedded Devicescited by 48
- 2022Glance and Focus Networks for Dynamic Visual Recognitioncited by 41
- 2021HR-NAS: Searching Efficient High-Resolution Neural Architectures with Lightweight Transformerscited by 39
- 2024Lightweight Deep Learning for Resource-Constrained Environments: A Surveycited by 38
38 more
- 2021Towards Compact CNNs via Collaborative Compressioncited by 36
- 2021CondenseNet V2: Sparse Feature Reactivation for Deep Networkscited by 34
- 2021Dynamic Resolution Networkcited by 31
- 2021Topology-Aware Network Pruning using Multi-stage Graph Embedding and Reinforcement Learningcited by 30
- 2023Masked Contrastive Graph Representation Learning for Age Estimationcited by 27
- 2023Latency-aware Unified Dynamic Networks for Efficient Image Recognitioncited by 26
- 2022Latency-aware Spatial-wise Dynamic Networkscited by 25
- 2023DAT++: Spatially Dynamic Vision Transformer with Deformable Attentioncited by 21
- 2021Differentiable Dynamic Quantization with Mixed Precision and Adaptive Resolutioncited by 19
- 2021Learning Prototype-oriented Set Representations for Meta-Learningcited by 19
- 2021Knowledge Evolution in Neural Networkscited by 18
- 2022Hybrid Pixel-Unshuffled Network for Lightweight Image Super-Resolutioncited by 18
- 2023Computation-efficient Deep Learning for Computer Vision: A Surveycited by 14
- 2022RepGhost: A Hardware-Efficient Ghost Module via Re-parameterizationcited by 13
- 2023Towards energy-efficient Deep Learning: An overview of energy-efficient approaches along the Deep Learning Lifecyclecited by 13
- 2025Emulating Human-like Adaptive Vision for Efficient and Flexible Machine Visual Perceptioncited by 13
- 2021Improving Computational Efficiency in Visual Reinforcement Learning via Stored Embeddingscited by 12
- 2022SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruningcited by 12
- 2022An Examination of Bias of Facial Analysis based BMI Prediction Modelscited by 10
- 2024Strengthening Layer Interaction via Dynamic Layer Attentioncited by 10
- 2021Resource-Efficient Deep Learning: A Survey on Model-, Arithmetic-, and Implementation-Level Techniquescited by 9
- 2022PAD-Net: An Efficient Framework for Dynamic Networkscited by 9
- 2021Neural Architecture Search as Program Transformation Explorationcited by 8
- 2021RADARS: Memory Efficient Reinforcement Learning Aided Differentiable Neural Architecture Searchcited by 8
- 2025UniPCGC: Towards Practical Point Cloud Geometry Compression via an Efficient Unified Approachcited by 8
- 2023DGCNet: An Efficient 3D-Densenet based on Dynamic Group Convolution for Hyperspectral Remote Sensing Image Classificationcited by 7
- 2023Spatial-Spectral Hyperspectral Classification based on Learnable 3D Group Convolutioncited by 7
- 2021Set-to-Sequence Methods in Machine Learning: a Reviewcited by 6
- 2021Compacting Deep Neural Networks for Internet of Things: Methods and Applicationscited by 6
- 2021Dynamic Domain Adaptation for Efficient Inferencecited by 6
- 2023Multi-class Skin Cancer Classification Architecture Based on Deep Convolutional Neural Networkcited by 6
- 2024Multi-Scale Fusion for Object Representationcited by 6
- 2022Selective Residual M-Net for Real Image Denoisingcited by 5
- 2023Parameter and Computation Efficient Transfer Learning for Vision-Language Pre-trained Modelscited by 5
- 2023Adam-family Methods with Decoupled Weight Decay in Deep Learningcited by 5
- 2024Grouped Discrete Representation for Object-Centric Learningcited by 5
- 2025UltraFast-LiNET: Light-weight multi-scale shift convolutional network for real-time low-light image enhancementcited by 5
- 2021Two-level Group Convolutioncited by 4
50 most cited of 121 All 121 (JSON)
- 2026Mixture of Channel Experts: Static Sparse Supports with Input-Adaptive Mixing for Pointwise Projections24 Aug 2026
- 2026Topology-Guided Biomechanical Profiling: A White-Box Framework for Opportunistic Screening of Spinal Instability on Routine CT17 Mar 2026
- 2026A Survey on Semantic Communication for Vision: Categories, Frameworks, Enabling Techniques, and Applications29 Jan 2026
- 2026LSR-Net: A Lightweight and Strong Robustness Network for Bearing Fault Diagnosis in Noise Environment14 Jan 2026
- 2025UltraFast-LiNET: Light-weight multi-scale shift convolutional network for real-time low-light image enhancement2 Dec 2025
- 2025Emulating Human-like Adaptive Vision for Efficient and Flexible Machine Visual Perception18 Sep 2025
- 2025Reverse Convolution and Its Applications to Image Restoration13 Aug 2025
- 2025Fast AI Model Partition for Split Learning over Edge Networks23 Jun 2025
- 2025DeepTraverse: A Depth-First Search Inspired Network for Algorithmic Visual Understanding11 Jun 2025
- 2025Compound and Parallel Modes of Tropical Convolutional Neural Networks9 Apr 2025
- 2025UniPCGC: Towards Practical Point Cloud Geometry Compression via an Efficient Unified Approach24 Mar 2025
- 2025CQ CNN: A Hybrid Classical Quantum Convolutional Neural Network for Alzheimer's Disease Detection Using Diffusion Generated and U Net Segmented 3D MRI4 Mar 2025
38 more
- 2024AdaScale: Dynamic Context-aware DNN Scaling via Automated Adaptation Loop on Mobile Devices1 Dec 2024
- 2024ANDHRA Bandersnatch: Training Neural Networks to Predict Parallel Realities28 Nov 2024
- 2024Grouped Discrete Representation for Object-Centric Learning4 Nov 2024
- 2024Multi-Scale Fusion for Object Representation2 Oct 2024
- 2024OStr-DARTS: Differentiable Neural Architecture Search based on Operation Strength22 Sep 2024
- 2024Organized Grouped Discrete Representation for Object-Centric Learning5 Sep 2024
- 2024Enhancing Adaptive Deep Networks for Image Classification via Uncertainty-aware Decision Fusion25 Aug 2024
- 2024Grouped Discrete Representation Guides Object-Centric Learning1 Jul 2024
- 2024Predicting Probabilities of Error to Combine Quantization and Early Exiting: QuEE20 Jun 2024
- 2024Faster Metallic Surface Defect Detection Using Deep Learning with Channel Shuffling19 Jun 2024
- 2024Strengthening Layer Interaction via Dynamic Layer Attention19 Jun 2024
- 2024CSCO: Connectivity Search of Convolutional Operators26 Apr 2024
- 2024Lightweight Deep Learning for Resource-Constrained Environments: A Survey8 Apr 2024
- 2024The Unreasonable Ineffectiveness of the Deeper Layers26 Mar 2024
- 2024Deep Few-view High-resolution Photon-counting CT at Halved Dose for Extremity Imaging19 Mar 2024
- 2024Exploring Hardware Friendly Bottleneck Architecture in CNN for Embedded Computing Systems11 Mar 2024
- 2024When do Convolutional Neural Networks Stop Learning?4 Mar 2024
- 2024Less is KEN: a Universal and Simple Non-Parametric Pruning Algorithm for Large Language Models5 Feb 2024
- 2023One-Shot Multi-Rate Pruning of Graph Convolutional Networks29 Dec 2023
- 2023Balanced Group Convolution: An Improved Group Convolution Based on Approximability Estimates19 Oct 2023
- 2023Adam-family Methods with Decoupled Weight Decay in Deep Learning13 Oct 2023
- 2023Parameter and Computation Efficient Transfer Learning for Vision-Language Pre-trained Models4 Sep 2023
- 2023DAT++: Spatially Dynamic Vision Transformer with Deformable Attention4 Sep 2023
- 2023Latency-aware Unified Dynamic Networks for Efficient Image Recognition30 Aug 2023
- 2023Computation-efficient Deep Learning for Computer Vision: A Survey27 Aug 2023
- 2023Digital Modeling on Large Kernel Metamaterial Neural Network21 Jul 2023
- 2023Spatial-Spectral Hyperspectral Classification based on Learnable 3D Group Convolution15 Jul 2023
- 2023DGCNet: An Efficient 3D-Densenet based on Dynamic Group Convolution for Hyperspectral Remote Sensing Image Classification13 Jul 2023
- 2023Miniaturized Graph Convolutional Networks with Topologically Consistent Pruning30 Jun 2023
- 2023Explainable Lifelong Stream Learning Based on "Glocal" Pairwise Fusion23 Jun 2023
- 2023Masked Contrastive Graph Representation Learning for Age Estimation16 Jun 2023
- 2023MPSA-DenseNet: A novel deep learning model for English accent classification15 Jun 2023
- 2023Autism Disease Detection Using Transfer Learning Techniques: Performance Comparison Between Central Processing Unit vs Graphics Processing Unit Functions for Neural Networks1 Jun 2023
- 2023Budget-Aware Graph Convolutional Network Design using Probabilistic Magnitude Pruning30 May 2023
- 2023Boosting Convolutional Neural Networks with Middle Spectrum Grouped Convolution13 Apr 2023
- 2023RSIR Transformer: Hierarchical Vision Transformer using Random Sampling Windows and Important Region Windows13 Apr 2023
- 2023Progressive Channel-Shrinking Network1 Apr 2023
- 2023Gated Compression Layers for Efficient Always-On Models15 Mar 2023
50 newest of 121 All 121 (JSON)
- 2024The Unreasonable Ineffectiveness of the Deeper Layerscited by 219
- 2024The Unreasonable Ineffectiveness of the Deeper Layers26 Mar 2024
- 2021Dynamic Neural Networks: A Surveycited by 405
- 2023Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networkscited by 129
- 2021State Entropy Maximization with Random Encoders for Efficient Explorationcited by 107
- 2021Weakly Supervised Object Localization and Detection: A Surveycited by 84
- 2022The Effects of Regularization and Data Augmentation are Class Dependentcited by 67
- 2022Dynamic Multimodal Fusioncited by 54
- 2021DeepReDuce: ReLU Reduction for Fast Private Inferencecited by 50
- 2022Online Continual Learning for Embedded Devicescited by 48
- 2022Glance and Focus Networks for Dynamic Visual Recognitioncited by 41
- 2021HR-NAS: Searching Efficient High-Resolution Neural Architectures with Lightweight Transformerscited by 39
- 2024Lightweight Deep Learning for Resource-Constrained Environments: A Surveycited by 38
- 2021Towards Compact CNNs via Collaborative Compressioncited by 36
12 most cited of 115 All 115 (JSON)
- 2026Topology-Guided Biomechanical Profiling: A White-Box Framework for Opportunistic Screening of Spinal Instability on Routine CT17 Mar 2026
- 2026A Survey on Semantic Communication for Vision: Categories, Frameworks, Enabling Techniques, and Applications29 Jan 2026
- 2026LSR-Net: A Lightweight and Strong Robustness Network for Bearing Fault Diagnosis in Noise Environment14 Jan 2026
- 2025UltraFast-LiNET: Light-weight multi-scale shift convolutional network for real-time low-light image enhancement2 Dec 2025
- 2025Emulating Human-like Adaptive Vision for Efficient and Flexible Machine Visual Perception18 Sep 2025
- 2025Reverse Convolution and Its Applications to Image Restoration13 Aug 2025
- 2025Fast AI Model Partition for Split Learning over Edge Networks23 Jun 2025
- 2025DeepTraverse: A Depth-First Search Inspired Network for Algorithmic Visual Understanding11 Jun 2025
- 2025Compound and Parallel Modes of Tropical Convolutional Neural Networks9 Apr 2025
- 2025UniPCGC: Towards Practical Point Cloud Geometry Compression via an Efficient Unified Approach24 Mar 2025
- 2025CQ CNN: A Hybrid Classical Quantum Convolutional Neural Network for Alzheimer's Disease Detection Using Diffusion Generated and U Net Segmented 3D MRI4 Mar 2025
- 2024AdaScale: Dynamic Context-aware DNN Scaling via Automated Adaptation Loop on Mobile Devices1 Dec 2024
12 newest of 115 All 115 (JSON)