Recent Advances in Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
In the last few years, deep learning has led to very good performance on a variety of problems, such as visual recognition, speech recognition and natural language processing. Among different types of deep neural networks, convolutional neural networks have been most extensively studied. Leveraging on the rapid growth in the amount of the annotated data and the great improvements in the strengths of graphics processor units, the research on convolutional neural networks has been emerged swiftly and achieved state-of-the-art results on various tasks. In this paper, we provide a broad survey of the recent advances in convolutional neural networks. We detailize the improvements of CNN on different aspects, including layer design, activation function, loss function, regularization, optimization and fast computation. Besides, we also introduce various applications of convolutional neural networks in computer vision, speech and natural language processing.
Key facts. Cited by 360 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Dec 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 73; 2022: 79; 2023: 86; 2024: 67; 2025: 44; 2026: 11.
360 papers.
Sort:
By area:
- 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 197
- 2022A Review of Safe Reinforcement Learning: Methods, Theory and Applicationscited by 181
- 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
- 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
- 2021Video Summarization Using Deep Neural Networks: A Surveycited by 85
- 2022Unified Pretraining Framework for Document Understandingcited by 85
- 2023CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Imagescited by 84
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challengescited by 74
- 2023Hyperbolic Deep Learning in Computer Vision: A Surveycited by 73
- 2023Deep Learning for Time Series Classification and Extrinsic Regression: A Current Surveycited by 68
- 2021Evaluating the Robustness of Semantic Segmentation for Autonomous Driving against Real-World Adversarial Patch Attackscited by 55
- 2023A Survey on Time-Series Pre-Trained Modelscited by 52
38 more
- 2021Hyperspectral Image Classification-Traditional to Deep Models: A Survey for Future Prospectscited by 49
- 2022Optimizing Relevance Maps of Vision Transformers Improves Robustnesscited by 41
- 2024Machine Unlearning: A Comprehensive Surveycited by 35
- 20245%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Taskscited by 34
- 2021INTERN: A New Learning Paradigm Towards General Visioncited by 33
- 2023A Survey on Out-of-Distribution Detection in NLPcited by 31
- 2022Green Learning: Introduction, Examples and Outlookcited by 30
- 2024A Survey of Generative AI for de novo Drug Design: New Frontiers in Molecule and Protein Generationcited by 29
- 2021A Deep Learning approach to Reduced Order Modelling of Parameter Dependent Partial Differential Equationscited by 28
- 2022Dynamic-Group-Aware Networks for Multi-Agent Trajectory Prediction with Relational Reasoningcited by 28
- 2023Quantum Recurrent Neural Networks for Sequential Learningcited by 25
- 2023A Comprehensive Overview and Comparative Analysis on Deep Learning Models: CNN, RNN, LSTM, GRUcited by 25
- 2021A Survey of Deep Learning Techniques for Weed Detection from Imagescited by 23
- 2021Deep Metric Learning for Few-Shot Image Classification: A Review of Recent Developmentscited by 23
- 2021Google Neural Network Models for Edge Devices: Analyzing and Mitigating Machine Learning Inference Bottleneckscited by 23
- 2023Bilevel Fast Scene Adaptation for Low-Light Image Enhancementcited by 22
- 2023Object Detection with Transformers: A Reviewcited by 22
- 2023FICE: Text-Conditioned Fashion Image Editing With Guided GAN Inversioncited by 21
- 2021Discovering Distinctive "Semantics" in Super-Resolution Networkscited by 20
- 2021Monte Carlo DropBlock for Modelling Uncertainty in Object Detectioncited by 20
- 2023Does Few-shot Learning Suffer from Backdoor Attacks?cited by 20
- 2023Adapter is All You Need for Tuning Visual Taskscited by 19
- 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodalitycited by 19
- 2022Group-invariant max filteringcited by 18
- 2021Wide-Baseline Multi-Camera Calibration using Person Re-Identificationcited by 15
- 2023Dual Cross-Attention for Medical Image Segmentationcited by 15
- 2025Efficient Rectified Flow for Image Fusioncited by 15
- 2021Deep High-Resolution Representation Learning for Cross-Resolution Person Re-identificationcited by 14
- 2021Learning quantum data with the quantum Earth Mover's distancecited by 13
- 2021Latent Space Explanation by Interventioncited by 13
- 2021A Physics Informed Neural Network Approach to Solution and Identification of Biharmonic Equations of Elasticitycited by 12
- 2022Self-Regularized Prototypical Network for Few-Shot Semantic Segmentationcited by 12
- 2022Globally Gated Deep Linear Networkscited by 12
- 2022Video Unsupervised Domain Adaptation with Deep Learning: A Comprehensive Surveycited by 12
- 2025RF-DETR Object Detection vs YOLOv12 : A Study of Transformer-based and CNN-based Architectures for Single-Class and Multi-Class Greenfruit Detection in Complex Orchard Environments Under Label Ambiguitycited by 12
- 2024Quantum Denoising Diffusion Modelscited by 11
- 2021Predicting Mechanically Driven Full-Field Quantities of Interest with Deep Learning-Based Metamodelscited by 10
- 2024Deep Lead Optimization: Leveraging Generative AI for Structural Modificationcited by 10
50 most cited of 360 All 360 (JSON)
- 2026Scalability and Performance Evaluation of Federated Learning Frameworks: A Comparative Analysis14 Sep 2026
- 2026TileNet: Tile-Based CNN-SVM Architecture for Autonomous Unmanned Aerial Systems Inspection of Flat Roofs11 Sep 2026
- 2026Symbolic Regression via Neural Networks5 May 2026
- 2026DWTSumm: Discrete Wavelet Transform for Document Summarization22 Apr 2026
- 2026A Wireless World Model for AI-Native 6G Networks26 Mar 2026
- 2026Unmasking Biases and Reliability Concerns in Convolutional Neural Networks Analysis of Cancer Pathology Images12 Mar 2026
- 2026Concept-Guided Fine-Tuning: Steering ViTs away from Spurious Correlations to Improve Robustness9 Mar 2026
- 2026A Benchmark Study of Neural Network Compression Methods for Hyperspectral Image Classification5 Mar 2026
- 2026Towards Performance-Enhanced Model-Contrastive Federated Learning using Historical Information in Heterogeneous Scenarios12 Feb 2026
- 2026Deep Neural Network Architectures for Electrocardiogram Classification: A Comprehensive Evaluation7 Feb 2026
- 2026A Dual-TransUNet Deep Learning Framework for Multi-Source Precipitation Merging and Improving Seasonal and Extreme Estimates4 Feb 2026
- 2025An Interpretable Operator-Learning Model for Electric Field Profile Reconstruction in Discharges Based on the EFISH Method29 Nov 2025
38 more
- 2025FruitProm: Probabilistic Maturity Estimation and Detection of Fruits and Vegetables28 Oct 2025
- 2025Advances in Medical Image Segmentation: A Comprehensive Survey with a Focus on Lumbar Spine Applications1 Oct 2025
- 2025Neural Network Based Framework for Passive Intermodulation Cancellation in MIMO Systems21 Sep 2025
- 2025Efficient Rectified Flow for Image Fusion20 Sep 2025
- 2025Multi-Scale Deep Learning for Colon Histopathology: A Hybrid Graph-Transformer Approach2 Sep 2025
- 2025TLCCSP: A Scalable Framework for Enhancing Time Series Forecasting with Time-Lagged Cross-Correlations9 Aug 2025
- 2025Neural Network Training via Stochastic Alternating Minimization with Trainable Step Sizes6 Aug 2025
- 2025AVPDN: Learning Motion-Robust and Scale-Adaptive Representations for Video-Based Polyp Detection5 Aug 2025
- 2025Proactive Disentangled Modeling of Trigger-Object Pairings for Backdoor Defense3 Aug 2025
- 2025Combining Discrete Wavelet and Cosine Transforms for Efficient Sentence Embedding1 Aug 2025
- 2025Semantic Compression for Word and Sentence Embeddings using Discrete Wavelet Transform31 Jul 2025
- 2025Tricks and Plug-ins for Gradient Boosting in Image Classification30 Jul 2025
- 2025Deep learning-aided inverse design of porous metamaterials23 Jul 2025
- 2025Rethinking Occlusion in FER: A Semantic-Aware Perspective and Go Beyond21 Jul 2025
- 2025Visual Place Recognition for Large-Scale UAV Applications20 Jul 2025
- 2025SuperCM: Improving Semi-Supervised Learning and Domain Adaptation through differentiable clustering18 Jul 2025
- 2025Deformable Dynamic Convolution for Accurate yet Efficient Spatio-Temporal Traffic Prediction13 Jul 2025
- 2025Prediction of Lane Change Intentions of Human Drivers using an LSTM, a CNN and a Transformer11 Jul 2025
- 2025Empowering Bridge Digital Twins by Bridging the Data Gap with a Unified Synthesis Framework8 Jul 2025
- 2025Similarity Memory Prior is All You Need for Medical Image Segmentation1 Jul 2025
- 2025AquaCluster: Using Satellite Images And Self-supervised Machine Learning Networks To Detect Water Hidden Under Vegetation9 Jun 2025
- 2025Inceptive Transformers: Enhancing Contextual Representations through Multi-Scale Feature Learning Across Domains and Languages26 May 2025
- 2025Field Matters: A Lightweight LLM-enhanced Method for CTR Prediction20 May 2025
- 2025Unsupervised anomaly detection in MeV ultrafast electron diffraction19 May 2025
- 2025ChestyBot: Detecting and Disrupting Chinese Communist Party Influence Stratagems15 May 2025
- 2025Improving Generalization of Medical Image Registration Foundation Model10 May 2025
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challenges7 May 2025
- 2025GADS: A Super Lightweight Model for Head Pose Estimation22 Apr 2025
- 2025RF-DETR Object Detection vs YOLOv12 : A Study of Transformer-based and CNN-based Architectures for Single-Class and Multi-Class Greenfruit Detection in Complex Orchard Environments Under Label Ambiguity17 Apr 2025
- 2025A Diffusion-Based Framework for Terrain-Aware Remote Sensing Image Reconstruction16 Apr 2025
- 2025Beyond the Generative Learning Trilemma: Generative Model Assessment in Data Scarcity Domains14 Apr 2025
- 2025A Solid-State Nanopore Signal Generator for Training Machine Learning Models7 Apr 2025
- 2025Engineering Artificial Intelligence: Framework, Challenges, and Future Direction3 Apr 2025
- 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodality28 Mar 2025
- 2025A Survey on fMRI-based Brain Decoding for Reconstructing Multimodal Stimuli20 Mar 2025
- 2025Image-Based Alzheimer's Disease Detection Using Pretrained Convolutional Neural Network Models9 Feb 2025
- 2025Brain Tumor Identification using Improved YOLOv86 Feb 2025
- 2025Hier-EgoPack: Hierarchical Egocentric Video Understanding with Diverse Task Perspectives4 Feb 2025
50 newest of 360 All 360 (JSON)
- 2025Efficient Rectified Flow for Image Fusioncited by 15
- 2024Quantum Denoising Diffusion Modelscited by 11
- 2025Efficient Rectified Flow for Image Fusion20 Sep 2025
- 2024Quantum Denoising Diffusion Models13 Jan 2024
- 2024Machine Unlearning: A Comprehensive Surveycited by 35
- 2024Machine Unlearning: A Comprehensive Survey13 May 2024
- 2026A Wireless World Model for AI-Native 6G Networkscited by 0
- 2026A Wireless World Model for AI-Native 6G Networks26 Mar 2026
- 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 197
- 2022A Review of Safe Reinforcement Learning: Methods, Theory and Applicationscited by 181
- 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
- 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
- 2021Video Summarization Using Deep Neural Networks: A Surveycited by 85
- 2022Unified Pretraining Framework for Document Understandingcited by 85
- 2023CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Imagescited by 84
- 2023Hyperbolic Deep Learning in Computer Vision: A Surveycited by 73
- 2023Deep Learning for Time Series Classification and Extrinsic Regression: A Current Surveycited by 68
- 2021Evaluating the Robustness of Semantic Segmentation for Autonomous Driving against Real-World Adversarial Patch Attackscited by 55
- 2023A Survey on Time-Series Pre-Trained Modelscited by 52
- 2021Hyperspectral Image Classification-Traditional to Deep Models: A Survey for Future Prospectscited by 49
12 most cited of 351 All 351 (JSON)
- 2026Scalability and Performance Evaluation of Federated Learning Frameworks: A Comparative Analysis14 Sep 2026
- 2026TileNet: Tile-Based CNN-SVM Architecture for Autonomous Unmanned Aerial Systems Inspection of Flat Roofs11 Sep 2026
- 2026Symbolic Regression via Neural Networks5 May 2026
- 2026DWTSumm: Discrete Wavelet Transform for Document Summarization22 Apr 2026
- 2026Unmasking Biases and Reliability Concerns in Convolutional Neural Networks Analysis of Cancer Pathology Images12 Mar 2026
- 2026Concept-Guided Fine-Tuning: Steering ViTs away from Spurious Correlations to Improve Robustness9 Mar 2026
- 2026A Benchmark Study of Neural Network Compression Methods for Hyperspectral Image Classification5 Mar 2026
- 2026Towards Performance-Enhanced Model-Contrastive Federated Learning using Historical Information in Heterogeneous Scenarios12 Feb 2026
- 2026Deep Neural Network Architectures for Electrocardiogram Classification: A Comprehensive Evaluation7 Feb 2026
- 2026A Dual-TransUNet Deep Learning Framework for Multi-Source Precipitation Merging and Improving Seasonal and Extreme Estimates4 Feb 2026
- 2025An Interpretable Operator-Learning Model for Electric Field Profile Reconstruction in Discharges Based on the EFISH Method29 Nov 2025
- 2025FruitProm: Probabilistic Maturity Estimation and Detection of Fruits and Vegetables28 Oct 2025
12 newest of 351 All 351 (JSON)