ACNet: Strengthening the Kernel Skeletons for Powerful CNN via Asymmetric Convolution Blocks
Not on the map. Why?
Abstract (arXiv)
As designing appropriate Convolutional Neural Network (CNN) architecture in the context of a given application usually involves heavy human works or numerous GPU hours, the research community is soliciting the architecture-neutral CNN structures, which can be easily plugged into multiple mature architectures to improve the performance on our real-world applications. We propose Asymmetric Convolution Block (ACB), an architecture-neutral structure as a CNN building block, which uses 1D asymmetric convolutions to strengthen the square convolution kernels. For an off-the-shelf architecture, we replace the standard square-kernel convolutional layers with ACBs to construct an Asymmetric Convolutional Network (ACNet), which can be trained to reach a higher level of accuracy. After training, we equivalently convert the ACNet into the same original architecture, thus requiring no extra computations anymore. We have observed that ACNet can improve the performance of various models on CIFAR and ImageNet by a clear margin. Through further experiments, we attribute the effectiveness of ACB to its capability of enhancing the model's robustness to rotational distortions and strengthening the central skeleton parts of square convolution kernels.
Key facts. Cited by 178 papers in the map (data through 13 Oct 2026). First posted on arXiv 11 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 34; 2023: 39; 2024: 37; 2025: 30; 2026: 12.
178 papers.
Sort:
By area:
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 979
- 2021RepVGG: Making VGG-style ConvNets Great Againcited by 520
- 2022HRDA: Context-Aware High-Resolution Domain-Adaptive Semantic Segmentationcited by 163
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 161
- 2022Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNscited by 155
- 2022More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsitycited by 142
- 2021Salient Object Detection via Integrity Learningcited by 133
- 2023RepViT: Revisiting Mobile CNN From ViT Perspectivecited by 123
- 2022Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learningcited by 118
- 2022MobileOne: An Improved One millisecond Mobile Backbonecited by 109
- 2023MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Trainingcited by 96
- 2021Diverse Branch Block: Building a Convolution as an Inception-like Unitcited by 87
38 more
- 2022What Makes Convolutional Models Great on Long Sequence Modeling?cited by 86
- 2023Towards Efficient Visual Adaption via Structural Re-parameterizationcited by 73
- 2022Representation Compensation Networks for Continual Semantic Segmentationcited by 72
- 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
- 2023UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognitioncited by 64
- 2021Initialization and Regularization of Factorized Neural Layerscited by 58
- 2021Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perceptioncited by 57
- 2024FiLo: Zero-Shot Anomaly Detection by Fine-Grained Description and High-Quality Localizationcited by 51
- 2024ClipSAM: CLIP and SAM Collaboration for Zero-Shot Anomaly Segmentationcited by 49
- 2024QKFormer: Hierarchical Spiking Transformer using Q-K Attentioncited by 47
- 2023NORM: Knowledge Distillation via N-to-One Representation Matchingcited by 44
- 2021CTNet: Context-based Tandem Network for Semantic Segmentationcited by 43
- 2021RepMLP: Re-parameterizing Convolutions into Fully-connected Layers for Image Recognitioncited by 40
- 2022NTIRE 2022 Challenge on Efficient Super-Resolution: Methods and Resultscited by 40
- 2024NTIRE 2024 Challenge on Image Super-Resolution (x4): Methods and Resultscited by 40
- 2022Overview of Deep Learning-based CSI Feedback in Massive MIMO Systemscited by 37
- 2024Improved Implicit Neural Representation with Fourier Reparameterized Trainingcited by 36
- 2024Efficient Real-world Image Super-Resolution Via Adaptive Directional Gradient Convolutioncited by 36
- 2022Re-parameterizing Your Optimizers rather than Architecturescited by 35
- 2021RepMLPNet: Hierarchical Vision MLP with Re-parameterized Localitycited by 32
- 2022StructToken : Rethinking Semantic Segmentation with Structural Priorcited by 30
- 2023Training Full Spike Neural Networks via Auxiliary Accumulation Pathwaycited by 26
- 2025The Tenth NTIRE 2025 Efficient Super-Resolution Challenge Reportcited by 26
- 2023VanillaNet: the Power of Minimalism in Deep Learningcited by 23
- 2022Make RepVGG Greater Again: A Quantization-aware Approachcited by 22
- 2021Collapsible Linear Blocks for Super-Efficient Super Resolutioncited by 19
- 2021Real-Time Video Super-Resolution on Smartphones with Deep Learning, Mobile AI 2021 Challenge: Reportcited by 19
- 2022RepSR: Training Efficient VGG-style Super-Resolution Networks with Structural Re-Parameterization and Batch Normalizationcited by 19
- 2022Edge-enhanced Feature Distillation Network for Efficient Super-Resolutioncited by 18
- 2023Consolidator: Mergeable Adapter with Grouped Connections for Visual Adaptationcited by 18
- 2021Brain Age Estimation From MRI Using Cascade Networks with Ranking Losscited by 17
- 2023AsymFormer: Asymmetrical Cross-Modal Representation Learning for Mobile Platform Real-Time RGB-D Semantic Segmentationcited by 17
- 2021Fast Camera Image Denoising on Mobile GPUs with Deep Learning, Mobile AI 2021 Challenge: Reportcited by 15
- 2021On-Off Center-Surround Receptive Fields for Accurate and Robust Image Classificationcited by 15
- 2024Zero-shot Generalizable Incremental Learning for Vision-Language Object Detectioncited by 15
- 2024RingMo-Aerial: An Aerial Remote Sensing Foundation Model With Affine Transformation Contrastive Learningcited by 15
- 2024Customize Segment Anything Model for Multi-Modal Semantic Segmentation with Mixture of LoRA Expertscited by 15
- 2025LSNet: See Large, Focus Smallcited by 15
50 most cited of 178 All 178 (JSON)
- 2026UltraMatch: Transport Path Routing for Ultra-Fast and Memory-Efficient Image Matching29 Sep 2026
- 2026Strip Convolution and Direction-Aware Exclusion Loss for Oriented Ship Detection23 Sep 2026
- 2026LiAuto-MindViT: A Hybrid Vision Backbone with Adaptive Bidirectional Mamba21 Sep 2026
- 2026HDMamba-YOLO: Efficient State-Space Perception and Local Spatial Reconstruction for UAV Small Object19 Sep 2026
- 2026Train Overcomplete, Deploy Compact: Scaling Recovery Capacity for Structured LLM Pruning7 Sep 2026
- 2026SPDCN: Strip-based Deformable Convolutional Network for Steel Surface Defect Segmentation23 Jul 2026
- 2026RaysUp: Ultra-light Universal Feature Upsampling via Geometry-Aware Ray Representation22 Jun 2026
- 2026Local Spatiotemporal Convolutional Network for Robust Gait Recognition14 May 2026
- 2026Learning Coverage- and Power-Optimal Transmitter Placement from City Maps: A Comparative Study of Direct and Indirect Neural Approaches23 Apr 2026
- 2026GAC-KAN: An Ultra-Lightweight GNSS Interference Classifier for GenAI-Powered Consumer Edge Devices30 Jan 2026
- 2026Dynamic Differential Linear Attention: Enhancing Linear Diffusion Transformer for High-Quality Image Generation20 Jan 2026
- 2026SKANet: A Cognitive Dual-Stream Framework with Adaptive Modality Fusion for Robust Compound GNSS Interference Classification19 Jan 2026
38 more
- 2025Joint Multi-scale Gated Transformer and Prior-guided Convolutional Network for Learned Image Compression30 Nov 2025
- 2025Attention via Synaptic Plasticity is All You Need: A Biologically Inspired Spiking Neuromorphic Transformer18 Nov 2025
- 2025MPCM-Net: Multi-scale network integrates partial attention convolution with Mamba for ground-based cloud image segmentation12 Nov 2025
- 2025Controllable-LPMoE: Adapting to Challenging Object Segmentation via Dynamic Local Priors from Mixture-of-Experts24 Oct 2025
- 2025Efficient Real-World Deblurring using Single Images: AIM 2025 Challenge Report14 Oct 2025
- 2025Efficient Perceptual Image Super Resolution: AIM 2025 Study and Benchmark14 Oct 2025
- 2025Detection of retinal diseases using an accelerated reused convolutional network5 Oct 2025
- 2025Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospects19 Sep 2025
- 2025Adaptive Fuzzy Time Series Forecasting via Partially Asymmetric Convolution and Sub-Sliding Window Fusion28 Jul 2025
- 2025Airway Segmentation Network for Enhanced Tubular Feature Extraction9 Jul 2025
- 2025MobileIE: An Extremely Lightweight and Effective ConvNet for Real-Time Image Enhancement on Mobile Devices2 Jul 2025
- 2025Deep Learning-Based Multi-Object Tracking: A Comprehensive Survey from Foundations to State-of-the-Art16 Jun 2025
- 2025DiscoVLA: Discrepancy Reduction in Vision, Language, and Alignment for Parameter-Efficient Video-Text Retrieval10 Jun 2025
- 2025Enhancing Frequency for Single Image Super-Resolution with Learnable Separable Kernels5 Jun 2025
- 2025RePaViT: Scalable Vision Transformer Acceleration via Structural Reparameterization on Feedforward Network Layers28 May 2025
- 2025Enhancing Shape Perception and Segmentation Consistency for Industrial Image Inspection19 May 2025
- 2025Expert-Like Reparameterization of Heterogeneous Pyramid Receptive Fields in Efficient CNNs for Fair Medical Image Classification19 May 2025
- 2025Lightweight RGB-D Salient Object Detection from a Speed-Accuracy Tradeoff Perspective7 May 2025
- 2025TS-Diff: Two-Stage Diffusion Model for Low-Light RAW Image Enhancement7 May 2025
- 2025Partition Map-Based Fast Block Partitioning for VVC Inter Coding25 Apr 2025
- 2025The Tenth NTIRE 2025 Efficient Super-Resolution Challenge Report14 Apr 2025
- 2025LSNet: See Large, Focus Small29 Mar 2025
- 2025RETHINED: A New Benchmark and Baseline for Real-Time High-Resolution Image Inpainting On Edge Devices18 Mar 2025
- 2025Golden Cudgel Network for Real-Time Semantic Segmentation5 Mar 2025
- 2025RVAFM: Re-parameterizing Vertical Attention Fusion Module for Handwritten Paragraph Text Recognition5 Mar 2025
- 2025Parameter Expanded Stochastic Gradient Markov Chain Monte Carlo2 Mar 2025
- 2025Striving for Faster and Better: A One-Layer Architecture with Auto Re-parameterization for Low-Light Image Enhancement27 Feb 2025
- 2025A Retrospective Systematic Study on Hierarchical Sparse Query Transformer-assisted Ultrasound Screening for Early Hepatocellular Carcinoma6 Feb 2025
- 2025ContextFormer: Redefining Efficiency in Semantic Segmentation31 Jan 2025
- 2025Rethinking the Upsampling Layer in Hyperspectral Image Super Resolution30 Jan 2025
- 2024Customize Segment Anything Model for Multi-Modal Semantic Segmentation with Mixture of LoRA Experts5 Dec 2024
- 2024HEIE: MLLM-Based Hierarchical Explainable AIGC Image Implausibility Evaluator26 Nov 2024
- 2024Scaling Up Your Kernels: Large Kernel Design in ConvNets towards Universal Representations10 Oct 2024
- 2024Gap Preserving Distillation by Building Bidirectional Mappings with A Dynamic Teacher5 Oct 2024
- 2024RingMo-Aerial: An Aerial Remote Sensing Foundation Model With Affine Transformation Contrastive Learning20 Sep 2024
- 2024AWF: Adaptive Weight Fusion for Enhanced Class Incremental Semantic Segmentation13 Sep 2024
- 2024Multi-SIGATnet: A multimodal schizophrenia MRI classification algorithm using sparse interaction mechanisms and graph attention networks25 Aug 2024
- 2024Reparameterized Multi-Resolution Convolutions for Long Sequence Modelling18 Aug 2024
50 newest of 178 All 178 (JSON)
- 2021Initialization and Regularization of Factorized Neural Layerscited by 58
- 2023NORM: Knowledge Distillation via N-to-One Representation Matchingcited by 44
- 2022Edge-enhanced Feature Distillation Network for Efficient Super-Resolutioncited by 18
- 2021LANA: Latency Aware Network Accelerationcited by 11
- 2023Towards a Smaller Student: Capacity Dynamic Distillation for Efficient Image Retrievalcited by 6
- 2024Gap Preserving Distillation by Building Bidirectional Mappings with A Dynamic Teachercited by 0
- 2024Gap Preserving Distillation by Building Bidirectional Mappings with A Dynamic Teacher5 Oct 2024
- 2023NORM: Knowledge Distillation via N-to-One Representation Matching23 May 2023
- 2023Towards a Smaller Student: Capacity Dynamic Distillation for Efficient Image Retrieval16 Mar 2023
- 2022Edge-enhanced Feature Distillation Network for Efficient Super-Resolution19 Apr 2022
- 2021LANA: Latency Aware Network Acceleration12 Jul 2021
- 2021Initialization and Regularization of Factorized Neural Layers3 May 2021
- 2024Customize Segment Anything Model for Multi-Modal Semantic Segmentation with Mixture of LoRA Expertscited by 15
- 2023Experts Weights Averaging: A New General Training Scheme for Vision Transformerscited by 12
- 2025Controllable-LPMoE: Adapting to Challenging Object Segmentation via Dynamic Local Priors from Mixture-of-Expertscited by 9
- 2025A Retrospective Systematic Study on Hierarchical Sparse Query Transformer-assisted Ultrasound Screening for Early Hepatocellular Carcinomacited by 1
- 2025Controllable-LPMoE: Adapting to Challenging Object Segmentation via Dynamic Local Priors from Mixture-of-Experts24 Oct 2025
- 2025A Retrospective Systematic Study on Hierarchical Sparse Query Transformer-assisted Ultrasound Screening for Early Hepatocellular Carcinoma6 Feb 2025
- 2024Customize Segment Anything Model for Multi-Modal Semantic Segmentation with Mixture of LoRA Experts5 Dec 2024
- 2023Experts Weights Averaging: A New General Training Scheme for Vision Transformers11 Aug 2023
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 979
- 2021RepVGG: Making VGG-style ConvNets Great Againcited by 520
- 2022HRDA: Context-Aware High-Resolution Domain-Adaptive Semantic Segmentationcited by 163
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 161
- 2022Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNscited by 155
- 2022More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsitycited by 142
- 2021Salient Object Detection via Integrity Learningcited by 133
- 2023RepViT: Revisiting Mobile CNN From ViT Perspectivecited by 123
- 2022Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learningcited by 118
- 2022MobileOne: An Improved One millisecond Mobile Backbonecited by 109
- 2023MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Trainingcited by 96
- 2021Diverse Branch Block: Building a Convolution as an Inception-like Unitcited by 87
12 most cited of 163 All 163 (JSON)
- 2026UltraMatch: Transport Path Routing for Ultra-Fast and Memory-Efficient Image Matching29 Sep 2026
- 2026Strip Convolution and Direction-Aware Exclusion Loss for Oriented Ship Detection23 Sep 2026
- 2026HDMamba-YOLO: Efficient State-Space Perception and Local Spatial Reconstruction for UAV Small Object19 Sep 2026
- 2026Train Overcomplete, Deploy Compact: Scaling Recovery Capacity for Structured LLM Pruning7 Sep 2026
- 2026SPDCN: Strip-based Deformable Convolutional Network for Steel Surface Defect Segmentation23 Jul 2026
- 2026RaysUp: Ultra-light Universal Feature Upsampling via Geometry-Aware Ray Representation22 Jun 2026
- 2026Local Spatiotemporal Convolutional Network for Robust Gait Recognition14 May 2026
- 2026Learning Coverage- and Power-Optimal Transmitter Placement from City Maps: A Comparative Study of Direct and Indirect Neural Approaches23 Apr 2026
- 2026GAC-KAN: An Ultra-Lightweight GNSS Interference Classifier for GenAI-Powered Consumer Edge Devices30 Jan 2026
- 2026SKANet: A Cognitive Dual-Stream Framework with Adaptive Modality Fusion for Robust Compound GNSS Interference Classification19 Jan 2026
- 2025Joint Multi-scale Gated Transformer and Prior-guided Convolutional Network for Learned Image Compression30 Nov 2025
- 2025Attention via Synaptic Plasticity is All You Need: A Biologically Inspired Spiking Neuromorphic Transformer18 Nov 2025
12 newest of 163 All 163 (JSON)