ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
Not on the map. Why?
Abstract (arXiv)
Currently, the neural network architecture design is mostly guided by the indirect metric of computation complexity, i.e., FLOPs. However, the direct metric, e.g., speed, also depends on the other factors such as memory access cost and platform characterics. Thus, this work proposes to evaluate the direct metric on the target platform, beyond only considering FLOPs. Based on a series of controlled experiments, this work derives several practical guidelines for efficient network design. Accordingly, a new architecture is presented, called ShuffleNet V2. Comprehensive ablation experiments verify that our model is the state-of-the-art in terms of speed and accuracy tradeoff.
Key facts. Cited by 1,132 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 261; 2022: 231; 2023: 208; 2024: 195; 2025: 138; 2026: 98.
1,132 papers.
Sort:
By area:
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 798
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 636
- 2021RepVGG: Making VGG-style ConvNets Great Againcited by 520
- 2022Decoupled Knowledge Distillationcited by 380
- 2022Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Frameworkcited by 376
- 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
- 2021Distilling Knowledge via Knowledge Reviewcited by 285
- 2022Vision Transformers for Single Image Dehazingcited by 255
- 2021I-BERT: Integer-only BERT Quantizationcited by 250
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 248
38 more
- 2022EfficientFormer: Vision Transformers at MobileNet Speedcited by 240
- 2021Coordinate Attention for Efficient Mobile Network Designcited by 239
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
- 2021Mobile-Former: Bridging MobileNet and Transformercited by 234
- 2021AdaViT: Adaptive Vision Transformers for Efficient Image Recognitioncited by 228
- 2021Parametric Contrastive Learningcited by 217
- 2021RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whiteningcited by 213
- 2021Accelerating Sparse Deep Neural Networkscited by 213
- 2022UniFormer: Unifying Convolution and Self-attention for Visual Recognitioncited by 206
- 2023EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attentioncited by 172
- 2021Pixel Difference Networks for Efficient Edge Detectioncited by 167
- 2022Separable Self-attention for Mobile Vision Transformerscited by 163
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 161
- 2022Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNscited by 155
- 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mambacited by 146
- 2021Not All Images are Worth 16x16 Words: Dynamic Transformers for Efficient Image Recognitioncited by 143
- 2024MambaOut: Do We Really Need Mamba for Vision?cited by 142
- 2022Knowledge Distillation with the Reused Teacher Classifiercited by 140
- 2023Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networkscited by 129
- 2023RepViT: Revisiting Mobile CNN From ViT Perspectivecited by 123
- 2021MPViT: Multi-Path Vision Transformer for Dense Predictioncited by 122
- 2022EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Applicationscited by 121
- 2022EdgeViTs: Competing Light-weight CNNs on Mobile Devices with Vision Transformerscited by 116
- 2021VisualVoice: Audio-Visual Speech Separation with Cross-Modal Consistencycited by 114
- 2022Curriculum Temperature for Knowledge Distillationcited by 110
- 2021Panoptic SegFormer: Delving Deeper into Panoptic Segmentation with Transformerscited by 109
- 2022MobileOne: An Improved One millisecond Mobile Backbonecited by 109
- 2021Parameterized Knowledge Transfer for Personalized Federated Learningcited by 108
- 2021Involution: Inverting the Inherence of Convolution for Visual Recognitioncited by 99
- 2021The Efficiency Misnomercited by 98
- 2021A Survey of Modern Deep Learning based Object Detection Modelscited by 97
- 2021ResLT: Residual Learning for Long-tailed Recognitioncited by 96
- 2022Agreement-on-the-Line: Predicting the Performance of Neural Networks under Distribution Shiftcited by 94
- 2021CAT: Cross Attention in Vision Transformercited by 92
- 2021Lite-HRNet: A Lightweight High-Resolution Networkcited by 91
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2023Rethinking Model Ensemble in Transfer-based Adversarial Attackscited by 88
- 2021Characterizing signal propagation to close the performance gap in unnormalized ResNetscited by 87
50 most cited of 1,132 All 1,132 (JSON)
- 2026Watch Your Speech: Text-aware Video-to-Speech Synthesis with Textual Conditioning1 Oct 2026
- 2026Minkowski Attractor Networks: Closed-Form Hyperbolic Flows for Visual Representations29 Sep 2026
- 2026Transolver-σ: Joint Spectral-Physical Subspace Modeling for Neural PDE Solving29 Sep 2026
- 2026PSM: Dataset Distillation Based on Precise Statistical Matching by Difficulty28 Sep 2026
- 2026Does per-frame early exit pay? A compute-matched study of dynamic depth for on-device speech enhancement24 Sep 2026
- 2026Dimension-Specific Imbalance and an Adaptive Hybrid Label Strategy for Multi-Task Affective State Recognition in Classroom Video23 Sep 2026
- 2026Ananke: Contractive Torus Attractor Networks21 Sep 2026
- 2026A principled approach for energy-efficient training via phase-aware GPU frequency tuning21 Sep 2026
- 2026Morphology-Aware Ambiguity Learning for Wafer Defect Decision Support18 Sep 2026
- 2026Proportional-Fair Resource Allocation and Dual-Threshold Early-Exit Inference for Secure Cooperative Multi-Layer Edge Intelligence14 Sep 2026
- 2026From Visual Feedback to Textual Reviews: A Multi-Agent Vision-Language Framework for Image-Grounded Review Assistance13 Sep 2026
- 2026OCT-FedSIR: Toward Trustworthy Federated Ophthalmic Learning under Annotation Noise13 Sep 2026
38 more
- 2026Robust Decentralized Federated Distillation via Multi-Modality Knowledge Collaboration7 Sep 2026
- 2026Adaptive Gated Deepfake Detection for Low-Resolution and Resource-Constrained Environments4 Sep 2026
- 2026What Does the Encoder Actually Decide? A Controlled Comparison of Vision Backbones on Joint Tree Segmentation and Stereo Depth2 Sep 2026
- 2026H3DNAS: Hardware-Aware ONNX-Native 3D Point Cloud Model Compression2 Sep 2026
- 2026Convergence Theory of Knowledge Distillation in Asynchronous P2P Gossip Learning Network1 Sep 2026
- 2026Let Confidence Change, Not the Prediction: Prediction-Preserving Repair for Post-hoc Calibration1 Sep 2026
- 2026Enabling Memory-efficient Im2win Convolution with Multi-precision Support on GPU CUDA and Tensor Cores21 Aug 2026
- 2026Text-Guided Visual Dependency Graph Learning with Cross-Modal Attention Priors19 Aug 2026
- 2026When Simplicity Wins: Bottleneck-Aware Context Modeling for Lightweight Semantic Segmentation19 Aug 2026
- 2026Binarized High-Efficiency RAW Video Restoration and Beyond17 Aug 2026
- 2026Breaking the Compression Barrier: Cross-Architecture Compression Boundary Learning via Reverse Regrowth17 Aug 2026
- 2026AmalthAI: An Open-Source Computer Vision Platform for Cultural Heritage13 Aug 2026
- 2026BoltNet: An Ultra-Lightweight Convolutional Network for On-Device Plant Species Identification12 Aug 2026
- 2026GLOBE: Trajectory-Aligned Gradient Matching with Structured SparseOptimization for Coreset Selection3 Aug 2026
- 2026UltraViT: Latency-Optimized On-device Vision Encoder for Large Vision-Language Models25 Jul 2026
- 2026Flash EQ-Linear: Accelerating Equivariant Linear Layers via Group-wise Discrete Fourier Transform23 Jul 2026
- 2026MicroCharNet: Less is More for License Plate Character Detection13 Jul 2026
- 2026FSFVE: Few Shot Compressed Face Video Enhancement13 Jul 2026
- 2026RTFVE: Realtime Face Video Enhancement13 Jul 2026
- 2026RED-Sphere: Hyperspherical Residual Edge Debiasing for Cross-Population Fundus Disease Domain Generalization12 Jul 2026
- 2026NanoVSR: Towards Real-Time Video Super-Resolution on Edge Devices11 Jul 2026
- 2026Learnable Weighting of Intra-Attribute Distances for Categorical Data Clustering with Nominal and Ordinal Attributes6 Jul 2026
- 2026When Token Compression Breaks: Structural Pruning vs. Token Reduction for Robust ViT Segmentation under High Compression2 Jul 2026
- 2026TCG-AR: Real-Time Multi-View Augmented Reality for Trading Card Game Streaming2 Jul 2026
- 2026Do Newer Lightweight CNNs Perform Better Under Resource Constraints? A Controlled Multigenerational Study of Architecture, Initialization, Training Budget, and Efficiency2 Jul 2026
- 2026Condensing Large-Scale Datasets Directly with Minimal Information Loss1 Jul 2026
- 2026MAPE: Defending Against Transferable Adversarial Attacks Using Multi-Source Adversarial Perturbations Elimination30 Jun 2026
- 2026HASTE: A Framework for Training-Free, Dynamic, and Steerable Compression of Pre-Trained Convolutional Neural Networks29 Jun 2026
- 2026Large Language Model Teaches Visual Students: Cross-Modality Transfer of Fine-Grained Conceptual Knowledge25 Jun 2026
- 2026Modeling Local, Global, and Cross-Modal Context in Multimodal 3D MRI25 Jun 2026
- 2026The Inference-Compute Frontier and a Latency-Efficient Architecture for Limit Order Book Prediction24 Jun 2026
- 2026On the Expressive Power of Weight Quantization in Large Language Models20 Jun 2026
- 2026Efficient Neural Network Model Selection for Few-Class Application Datasets18 Jun 2026
- 2026An affordable hardware-aware neural architecture search for deploying convolutional neural networks on ultra-low-power computing platforms15 Jun 2026
- 2026CREST: Deployment-Realistic Hardware-in-the-Loop NAS for Embedded Sensing Systems12 Jun 2026
- 2026Performance Analysis of YOLOv11 and YOLOv8 for Mixed Traffic Object Detection under Adverse Weather Conditions in Developing Countries10 Jun 2026
- 2026Beyond aggregate scores: Deployment-aware and non-compensatory benchmarking of vision-based eye-state recognition models for driver monitoring6 Jun 2026
- 2026Unsupervised Continual Clustering via Forward-Backward Knowledge Distillation5 Jun 2026
50 newest of 1,132 All 1,132 (JSON)
- 2023Training on Thin Air: Improve Image Classification with Generated Datacited by 50
- 2023DiffI2I: Efficient Diffusion Model for Image-to-Image Translationcited by 24
- 2023Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation?cited by 21
- 2024JIGMARK: A Black-Box Approach for Enhancing Image Watermarks against Diffusion Model Editscited by 9
- 2025TAIGen: Training-Free Adversarial Image Generation via Diffusion Modelscited by 2
- 2024MMAD-Purify: A Precision-Optimized Framework for Efficient and Scalable Multi-Modal Attackscited by 1
- 2023Adversarial defense based on distribution transfercited by 0
- 2024D-Cube: Exploiting Hyper-Features of Diffusion Model for Robust Medical Classificationcited by 0
- 2025TAIGen: Training-Free Adversarial Image Generation via Diffusion Models20 Aug 2025
- 2024D-Cube: Exploiting Hyper-Features of Diffusion Model for Robust Medical Classification17 Nov 2024
- 2024MMAD-Purify: A Precision-Optimized Framework for Efficient and Scalable Multi-Modal Attacks17 Oct 2024
- 2024JIGMARK: A Black-Box Approach for Enhancing Image Watermarks against Diffusion Model Edits6 Jun 2024
- 2023Adversarial defense based on distribution transfer23 Nov 2023
- 2023DiffI2I: Efficient Diffusion Model for Image-to-Image Translation26 Aug 2023
- 2023Training on Thin Air: Improve Image Classification with Generated Data24 May 2023
- 2023Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation?22 May 2023
- 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mambacited by 146
- 2024MambaOut: Do We Really Need Mamba for Vision?cited by 142
- 2024Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Modelcited by 18
- 2024EfficientViM: Efficient Vision Mamba with Hidden State Mixer based State Space Dualitycited by 17
- 2024MobileMamba: Lightweight Multi-Receptive Visual Mamba Networkcited by 16
- 2024TinyViM: Frequency Decoupling for Tiny Hybrid Vision Mambacited by 15
- 2025TEM^3-Learning: Time-Efficient Multimodal Multi-Task Learning for Advanced Assistive Drivingcited by 3
- 2024MpoxMamba: A Grouped Mamba-based Lightweight Hybrid Network for Mpox Detectioncited by 0
- 2025TEM^3-Learning: Time-Efficient Multimodal Multi-Task Learning for Advanced Assistive Driving22 Jun 2025
- 2024TinyViM: Frequency Decoupling for Tiny Hybrid Vision Mamba26 Nov 2024
- 2024MobileMamba: Lightweight Multi-Receptive Visual Mamba Network24 Nov 2024
- 2024EfficientViM: Efficient Vision Mamba with Hidden State Mixer based State Space Duality22 Nov 2024
- 2024MpoxMamba: A Grouped Mamba-based Lightweight Hybrid Network for Mpox Detection6 Sep 2024
- 2024Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Model27 Jun 2024
- 2024MambaOut: Do We Really Need Mamba for Vision?13 May 2024
- 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba15 Mar 2024
- 2023Vision-Language Models can Identify Distracted Driver Behavior from Naturalistic Videoscited by 16
- 2026FastSLM: Hierarchical Temporal Abstraction for Efficient Long-Form Speech Adaptationcited by 0
- 2026DAIT: Distillation from Vision-Language Models to Lightweight Classifiers with Adaptive Intermediate Teacher Transfercited by 0
- 2026UltraViT: Latency-Optimized On-device Vision Encoder for Large Vision-Language Modelscited by 0
- 2026UltraViT: Latency-Optimized On-device Vision Encoder for Large Vision-Language Models25 Jul 2026
- 2026DAIT: Distillation from Vision-Language Models to Lightweight Classifiers with Adaptive Intermediate Teacher Transfer16 Mar 2026
- 2026FastSLM: Hierarchical Temporal Abstraction for Efficient Long-Form Speech Adaptation8 Jan 2026
- 2023Vision-Language Models can Identify Distracted Driver Behavior from Naturalistic Videos16 Jun 2023
- 2026On the Expressive Power of Weight Quantization in Large Language Modelscited by 0
- 2026When Token Compression Breaks: Structural Pruning vs. Token Reduction for Robust ViT Segmentation under High Compressioncited by 0
- 2026Does per-frame early exit pay? A compute-matched study of dynamic depth for on-device speech enhancementcited by 0
- 2026Does per-frame early exit pay? A compute-matched study of dynamic depth for on-device speech enhancement24 Sep 2026
- 2026When Token Compression Breaks: Structural Pruning vs. Token Reduction for Robust ViT Segmentation under High Compression2 Jul 2026
- 2026On the Expressive Power of Weight Quantization in Large Language Models20 Jun 2026
- 2024OSLO: One-Shot Label-Only Membership Inference Attackscited by 11
- 2024OSLO: One-Shot Label-Only Membership Inference Attacks27 May 2024
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 798
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 636
- 2021RepVGG: Making VGG-style ConvNets Great Againcited by 520
- 2022Decoupled Knowledge Distillationcited by 380
- 2022Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Frameworkcited by 376
- 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
- 2021Distilling Knowledge via Knowledge Reviewcited by 285
- 2022Vision Transformers for Single Image Dehazingcited by 255
- 2021I-BERT: Integer-only BERT Quantizationcited by 250
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 248
12 most cited of 1,103 All 1,103 (JSON)
- 2026Watch Your Speech: Text-aware Video-to-Speech Synthesis with Textual Conditioning1 Oct 2026
- 2026Minkowski Attractor Networks: Closed-Form Hyperbolic Flows for Visual Representations29 Sep 2026
- 2026Transolver-σ: Joint Spectral-Physical Subspace Modeling for Neural PDE Solving29 Sep 2026
- 2026PSM: Dataset Distillation Based on Precise Statistical Matching by Difficulty28 Sep 2026
- 2026Dimension-Specific Imbalance and an Adaptive Hybrid Label Strategy for Multi-Task Affective State Recognition in Classroom Video23 Sep 2026
- 2026Ananke: Contractive Torus Attractor Networks21 Sep 2026
- 2026A principled approach for energy-efficient training via phase-aware GPU frequency tuning21 Sep 2026
- 2026Morphology-Aware Ambiguity Learning for Wafer Defect Decision Support18 Sep 2026
- 2026Proportional-Fair Resource Allocation and Dual-Threshold Early-Exit Inference for Secure Cooperative Multi-Layer Edge Intelligence14 Sep 2026
- 2026From Visual Feedback to Textual Reviews: A Multi-Agent Vision-Language Framework for Image-Grounded Review Assistance13 Sep 2026
- 2026OCT-FedSIR: Toward Trustworthy Federated Ophthalmic Learning under Annotation Noise13 Sep 2026
- 2026Robust Decentralized Federated Distillation via Multi-Modality Knowledge Collaboration7 Sep 2026
12 newest of 1,103 All 1,103 (JSON)