GhostNet: More Features from Cheap Operations
Not on the map. Why?
Abstract (arXiv)
Deploying convolutional neural networks (CNNs) on embedded devices is difficult due to the limited memory and computation resources. The redundancy in feature maps is an important characteristic of those successful CNNs, but has rarely been investigated in neural architecture design. This paper proposes a novel Ghost module to generate more feature maps from cheap operations. Based on a set of intrinsic feature maps, we apply a series of linear transformations with cheap cost to generate many ghost feature maps that could fully reveal information underlying intrinsic features. The proposed Ghost module can be taken as a plug-and-play component to upgrade existing convolutional neural networks. Ghost bottlenecks are designed to stack Ghost modules, and then the lightweight GhostNet can be easily established. Experiments conducted on benchmarks demonstrate that the proposed Ghost module is an impressive alternative of convolution layers in baseline models, and our GhostNet can achieve higher recognition performance (e.g. 75.7% top-1 accuracy) than MobileNetV3 with similar computational cost on the ImageNet ILSVRC-2012 classification dataset. Code is available at https://github.com/huawei-noah/ghostnet
Key facts. Cited by 410 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 77; 2022: 81; 2023: 66; 2024: 76; 2025: 72; 2026: 38.
410 papers.
Sort:
By area:
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
- 2021Transformer in Transformercited by 632
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 347
- 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
- 2021Mobile-Former: Bridging MobileNet and Transformercited by 234
- 2023EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attentioncited by 172
- 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mambacited by 146
- 2023Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networkscited by 129
- 2021Rethinking BiSeNet For Real-time Semantic Segmentationcited by 124
- 2021Shuffle Transformer: Rethinking Spatial Shuffle for Vision Transformercited by 115
- 2022MobileOne: An Improved One millisecond Mobile Backbonecited by 109
38 more
- 2021Distilling Object Detectors via Decoupled Featurescited by 105
- 2024MobileNetV4 -- Universal Models for the Mobile Ecosystemcited by 98
- 2023InceptionNeXt: When Inception Meets ConvNeXtcited by 84
- 2022TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentationcited by 82
- 2023One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillationcited by 77
- 2021MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Imagecited by 74
- 2024Wavelet Convolutions for Large Receptive Fieldscited by 74
- 2024SHViT: Single-Head Vision Transformer with Memory Efficient Macro Designcited by 55
- 2024Rewrite the Starscited by 55
- 2022Pro-tuning: Unified Prompt Tuning for Vision Taskscited by 53
- 2021ReCU: Reviving the Dead Weights in Binary Neural Networkscited by 51
- 2023Gold-YOLO: Efficient Object Detector via Gather-and-Distribute Mechanismcited by 51
- 2021FaceX-Zoo: A PyTorch Toolbox for Face Recognitioncited by 49
- 2022Improving the Transferability of Targeted Adversarial Examples through Object-Based Diverse Inputcited by 49
- 2021AdaFuse: Adaptive Temporal Fusion Network for Efficient Action Recognitioncited by 48
- 2022Beyond Attentive Tokens: Incorporating Token Importance and Diversity for Efficient Vision Transformerscited by 47
- 2021Combined Depth Space based Architecture Search For Person Re-identificationcited by 44
- 2022Exploring Inter-Channel Correlation for Diversity-preserved KnowledgeDistillationcited by 44
- 2022GhostNetV2: Enhance Cheap Operation with Long-Range Attentioncited by 44
- 2021Manifold Regularized Dynamic Network Pruningcited by 43
- 2022EfficientViT: Multi-Scale Linear Attention for High-Resolution Dense Predictioncited by 42
- 2023Adaptive Sparse Convolutional Networks with Global Context Enhancement for Faster Object Detection on Drone Imagescited by 41
- 2023EdgeSAM: Prompt-In-the-Loop Distillation for SAMcited by 40
- 2021Learning Frequency Domain Approximation for Binary Neural Networkscited by 38
- 2022AdaBin: Improving Binary Neural Networks with Adaptive Binary Setscited by 38
- 2022Visual Attention Methods in Deep Learning: An In-Depth Surveycited by 37
- 2023Rethinking Mobile Block for Efficient Attention-based Modelscited by 36
- 2021Revisiting Dynamic Convolution via Matrix Decompositioncited by 35
- 2022DUET: A Tuning-Free Device-Cloud Collaborative Parameters Generation Framework for Efficient Device Model Generalizationcited by 35
- 2021YOLOStereo3D: A Step Back to 2D for Efficient Stereo 3D Detectioncited by 34
- 2021CondenseNet V2: Sparse Feature Reactivation for Deep Networkscited by 34
- 2023EdgeFace: Efficient Face Recognition Model for Edge Devicescited by 33
- 2021Prioritized Architecture Sampling with Monto-Carlo Tree Searchcited by 32
- 2023Focus the Discrepancy: Intra- and Inter-Correlation Learning for Image Anomaly Detectioncited by 32
- 2021Dynamic Resolution Networkcited by 31
- 2022ParC-Net: Position Aware Circular Convolution with Merits from ConvNets and Transformercited by 28
- 2021PP-LCNet: A Lightweight CPU Convolutional Neural Networkcited by 27
- 2021Face.evoLVe: A High-Performance Face Recognition Librarycited by 26
50 most cited of 410 All 410 (JSON)
- 2026Small Object Detection in Drone Aerial Imagery with LAF-YOLOv1013 Sep 2026
- 2026LightMedSeg-ISLES: Stroke Lesion Segmentation with 81x Fewer Parameters than nnU-Net9 Sep 2026
- 2026H3DNAS: Hardware-Aware ONNX-Native 3D Point Cloud Model Compression2 Sep 2026
- 2026When Simplicity Wins: Bottleneck-Aware Context Modeling for Lightweight Semantic Segmentation19 Aug 2026
- 2026BoltNet: An Ultra-Lightweight Convolutional Network for On-Device Plant Species Identification12 Aug 2026
- 2026Ghost Features and Spooky Transfer Learning for Hypercomplex-Valued Neural Networks7 Aug 2026
- 2026BladeYOLO: Wind Turbine Blade Defect Detection with Limited Annotations and Weak-Saliency Awareness30 Jul 2026
- 2026UltraViT: Latency-Optimized On-device Vision Encoder for Large Vision-Language Models25 Jul 2026
- 2026Efficient Tuning Before Low-Bit Post-Training Quantization for Stochastic Gradient Descent-optimized Models13 Jul 2026
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching23 Jun 2026
- 2026DepthPolyp: Pseudo-Depth Guided Lightweight Segmentation for Real-Time Colonoscopy15 May 2026
- 2026Representative Attention For Vision Transformers14 May 2026
38 more
- 2026CADS: Conformal Adaptive Decision System for Cost-Efficient Image Classification12 May 2026
- 2026Image Classification via Random Dilated Convolution with Multi-Branch Feature Extraction and Context Excitation28 Apr 2026
- 2026KAConvNet: Kolmogorov-Arnold Convolutional Networks for Vision Recognition25 Apr 2026
- 2026Attention-Augmented YOLOv8 with Ghost Convolution for Real-Time Vehicle Detection in Intelligent Transportation Systems22 Apr 2026
- 20263DTV: A Feedforward Interpolation Network for Real-Time View Synthesis13 Apr 2026
- 2026FaceLiVTv2: An Improved Hybrid Architecture for Efficient Mobile Face Recognition10 Apr 2026
- 2026Sparse Gain Radio Map Reconstruction With Geometry Priors and Uncertainty-Guided Measurement Selection7 Apr 2026
- 2026SARES-DEIM: Sparse Mixture-of-Experts Meets DETR for Robust SAR Ship Detection5 Apr 2026
- 2026Demo-Pose: Depth-Monocular Modality Fusion For Object Pose Estimation29 Mar 2026
- 2026Beyond MACs: Hardware Efficient Architecture Design for Vision Backbones27 Mar 2026
- 2026Real-Time Branch-to-Tool Distance Estimation for Autonomous UAV Pruning: Benchmarking Five DEFOM-Stereo Variants from Simulation to Jetson Deployment27 Mar 2026
- 2026SmaAT-QMix-UNet: A Parameter-Efficient Vector-Quantized UNet for Precipitation Nowcasting23 Mar 2026
- 2026Advancing Visual Reliability: Color-Accurate Underwater Image Enhancement for Real-Time Underwater Missions17 Mar 2026
- 2026Efficient RGB-D Scene Understanding via Multi-task Adaptive Learning and Cross-dimensional Feature Guidance8 Mar 2026
- 2026LightMedSeg: Lightweight 3D Medical Image Segmentation with Learned Spatial Anchors7 Mar 2026
- 2026No Labels, No Look-Ahead: Unsupervised Online Video Stabilization with Classical Priors26 Feb 2026
- 2026Face Presentation Attack Detection via Content-Adaptive Spatial Operators21 Feb 2026
- 2026RefineFormer3D: Efficient 3D Medical Image Segmentation via Adaptive Multi-Scale Transformer with Cross Attention Fusion18 Feb 2026
- 2026LAF-YOLOv10 with Partial Convolution Backbone, Attention-Guided Feature Pyramid, Auxiliary P2 Head, and Wise-IoU Loss for Small Object Detection in Drone Aerial Imagery13 Feb 2026
- 2026Resource-Efficient RGB-Only Action Recognition for Edge Deployment11 Feb 2026
- 2026GAC-KAN: An Ultra-Lightweight GNSS Interference Classifier for GenAI-Powered Consumer Edge Devices30 Jan 2026
- 2026Active Learning-Driven Lightweight YOLOv9: Enhancing Efficiency in Smart Agriculture30 Jan 2026
- 2026Routing the Lottery: Adaptive Subnetworks for Heterogeneous Data29 Jan 2026
- 2026EFSI-DETR: Efficient Frequency-Semantic Integration for Real-Time Small Object Detection in UAV Imagery26 Jan 2026
- 2026Revisiting Lightweight Low-Light Image Enhancement: From a YUV Color Space Perspective24 Jan 2026
- 2026PhyG-MoE: A Physics-Guided Mixture-of-Experts Framework for Energy-Efficient GNSS Interference Recognition19 Jan 2026
- 2025UltraLBM-UNet: Ultralight Bidirectional Mamba-based Model for Skin Lesion Segmentation25 Dec 2025
- 2025Towards Ancient Plant Seed Classification: A Benchmark Dataset and Baseline Model20 Dec 2025
- 2025CLIP-FTI: Fine-Grained Face Template Inversion via CLIP-Driven Attribute Conditioning17 Dec 2025
- 2025Effective Attention-Guided Multi-Scale Medical Network for Skin Lesion Segmentation8 Dec 2025
- 2025UltraFast-LiNET: Light-weight multi-scale shift convolutional network for real-time low-light image enhancement2 Dec 2025
- 2025BD-Net: Has Depth-Wise Convolution Ever Been Applied in Binary Neural Networks?19 Nov 2025
- 2025From Per-Image Low-Rank to Encoding Mismatch: Rethinking Feature Distillation in Vision Transformers19 Nov 2025
- 2025YOLO-Drone: An Efficient Object Detection Approach Using the GhostHead Network for Drone Images14 Nov 2025
- 2025Beyond ImageNet: Understanding Cross-Dataset Robustness of Lightweight Vision Models1 Nov 2025
- 2025SPLite Hand: Sparsity-Aware Lightweight 3D Hand Pose Estimation18 Oct 2025
- 2025FMC-DETR: Frequency-Decoupled Multi-Domain Coordination for Aerial-View Object Detection27 Sep 2025
- 2025HierLight-YOLO: A Hierarchical and Lightweight Object Detection Network for UAV Photography26 Sep 2025
50 newest of 410 All 410 (JSON)
- 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mambacited by 146
- 2024Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Modelcited by 18
- 2025DefMamba: Deformable Visual State Space Modelcited by 18
- 2024EfficientViM: Efficient Vision Mamba with Hidden State Mixer based State Space Dualitycited by 17
- 2024MobileMamba: Lightweight Multi-Receptive Visual Mamba Networkcited by 16
- 2024TinyViM: Frequency Decoupling for Tiny Hybrid Vision Mambacited by 15
- 2025UltraLBM-UNet: Ultralight Bidirectional Mamba-based Model for Skin Lesion Segmentationcited by 3
- 2024DS MYOLO: A Reliable Object Detector Based on SSMs for Driving Scenarioscited by 0
- 2025Joint-octamamba:an octa joint segmentation network based on feature enhanced mambacited by 0
- 2026BladeYOLO: Wind Turbine Blade Defect Detection with Limited Annotations and Weak-Saliency Awarenesscited by 0
- 2026BladeYOLO: Wind Turbine Blade Defect Detection with Limited Annotations and Weak-Saliency Awareness30 Jul 2026
- 2025UltraLBM-UNet: Ultralight Bidirectional Mamba-based Model for Skin Lesion Segmentation25 Dec 2025
- 2025Joint-octamamba:an octa joint segmentation network based on feature enhanced mamba15 Sep 2025
- 2025DefMamba: Deformable Visual State Space Model8 Apr 2025
- 2024TinyViM: Frequency Decoupling for Tiny Hybrid Vision Mamba26 Nov 2024
- 2024MobileMamba: Lightweight Multi-Receptive Visual Mamba Network24 Nov 2024
- 2024EfficientViM: Efficient Vision Mamba with Hidden State Mixer based State Space Duality22 Nov 2024
- 2024DS MYOLO: A Reliable Object Detector Based on SSMs for Driving Scenarios2 Sep 2024
- 2024Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Model27 Jun 2024
- 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba15 Mar 2024
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
- 2021Transformer in Transformercited by 632
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 347
- 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
- 2021Mobile-Former: Bridging MobileNet and Transformercited by 234
- 2023EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attentioncited by 172
- 2023Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networkscited by 129
- 2021Rethinking BiSeNet For Real-time Semantic Segmentationcited by 124
- 2021Shuffle Transformer: Rethinking Spatial Shuffle for Vision Transformercited by 115
- 2022MobileOne: An Improved One millisecond Mobile Backbonecited by 109
- 2021Distilling Object Detectors via Decoupled Featurescited by 105
12 most cited of 395 All 395 (JSON)
- 2026Small Object Detection in Drone Aerial Imagery with LAF-YOLOv1013 Sep 2026
- 2026LightMedSeg-ISLES: Stroke Lesion Segmentation with 81x Fewer Parameters than nnU-Net9 Sep 2026
- 2026H3DNAS: Hardware-Aware ONNX-Native 3D Point Cloud Model Compression2 Sep 2026
- 2026When Simplicity Wins: Bottleneck-Aware Context Modeling for Lightweight Semantic Segmentation19 Aug 2026
- 2026BoltNet: An Ultra-Lightweight Convolutional Network for On-Device Plant Species Identification12 Aug 2026
- 2026Ghost Features and Spooky Transfer Learning for Hypercomplex-Valued Neural Networks7 Aug 2026
- 2026Efficient Tuning Before Low-Bit Post-Training Quantization for Stochastic Gradient Descent-optimized Models13 Jul 2026
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching23 Jun 2026
- 2026DepthPolyp: Pseudo-Depth Guided Lightweight Segmentation for Real-Time Colonoscopy15 May 2026
- 2026CADS: Conformal Adaptive Decision System for Cost-Efficient Image Classification12 May 2026
- 2026Image Classification via Random Dilated Convolution with Multi-Branch Feature Extraction and Context Excitation28 Apr 2026
- 2026KAConvNet: Kolmogorov-Arnold Convolutional Networks for Vision Recognition25 Apr 2026
12 newest of 395 All 395 (JSON)