ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
We introduce a fast and efficient convolutional neural network, ESPNet, for semantic segmentation of high resolution images under resource constraints. ESPNet is based on a new convolutional module, efficient spatial pyramid (ESP), which is efficient in terms of computation, memory, and power. ESPNet is 22 times faster (on a standard GPU) and 180 times smaller than the state-of-the-art semantic segmentation network PSPNet, while its category-wise accuracy is only 8% less. We evaluated ESPNet on a variety of semantic segmentation datasets including Cityscapes, PASCAL VOC, and a breast biopsy whole slide image dataset. Under the same constraints on memory and computation, ESPNet outperforms all the current efficient CNN networks such as MobileNet, ShuffleNet, and ENet on both standard metrics and our newly introduced performance metrics that measure efficiency on edge devices. Our network can process high resolution images at a rate of 112 and 9 frames per second on a standard GPU and edge device, respectively.
Key facts. Cited by 133 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 40; 2022: 27; 2023: 23; 2024: 23; 2025: 12; 2026: 8.
133 papers.
Sort:
By area:
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
- 2022SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentationcited by 252
- 2022Rethinking Semantic Segmentation: A Prototype Viewcited by 140
- 2022Cross-Image Relational Knowledge Distillation for Semantic Segmentationcited by 118
- 2021Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenescited by 89
- 2022GMMSeg: Gaussian Mixture based Generative Semantic Segmentation Modelscited by 87
- 2021FaPN: Feature-aligned Pyramid Network for Dense Image Predictioncited by 81
- 2022Representation Compensation Networks for Continual Semantic Segmentationcited by 72
- 2021EPMF: Efficient Perception-aware Multi-sensor Fusion for 3D Semantic Segmentationcited by 59
- 2021Capturing Omni-Range Context for Omnidirectional Segmentationcited by 50
- 2021Efficient Medical Image Segmentation Based on Knowledge Distillationcited by 43
- 2023CaraNet: Context Axial Reverse Attention Network for Segmentation of Small Medical Objectscited by 43
38 more
- 2023EdgeSAM: Prompt-In-the-Loop Distillation for SAMcited by 41
- 2023You Only Segment Once: Towards Real-Time Panoptic Segmentationcited by 40
- 2023SwinMM: Masked Multi-view with Swin Transformers for 3D Medical Image Segmentationcited by 35
- 2022PP-LiteSeg: A Superior Real-Time Semantic Segmentation Modelcited by 33
- 2021Semi-Supervised Video Deraining with Dynamical Rain Generatorcited by 31
- 2022Mining Unseen Classes via Regional Objectness: A Simple Baseline for Incremental Segmentationcited by 28
- 2021Dynamic Fusion Module Evolves Drivable Area and Road Anomaly Detection: A Benchmark and Algorithmscited by 23
- 2021Cross-Dataset Collaborative Learning for Semantic Segmentation in Autonomous Drivingcited by 23
- 2021Double Similarity Distillation for Semantic Image Segmentationcited by 19
- 2021Multi-Exit Semantic Segmentation Networkscited by 18
- 2024Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Modelcited by 18
- 2021Scale-invariant scale-channel networks: Deep networks that generalise to previously unseen scalescited by 17
- 2021FBSNet: A Fast Bilateral Symmetrical Network for Real-Time Semantic Segmentationcited by 17
- 2022TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentationcited by 17
- 2023Towards Diverse Binary Segmentation via A Simple yet General Gated Networkcited by 17
- 2022Distilling Inter-Class Distance for Semantic Segmentationcited by 16
- 2021Tackling Catastrophic Forgetting and Background Shift in Continual Semantic Segmentationcited by 15
- 2021Graph Attention Layer Evolves Semantic Segmentation for Road Pothole Detection: A Benchmark and Algorithmscited by 15
- 2022Stage-Aware Feature Alignment Network for Real-Time Semantic Segmentation of Street Scenescited by 15
- 2023BPKD: Boundary Privileged Knowledge Distillation For Semantic Segmentationcited by 15
- 2021CFPNet: Channel-wise Feature Pyramid for Real-Time Semantic Segmentationcited by 14
- 2021MSCFNet: A Lightweight Network With Multi-Scale Context Fusion for Real-Time Semantic Segmentationcited by 14
- 2022A Guide to Image and Video based Small Object Detection using Deep Learning : Case Study of Maritime Surveillancecited by 14
- 2022FAKD: Feature Augmented Knowledge Distillation for Semantic Segmentationcited by 14
- 2023Computation-efficient Deep Learning for Computer Vision: A Surveycited by 14
- 2023TwinLiteNet: An Efficient and Lightweight Model for Driveable Area and Lane Segmentation in Self-Driving Carscited by 13
- 2023Lightweight Real-time Semantic Segmentation Network with Efficient Transformer and CNNcited by 12
- 2024Clustering Propagation for Universal Medical Image Segmentationcited by 12
- 2021Rethinking Semantic Segmentation Evaluation for Explainability and Model Selectioncited by 11
- 2021GSVNet: Guided Spatially-Varying Convolution for Fast Semantic Segmentation on Videocited by 11
- 2021CFPNet-M: A Light-Weight Encoder-Decoder Based Network for Multimodal Biomedical Image Real-Time Segmentationcited by 11
- 2022SFNet: Faster and Accurate Semantic Segmentation via Semantic Flowcited by 10
- 2023Survey on video anomaly detection in dynamic scenes with moving camerascited by 10
- 2024Development of Skip Connection in Deep Neural Networks for Computer Vision and Medical Image Analysis: A Surveycited by 10
- 2022Efficient High-Resolution Deep Learning: A Surveycited by 9
- 2023Efficient Semantic Segmentation by Altering Resolutions for Compressed Videoscited by 8
- 2024GOV-NeSF: Generalizable Open-Vocabulary Neural Semantic Fieldscited by 8
- 2021Semantic Scene Segmentation for Robotics Applicationscited by 7
50 most cited of 133 All 133 (JSON)
- 2026GABI: Geometry-Aware Boundary Integration for Spacecraft Segmentation30 May 2026
- 2026LiteViLNet: Lightweight Vision-LiDAR Fusion Network for Efficient Road Segmentation20 May 2026
- 2026TwinMixing: A Shuffle-Aware Feature Interaction Model for Multi-Task Segmentation30 Mar 2026
- 2026Efficient RGB-D Scene Understanding via Multi-task Adaptive Learning and Cross-dimensional Feature Guidance8 Mar 2026
- 2026Onboard-Targeted Segmentation of Straylight in Space Camera Sensors24 Feb 2026
- 2026Efficient Deep Learning for Medical Imaging: Bridging the Gap Between High-Performance AI and Clinical Deployment31 Jan 2026
- 2026SkeFi: Cross-Modal Knowledge Transfer for Wireless Skeleton-Based Action Recognition18 Jan 2026
- 2026Cross-Layer Attentive Feature Upsampling for Low-latency Semantic Segmentation3 Jan 2026
- 2025AVOID: The Adverse Visual Conditions Dataset with Obstacles for Driving Scene Understanding29 Dec 2025
- 2025AdaptViG: Adaptive Vision GNN with Exponential Decay Gating13 Nov 2025
- 2025DeepDetect: Learning All-in-One Dense Keypoints20 Oct 2025
- 2025Removing Cost Volumes from Optical Flow Estimators15 Oct 2025
38 more
- 2025FSDENet: A Frequency and Spatial Domains based Detail Enhancement Network for Remote Sensing Semantic Segmentation29 Sep 2025
- 2025Advanced Brain Tumor Segmentation Using EMCAD: Efficient Multi-scale Convolutional Attention Decoding5 Sep 2025
- 2025TriLiteNet: Lightweight Model for Multi-Task Visual Perception4 Sep 2025
- 2025Hierarchical Graph Feature Enhancement with Adaptive Frequency Modulation for Visual Recognition15 Aug 2025
- 2025ECMNet:Lightweight Semantic Segmentation with Efficient CNN-Mamba Network10 Jun 2025
- 2025Enhancing Shape Perception and Segmentation Consistency for Industrial Image Inspection19 May 2025
- 2025Graph Attention Convolutional U-NET: A Semantic Segmentation Model for Identifying Flooded Areas21 Feb 2025
- 2025Improving Cross-Lingual Phonetic Representation of Low-Resource Languages Through Language Similarity Analysis12 Jan 2025
- 2024RapidNet: Multi-Level Dilated Convolution Based Mobile Backbone14 Dec 2024
- 2024Efficient Semantic Segmentation via Lightweight Multiple-Information Interaction Network3 Oct 2024
- 2024Axial Attention Transformer Networks: A New Frontier in Breast Cancer Detection18 Sep 2024
- 2024EraW-Net: Enhance-Refine-Align W-Net for Scene-Associated Driver Attention Estimation16 Aug 2024
- 2024Sparse Refinement for Efficient High-Resolution Semantic Segmentation26 Jul 2024
- 2024Augmented Efficiency: Reducing Memory Footprint and Accelerating Inference for 3D Semantic Segmentation through Hybrid Vision23 Jul 2024
- 2024HAFormer: Unleashing the Power of Hierarchy-Aware Features for Lightweight Semantic Segmentation10 Jul 2024
- 2024Relative Difficulty Distillation for Semantic Segmentation4 Jul 2024
- 2024Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Model27 Jun 2024
- 2024FA-Depth: Toward Fast and Accurate Self-supervised Monocular Depth Estimation17 May 2024
- 2024Development of Skip Connection in Deep Neural Networks for Computer Vision and Medical Image Analysis: A Survey2 May 2024
- 2024BACS: Background Aware Continual Semantic Segmentation19 Apr 2024
- 2024IrrNet: Advancing Irrigation Mapping with Incremental Patch Size Training on Remote Sensing Imagery17 Apr 2024
- 2024Convolution-based Probability Gradient Loss for Semantic Segmentation10 Apr 2024
- 2024Towards Efficient and Accurate CT Segmentation via Edge-Preserving Probabilistic Downsampling5 Apr 2024
- 2024Adaptive Affinity-Based Generalization For MRI Imaging Segmentation Across Resource-Limited Settings3 Apr 2024
- 2024GOV-NeSF: Generalizable Open-Vocabulary Neural Semantic Fields1 Apr 2024
- 2024I2CKD : Intra- and Inter-Class Knowledge Distillation for Semantic Segmentation27 Mar 2024
- 2024TwinLiteNet+: An Enhanced Multi-Task Segmentation Model for Autonomous Driving25 Mar 2024
- 2024Clustering Propagation for Universal Medical Image Segmentation25 Mar 2024
- 2024Towards Customized Knowledge Distillation for Chip-Level Dense Image Predictions24 Jan 2024
- 2024Edge-Enabled Real-time Railway Track Segmentation21 Jan 2024
- 2024RMP-SAM: Towards Real-Time Multi-Purpose Segment Anything18 Jan 2024
- 2023fMPI: Fast Novel View Synthesis in the Wild with Layered Scene Representations26 Dec 2023
- 2023EdgeSAM: Prompt-In-the-Loop Distillation for SAM11 Dec 2023
- 2023Bilateral Network with Residual U-blocks and Dual-Guided Attention for Real-time Semantic Segmentation31 Oct 2023
- 2023P2AT: Pyramid Pooling Axial Transformer for Real-time Semantic Segmentation23 Oct 2023
- 2023Computation-efficient Deep Learning for Computer Vision: A Survey27 Aug 2023
- 2023Enhancing Medical Image Segmentation: Optimizing Cross-Entropy Weights and Post-Processing with Autoencoders21 Aug 2023
- 2023Survey on video anomaly detection in dynamic scenes with moving cameras14 Aug 2023
50 newest of 133 All 133 (JSON)
- 2022Cross-Image Relational Knowledge Distillation for Semantic Segmentationcited by 118
- 2021Efficient Medical Image Segmentation Based on Knowledge Distillationcited by 43
- 2022TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentationcited by 17
- 2022Distilling Inter-Class Distance for Semantic Segmentationcited by 16
- 2023BPKD: Boundary Privileged Knowledge Distillation For Semantic Segmentationcited by 15
- 2022FAKD: Feature Augmented Knowledge Distillation for Semantic Segmentationcited by 14
- 2023AICSD: Adaptive Inter-Class Similarity Distillation for Semantic Segmentationcited by 2
- 2024Relative Difficulty Distillation for Semantic Segmentationcited by 2
- 2021Orderly Dual-Teacher Knowledge Distillation for Lightweight Human Pose Estimationcited by 1
- 2022Knowledge Distillation from Cross Teaching Teachers for Efficient Semi-Supervised Abdominal Organ Segmentation in CTcited by 0
- 2023Knowledge Distillation for Adaptive MRI Prostate Segmentation Based on Limit-Trained Multi-Teacher Modelscited by 0
- 2024Towards Customized Knowledge Distillation for Chip-Level Dense Image Predictionscited by 0
12 most cited of 13 All 13 (JSON)
- 2024Relative Difficulty Distillation for Semantic Segmentation4 Jul 2024
- 2024I2CKD : Intra- and Inter-Class Knowledge Distillation for Semantic Segmentation27 Mar 2024
- 2024Towards Customized Knowledge Distillation for Chip-Level Dense Image Predictions24 Jan 2024
- 2023AICSD: Adaptive Inter-Class Similarity Distillation for Semantic Segmentation8 Aug 2023
- 2023BPKD: Boundary Privileged Knowledge Distillation For Semantic Segmentation13 Jun 2023
- 2023Knowledge Distillation for Adaptive MRI Prostate Segmentation Based on Limit-Trained Multi-Teacher Models16 Mar 2023
- 2022Knowledge Distillation from Cross Teaching Teachers for Efficient Semi-Supervised Abdominal Organ Segmentation in CT11 Nov 2022
- 2022FAKD: Feature Augmented Knowledge Distillation for Semantic Segmentation30 Aug 2022
- 2022Distilling Inter-Class Distance for Semantic Segmentation7 May 2022
- 2022Cross-Image Relational Knowledge Distillation for Semantic Segmentation14 Apr 2022
- 2022TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentation27 Feb 2022
- 2021Efficient Medical Image Segmentation Based on Knowledge Distillation23 Aug 2021
12 newest of 13 All 13 (JSON)
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
- 2022SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentationcited by 252
- 2022Rethinking Semantic Segmentation: A Prototype Viewcited by 140
- 2021Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenescited by 89
- 2022GMMSeg: Gaussian Mixture based Generative Semantic Segmentation Modelscited by 87
- 2021FaPN: Feature-aligned Pyramid Network for Dense Image Predictioncited by 81
- 2022Representation Compensation Networks for Continual Semantic Segmentationcited by 72
- 2021EPMF: Efficient Perception-aware Multi-sensor Fusion for 3D Semantic Segmentationcited by 59
- 2021Capturing Omni-Range Context for Omnidirectional Segmentationcited by 50
- 2023CaraNet: Context Axial Reverse Attention Network for Segmentation of Small Medical Objectscited by 43
- 2023EdgeSAM: Prompt-In-the-Loop Distillation for SAMcited by 41
- 2023You Only Segment Once: Towards Real-Time Panoptic Segmentationcited by 40
12 most cited of 117 All 117 (JSON)
- 2026GABI: Geometry-Aware Boundary Integration for Spacecraft Segmentation30 May 2026
- 2026LiteViLNet: Lightweight Vision-LiDAR Fusion Network for Efficient Road Segmentation20 May 2026
- 2026TwinMixing: A Shuffle-Aware Feature Interaction Model for Multi-Task Segmentation30 Mar 2026
- 2026Efficient RGB-D Scene Understanding via Multi-task Adaptive Learning and Cross-dimensional Feature Guidance8 Mar 2026
- 2026Onboard-Targeted Segmentation of Straylight in Space Camera Sensors24 Feb 2026
- 2026Efficient Deep Learning for Medical Imaging: Bridging the Gap Between High-Performance AI and Clinical Deployment31 Jan 2026
- 2026SkeFi: Cross-Modal Knowledge Transfer for Wireless Skeleton-Based Action Recognition18 Jan 2026
- 2026Cross-Layer Attentive Feature Upsampling for Low-latency Semantic Segmentation3 Jan 2026
- 2025AVOID: The Adverse Visual Conditions Dataset with Obstacles for Driving Scene Understanding29 Dec 2025
- 2025AdaptViG: Adaptive Vision GNN with Exponential Decay Gating13 Nov 2025
- 2025DeepDetect: Learning All-in-One Dense Keypoints20 Oct 2025
- 2025Removing Cost Volumes from Optical Flow Estimators15 Oct 2025
12 newest of 117 All 117 (JSON)