HarDNet: A Low Memory Traffic Network
Not on the map. Why?
Abstract (arXiv)
State-of-the-art neural network architectures such as ResNet, MobileNet, and DenseNet have achieved outstanding accuracy over low MACs and small model size counterparts. However, these metrics might not be accurate for predicting the inference time. We suggest that memory traffic for accessing intermediate feature maps can be a factor dominating the inference latency, especially in such tasks as real-time object detection and semantic segmentation of high-resolution video. We propose a Harmonic Densely Connected Network to achieve high efficiency in terms of both low MACs and memory traffic. The new network achieves 35%, 36%, 30%, 32%, and 45% inference time reduction compared with FC-DenseNet-103, DenseNet-264, ResNet-50, ResNet-152, and SSD-VGG, respectively. We use tools including Nvidia profiler and ARM Scale-Sim to measure the memory traffic and verify that the inference latency is indeed proportional to the memory traffic consumption and the proposed network consumes low memory traffic. We conclude that one should take memory traffic into consideration when designing neural network architectures for high-resolution applications at the edge.
Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 29; 2022: 23; 2023: 8; 2024: 6; 2025: 6; 2026: 4.
76 papers.
Sort:
By area:
- 2021SegDiff: Image Segmentation with Diffusion Probabilistic Modelscited by 279
- 2021Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformerscited by 159
- 2023Foundational Models Defining a New Era in Vision: A Survey and Outlookcited by 109
- 2021Standardized Max Logits: A Simple yet Effective Approach for Identifying Unexpected Road Obstacles in Urban-Scene Segmentationcited by 77
- 2021HarDNet-MSEG: A Simple Encoder-Decoder Polyp Segmentation Neural Network that Achieves over 0.9 Mean Dice and 86 FPScited by 71
- 2023AutoSAM: Adapting SAM to Medical Images by Overloading the Prompt Encodercited by 70
- 2021NeoUNet: Towards accurate colon polyp segmentation and neoplasm detectioncited by 50
- 2021Enhanced Boundary Learning for Glass-like Object Segmentationcited by 48
- 2022DenseHybrid: Hybrid Anomaly Detection for Dense Open-set Recognitioncited by 42
- 2021Lite-HDSeg: LiDAR Semantic Segmentation Using Lite Harmonic Dense Convolutionscited by 37
- 2021PaddleSeg: A High-Efficient Development Toolkit for Image Segmentationcited by 33
- 2022RTFormer: Efficient Design for Real-Time Semantic Segmentation with Transformercited by 31
38 more
- 2021Trans4Trans: Efficient Transformer for Transparent Object Segmentation to Help Visually Impaired People Navigate in the Real Worldcited by 30
- 2022Multi-Modal Masked Pre-Training for Monocular Panoramic Depth Completioncited by 23
- 2021Trans4Trans: Efficient Transformer for Transparent Object and Semantic Scene Segmentation in Real-World Navigation Assistancecited by 22
- 2021Focus U-Net: A novel dual attention-gated CNN for polyp segmentation during colonoscopycited by 20
- 2022CNN Filter DB: An Empirical Investigation of Trained Convolutional Filterscited by 20
- 2021Visual Representation Learning for Preference-Aware Path Planningcited by 17
- 2021Multi-domain semantic segmentation with overlapping labelscited by 14
- 2022Lightweight Monocular Depth Estimation through Guided Decodingcited by 14
- 2021Segmenting Transparent Object in the Wild with Transformercited by 13
- 2022A Comprehensive Study of Real-Time Object Detection Networks Across Multiple Domains: A Surveycited by 12
- 2021Rethinking Dilated Convolution for Real-time Semantic Segmentationcited by 11
- 2022What is Where by Looking: Weakly-Supervised Open-World Phrase-Grounding without Text Inputscited by 11
- 2022BlazeNeo: Blazing fast polyp segmentation and neoplasm detectioncited by 10
- 2022Recent Progress in Transformer-based Medical Image Analysiscited by 9
- 2021Panoptic Segmentation Forecastingcited by 7
- 2021Semantic Scene Segmentation for Robotics Applicationscited by 7
- 2022Semantic Segmentation for Autonomous Driving: Model Evaluation, Dataset Generation, Perspective Comparison, and Real-Time Capabilitycited by 7
- 2021Retrieval and Localization with Observation Constraintscited by 6
- 2021Task-Driven Deep Image Enhancement Network for Autonomous Driving in Bad Weathercited by 6
- 2022HiMODE: A Hybrid Monocular Omnidirectional Depth Estimation Modelcited by 6
- 2022HarDNet-DFUS: An Enhanced Harmonically-Connected Network for Diabetic Foot Ulcer Image Segmentation and Colonoscopy Polyp Segmentationcited by 6
- 2024YOLOv1 to YOLOv10: The fastest and most accurate real-time object detection systemscited by 6
- 2021Fast and Accurate Scene Parsing via Bi-direction Alignment Networkscited by 5
- 2022Learning Semantics-Aware Locomotion Skills from Human Demonstrationcited by 5
- 2024Colorectal Polyp Segmentation in the Deep Learning Era: A Comprehensive Surveycited by 5
- 2024Transformers-based architectures for stroke segmentation: A reviewcited by 5
- 2021Revisiting consistency for semi-supervised semantic segmentationcited by 4
- 2022ThreshNet: An Efficient DenseNet Using Threshold Mechanism to Reduce Connectionscited by 4
- 2024Active learning for efficient annotation in precision agriculture: a use-case on crop-weed semantic segmentationcited by 4
- 2022Efficient Convolutional Neural Networks on Raspberry Pi for Image Classificationcited by 3
- 2023Validating polyp and instrument segmentation methods in colonoscopy through Medico 2020 and MedAI 2021 Challengescited by 3
- 2025LGPS: A Lightweight GAN-Based Approach for Polyp Segmentation in Colonoscopy Imagescited by 3
- 2021AI Driven Road Maintenance Inspectioncited by 2
- 2021New Pruning Method Based on DenseNet Network for Image Classificationcited by 2
- 2021Zero-Shot Semantic Segmentation via Spatial and Multi-Scale Aware Visual Class Embeddingcited by 2
- 2022Synthetic data for unsupervised polyp segmentationcited by 2
- 2022LAPFormer: A Light and Accurate Polyp Segmentation Transformercited by 2
- 2023Cooperation Learning Enhanced Colonic Polyp Segmentation Based on Transformer-CNN Fusioncited by 2
50 most cited of 76 All 76 (JSON)
- 2026WoundFormer: Multi-Scale Spatial Feature Fusion for Multi-Class Wound Tissue Segmentation19 May 2026
- 2026Towards Symmetry-sensitive Pose Estimation: A Rotation Representation for Symmetric Object Classes20 Apr 2026
- 2026No Labels, No Look-Ahead: Unsupervised Online Video Stabilization with Classical Priors26 Feb 2026
- 2026BiSe-Unet: A Lightweight Dual-path U-Net with Attention-refined Context for Real-time Medical Image Segmentation22 Feb 2026
- 2025R2MF-Net: A Recurrent Residual Multi-Path Fusion Network for Robust Multi-directional Spine X-ray Segmentation8 Dec 2025
- 2025OCELOT 2023: Cell Detection from Cell-Tissue Interaction Challenge11 Sep 2025
- 2025The Power of Certainty: How Confident Models Lead to Better Segmentation14 Jul 2025
- 2025Colorectal Cancer Tumor Grade Segmentation in Digital Histopathology Images: From Giga to Mini Challenge7 Jul 2025
- 2025Prompt learning with bounding box constraints for medical image segmentation3 Jul 2025
- 2025LGPS: A Lightweight GAN-Based Approach for Polyp Segmentation in Colonoscopy Images24 Mar 2025
- 2024YOLOv1 to YOLOv10: The fastest and most accurate real-time object detection systems18 Aug 2024
- 2024FASTC: A Fast Attentional Framework for Semantic Traversability Classification Using Point Cloud24 Jun 2024
38 more
- 2024Active learning for efficient annotation in precision agriculture: a use-case on crop-weed semantic segmentation3 Apr 2024
- 2024Transformers-based architectures for stroke segmentation: A review27 Mar 2024
- 2024A Spatial-Temporal Progressive Fusion Network for Breast Lesion Segmentation in Ultrasound Videos18 Mar 2024
- 2024Colorectal Polyp Segmentation in the Deep Learning Era: A Comprehensive Survey22 Jan 2024
- 2023Validating polyp and instrument segmentation methods in colonoscopy through Medico 2020 and MedAI 2021 Challenges30 Jul 2023
- 2023Foundational Models Defining a New Era in Vision: A Survey and Outlook25 Jul 2023
- 2023Joint one-sided synthetic unpaired image translation and segmentation for colorectal cancer prevention20 Jul 2023
- 2023AutoSAM: Adapting SAM to Medical Images by Overloading the Prompt Encoder10 Jun 2023
- 2023DIAMANT: Dual Image-Attention Map Encoders For Medical Image Segmentation28 Apr 2023
- 2023TPE-Net: Track Point Extraction and Association Network for Rail Path Proposal Generation11 Feb 2023
- 2023SoftEnNet: Symbiotic Monocular Depth Estimation and Lumen Segmentation for Colonoscopy Endorobots19 Jan 2023
- 2023Cooperation Learning Enhanced Colonic Polyp Segmentation Based on Transformer-CNN Fusion17 Jan 2023
- 2022Efficient Semantic Segmentation on Edge Devices28 Dec 2022
- 2022RTFormer: Efficient Design for Real-Time Semantic Segmentation with Transformer13 Oct 2022
- 2022LAPFormer: A Light and Accurate Polyp Segmentation Transformer10 Oct 2022
- 2022Inference Latency Prediction at the Edge6 Oct 2022
- 2022Online pseudo labeling for polyp segmentation with momentum networks29 Sep 2022
- 2022HarDNet-DFUS: An Enhanced Harmonically-Connected Network for Diabetic Foot Ulcer Image Segmentation and Colonoscopy Polyp Segmentation15 Sep 2022
- 2022A Comprehensive Study of Real-Time Object Detection Networks Across Multiple Domains: A Survey23 Aug 2022
- 2022Recent Progress in Transformer-based Medical Image Analysis13 Aug 2022
- 2022Connection Reduction of DenseNet for Image Recognition2 Aug 2022
- 2022Semantic Segmentation for Autonomous Driving: Model Evaluation, Dataset Generation, Perspective Comparison, and Real-Time Capability26 Jul 2022
- 2022DenseHybrid: Hybrid Anomaly Detection for Dense Open-set Recognition6 Jul 2022
- 2022Learning Semantics-Aware Locomotion Skills from Human Demonstration27 Jun 2022
- 2022What is Where by Looking: Weakly-Supervised Open-World Phrase-Grounding without Text Inputs19 Jun 2022
- 2022HiMODE: A Hybrid Monocular Omnidirectional Depth Estimation Model11 Apr 2022
- 2022Efficient Convolutional Neural Networks on Raspberry Pi for Image Classification2 Apr 2022
- 2022CNN Filter DB: An Empirical Investigation of Trained Convolutional Filters29 Mar 2022
- 2022Multi-Modal Masked Pre-Training for Monocular Panoramic Depth Completion18 Mar 2022
- 2022Lightweight Monocular Depth Estimation through Guided Decoding8 Mar 2022
- 2022BlazeNeo: Blazing fast polyp segmentation and neoplasm detection28 Feb 2022
- 2022Efficient Video Segmentation Models with Per-frame Inference24 Feb 2022
- 2022Synthetic data for unsupervised polyp segmentation17 Feb 2022
- 2022Borrowing from yourself: Faster future video segmentation with partial channel update11 Feb 2022
- 2022ThreshNet: An Efficient DenseNet Using Threshold Mechanism to Reduce Connections9 Jan 2022
- 2021Realtime Global Attention Network for Semantic Segmentation24 Dec 2021
- 2021End-to-End Segmentation via Patch-wise Polygons Prediction5 Dec 2021
- 2021SegDiff: Image Segmentation with Diffusion Probabilistic Models1 Dec 2021
50 newest of 76 All 76 (JSON)
- 2021SegDiff: Image Segmentation with Diffusion Probabilistic Modelscited by 279
- 2021Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformerscited by 159
- 2023Foundational Models Defining a New Era in Vision: A Survey and Outlookcited by 109
- 2021Standardized Max Logits: A Simple yet Effective Approach for Identifying Unexpected Road Obstacles in Urban-Scene Segmentationcited by 77
- 2021HarDNet-MSEG: A Simple Encoder-Decoder Polyp Segmentation Neural Network that Achieves over 0.9 Mean Dice and 86 FPScited by 71
- 2023AutoSAM: Adapting SAM to Medical Images by Overloading the Prompt Encodercited by 70
- 2021NeoUNet: Towards accurate colon polyp segmentation and neoplasm detectioncited by 50
- 2021Enhanced Boundary Learning for Glass-like Object Segmentationcited by 48
- 2022DenseHybrid: Hybrid Anomaly Detection for Dense Open-set Recognitioncited by 42
- 2021Lite-HDSeg: LiDAR Semantic Segmentation Using Lite Harmonic Dense Convolutionscited by 37
- 2021PaddleSeg: A High-Efficient Development Toolkit for Image Segmentationcited by 33
- 2022RTFormer: Efficient Design for Real-Time Semantic Segmentation with Transformercited by 31
- 2021Trans4Trans: Efficient Transformer for Transparent Object Segmentation to Help Visually Impaired People Navigate in the Real Worldcited by 30
12 most cited of 75 All 75 (JSON)
- 2026WoundFormer: Multi-Scale Spatial Feature Fusion for Multi-Class Wound Tissue Segmentation19 May 2026
- 2026Towards Symmetry-sensitive Pose Estimation: A Rotation Representation for Symmetric Object Classes20 Apr 2026
- 2026No Labels, No Look-Ahead: Unsupervised Online Video Stabilization with Classical Priors26 Feb 2026
- 2026BiSe-Unet: A Lightweight Dual-path U-Net with Attention-refined Context for Real-time Medical Image Segmentation22 Feb 2026
- 2025R2MF-Net: A Recurrent Residual Multi-Path Fusion Network for Robust Multi-directional Spine X-ray Segmentation8 Dec 2025
- 2025OCELOT 2023: Cell Detection from Cell-Tissue Interaction Challenge11 Sep 2025
- 2025The Power of Certainty: How Confident Models Lead to Better Segmentation14 Jul 2025
- 2025Colorectal Cancer Tumor Grade Segmentation in Digital Histopathology Images: From Giga to Mini Challenge7 Jul 2025
- 2025Prompt learning with bounding box constraints for medical image segmentation3 Jul 2025
- 2025LGPS: A Lightweight GAN-Based Approach for Polyp Segmentation in Colonoscopy Images24 Mar 2025
- 2024YOLOv1 to YOLOv10: The fastest and most accurate real-time object detection systems18 Aug 2024
- 2024FASTC: A Fast Attentional Framework for Semantic Traversability Classification Using Point Cloud24 Jun 2024
12 newest of 75 All 75 (JSON)