Multi-Scale Context Aggregation by Dilated Convolutions
Not on the map. Why?
Abstract (arXiv)
State-of-the-art models for semantic segmentation are based on adaptations of convolutional networks that had originally been designed for image classification. However, dense prediction and image classification are structurally different. In this work, we develop a new convolutional network module that is specifically designed for dense prediction. The presented module uses dilated convolutions to systematically aggregate multi-scale contextual information without losing resolution. The architecture is based on the fact that dilated convolutions support exponential expansion of the receptive field without loss of resolution or coverage. We show that the presented context module increases the accuracy of state-of-the-art semantic segmentation systems. In addition, we examine the adaptation of image classification networks to dense prediction and show that simplifying the adapted network can increase accuracy.
Key facts. Cited by 1,133 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 2; 2019: 0; 2020: 0; 2021: 332; 2022: 255; 2023: 207; 2024: 152; 2025: 106; 2026: 79.
1,133 papers.
Sort:
By area:
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2024VMamba: Visual State Space Modelcited by 969
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2021Multi-Stage Progressive Image Restorationcited by 816
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
- 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 532
- 2021Semi-Supervised Semantic Segmentation with Cross Pseudo Supervisioncited by 463
38 more
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 339
- 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentationcited by 300
- 2021SegDiff: Image Segmentation with Diffusion Probabilistic Modelscited by 280
- 2022SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentationcited by 252
- 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 231
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 230
- 2021LocalViT: Analyzing Locality in Vision Transformerscited by 228
- 2021CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentationcited by 227
- 2021Contrastive Learning for Compact Single Image Dehazingcited by 219
- 2021ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Biascited by 216
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 216
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 212
- 2022Visual Attention Networkcited by 210
- 2021Adaptive Prototype Learning and Allocation for Few-Shot Segmentationcited by 207
- 2021UniT: Multimodal Multitask Learning with a Unified Transformercited by 195
- 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2021Dynamic Head: Unifying Object Detection Heads with Attentionscited by 187
- 2021Training Graph Neural Networks with 1000 Layerscited by 169
- 2021Conformer: Local Features Coupling Global Representations for Visual Recognitioncited by 164
- 2022HRDA: Context-Aware High-Resolution Domain-Adaptive Semantic Segmentationcited by 164
- 2022Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNscited by 155
- 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 151
- 2021HRFormer: High-Resolution Transformer for Dense Predictioncited by 149
- 2021PENet: Towards Precise and Efficient Image Guided Depth Completioncited by 146
- 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mambacited by 146
- 2022Understanding The Robustness in Vision Transformerscited by 144
- 2022Rethinking Semantic Segmentation: A Prototype Viewcited by 140
- 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
- 2024Mamba-UNet: UNet-Like Pure Visual Mamba for Medical Image Segmentationcited by 133
- 2023Scalable Transformer for PDE Surrogate Modelingcited by 128
- 2021CycleMLP: A MLP-like Architecture for Dense Predictioncited by 126
- 2022MatchFormer: Interleaving Attention in Transformers for Feature Matchingcited by 126
- 2022Decoupled Dynamic Spatial-Temporal Graph Neural Network for Traffic Forecastingcited by 123
- 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
- 2022Learning What Not to Segment: A New Perspective on Few-Shot Segmentationcited by 120
50 most cited of 1,133 All 1,133 (JSON)
- 2026Merit: Making every modality earn its contribution in multimodal attention decoding13 Oct 2026
- 2026Efficient Audio-Visual Speech Enhancement via Reinforcement Learning-Based Neural Architecture Search8 Oct 2026
- 20262D Spatial Reasoning with Adaptive Neural Cellular Automata6 Oct 2026
- 2026Learning from synthetic photorealistic raindrop for single image raindrop removal29 Sep 2026
- 2026TaskIR: Task-Driven Image Restoration via Degradation Adaptation and Task Feedback25 Sep 2026
- 2026BarkNet-Lite: A Lightweight Texture and Colour Network with the BarkBD Benchmark for Bark-Based Tree Species Recognition in Bangladesh7 Sep 2026
- 2026Multimodal Shared Latent Representation of Narration, Microscope and iOCT Images for Phase Recognition in Vitreoretinal Surgery31 Aug 2026
- 2026Behavioral Latency as Weak Event-Time Supervision for EEG Reaction-Time Decoding29 Aug 2026
- 2026Distributed Semantic Segmentation With Improved Rate-Distortion Trade-Off26 Aug 2026
- 2026Group-Shared Low-Rank Approximation for Mobile-Efficient Pointwise Convolutions in Large-Kernel CNNs26 Aug 2026
- 2026MV2GF: Multi-view Pedestrian Detection with a Visual Geometric Foundation Model21 Aug 2026
- 2026Multi-Scale Fruit Capsules: Dilated Convolutions and Dynamic Routing for In-the-Wild Explainable Fruit Recognition20 Aug 2026
38 more
- 2026Beyond receptive fields: sequence-pooled normalization can supply most of a sequence labeler's context19 Aug 2026
- 2026NanoSleep: A Parameter-Efficient Hybrid Temporal Convolutional Network for Single-Channel Sleep Stage Classification19 Aug 2026
- 2026RetiWave-Mamba: A Dual-Stream Network for Retinal Disease Detection based on Multi-scale Context and Frequency-Adaptive Mamba Projection18 Aug 2026
- 2026A Unified Backbone--Expert Framework with Relation-Token and Residual--Classifier Interfaces for Automatic Modulation Recognition15 Aug 2026
- 2026When GNNs Fail: Quantifying and Overcoming Temporal Correlation Volatility in Time Series7 Aug 2026
- 2026CFGPNet: Cross-Attention-Based Fused Gradient Programmed Network Framework for Multispectral Object Detection6 Aug 2026
- 2026Automated classification method of COVID-19 cases from chest CT volumes using 2D and 3D hybrid CNN for anisotropic volumes31 Jul 2026
- 2026Using Data-Derived Priors to Guide CNN Architecture Design for NIR Chemometrics28 Jul 2026
- 2026Impute On-Demand: Adaptive Correlated Time Series Imputation for Changing Environments26 Jul 2026
- 2026Cross-Modal Generative Framework for Signal Translation from Fetal-Maternal Electrocardiograms to Fetal Doppler Waveforms9 Jul 2026
- 2026Generative Diffusion Models of Stochastic Graph Signals7 Jul 2026
- 2026Rail Track Extraction from Rasterized Classified Point Clouds Using a Full-Resolution, Fully Convolutional Recurrent Neural Network7 Jul 2026
- 2026Sampling the Schwinger Model with Gauge-Equivariant Diffusion25 Jun 2026
- 2026Spatio-Temporal Retrieval-based Priors for Adaptive Computational Teaching in Driving23 Jun 2026
- 2026From Spatial to Spectral: An Efficient, Frequency-Guided Feature Representation Learner for Small Object Detection22 Jun 2026
- 2026INDEQS: Informed Neural controlled Differential EQuationS17 Jun 2026
- 2026From Coarse to Fine: Managing Temporal Granularity in Spatio-Temporal Data for Fine-Grained Traffic Prediction8 Jun 2026
- 2026DSFNet: Learning Dual-Domain Spectral Operators for Multi-Modality Spatio-Temporal Forecasting in Urban Transportation Systems5 Jun 2026
- 2026UtVAA: Ultra-tiny Vision Transformer with Affix Attention for Mobile Image Classification2 Jun 2026
- 2026ATV-Net: Adaptive Triple-View Network with Dynamic Feature Fusion25 May 2026
- 2026IV-Net: A neural network for elliptic PDEs with random and highly varying coefficients24 May 2026
- 2026SpineContextResUNet: A Computationally Efficient Residual UNet for Spine CT Segmentation20 May 2026
- 2026AMAR: Lightweight Attention-Based Multi-User Activity Recognition from Wi-Fi CSI20 May 2026
- 2026WD-FQDet: Multispectral Detection Transformer via Wavelet Decomposition and Frequency-aware Query Learning13 May 2026
- 2026Rethink the Role of Neural Decoders in Quantum Error Correction12 May 2026
- 2026YOTOnet: Zero-Shot Cross-Domain Fault Diagnosis via Domain-Conditioned Mixture of Experts6 May 2026
- 2026Convolutional Neural Networks in Vis-NIR Chemometrics: From Contradiction to Conditional Design4 May 2026
- 2026Machine Learning Enhanced Laser Spectroscopy for Multi-Species Gas Detection in Complex and Harsh Environments2 May 2026
- 2026Graph-based Semantic Calibration Network for Unaligned UAV RGBT Image Semantic Segmentation and A Large-scale Benchmark29 Apr 2026
- 2026Image Classification via Random Dilated Convolution with Multi-Branch Feature Extraction and Context Excitation28 Apr 2026
- 2026Selective Attention-Based Network for Robust Infrared Small Target Detection27 Apr 2026
- 2026GoClick: Lightweight Element Grounding Model for Autonomous GUI Interaction27 Apr 2026
- 2026Breaking the Resource Wall: Geometry-Guided Sequence Modeling for Efficient Semantic Segmentation25 Apr 2026
- 2026KAConvNet: Kolmogorov-Arnold Convolutional Networks for Vision Recognition25 Apr 2026
- 2026Cross-Stage Attention Propagation for Efficient Semantic Segmentation7 Apr 2026
- 2026Cross-subject Muscle Fatigue Detection via Adversarial and Supervised Contrastive Learning with Inception-Attention Network3 Apr 2026
- 2026Adaptive Learned Image Compression with Graph Neural Networks26 Mar 2026
- 2026Decentralized End-to-End Multi-AAV Pursuit Using Predictive Spatio-Temporal Observation via Deep Reinforcement Learning25 Mar 2026
50 newest of 1,133 All 1,133 (JSON)
- 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mambacited by 146
- 2024Mamba-UNet: UNet-Like Pure Visual Mamba for Medical Image Segmentationcited by 133
- 2024Spatial-Mamba: Effective Visual State Space Models via Structure-aware State Fusioncited by 41
- 2024VM-UNET-V2 Rethinking Vision Mamba UNet for Medical Image Segmentationcited by 39
- 2024Samba: Semantic Segmentation of Remotely Sensed Images with State Space Modelcited by 37
- 2024HC-Mamba: Vision MAMBA with Hybrid Convolutional Techniques for Medical Image Segmentationcited by 15
- 2024LoG-VMamba: Local-Global Vision Mamba for Medical Image Segmentationcited by 9
- 2024A Hybrid Transformer-Mamba Network for Single Image Derainingcited by 6
- 2025Vision Mamba in Remote Sensing: A Comprehensive Survey of Techniques, Applications and Outlookcited by 6
- 2026Breaking the Resource Wall: Geometry-Guided Sequence Modeling for Efficient Semantic Segmentationcited by 2
- 2025UINO-FSS: Unifying Representation Learning and Few-shot Segmentation via Hierarchical Distillation and Mamba-HyperCorrelationcited by 1
- 2025Numerical Investigation of Sequence Modeling Theory using Controllable Memory Functionscited by 1
12 most cited of 18 All 18 (JSON)
- 2026RetiWave-Mamba: A Dual-Stream Network for Retinal Disease Detection based on Multi-scale Context and Frequency-Adaptive Mamba Projection18 Aug 2026
- 2026Breaking the Resource Wall: Geometry-Guided Sequence Modeling for Efficient Semantic Segmentation25 Apr 2026
- 2026Multi-View Deformable Convolution Meets Visual Mamba for Coronary Artery Segmentation23 Mar 2026
- 2026MFil-Mamba: Multi-Filter Scanning for Spatial Redundancy-Aware Visual State Space Models20 Mar 2026
- 2025ClinicalFMamba: Advancing Clinical Assessment using Mamba-based Multimodal Neuroimaging Fusion5 Aug 2025
- 2025InceptionMamba: An Efficient Hybrid Network with Large Band Convolution and Bottleneck Mamba10 Jun 2025
- 2025Numerical Investigation of Sequence Modeling Theory using Controllable Memory Functions6 Jun 2025
- 2025SAMba-UNet: SAM2-Mamba UNet for Cardiac MRI in Medical Robotic Perception22 May 2025
- 2025Vision Mamba in Remote Sensing: A Comprehensive Survey of Techniques, Applications and Outlook1 May 2025
- 2025UINO-FSS: Unifying Representation Learning and Few-shot Segmentation via Hierarchical Distillation and Mamba-HyperCorrelation22 Apr 2025
- 2024Spatial-Mamba: Effective Visual State Space Models via Structure-aware State Fusion19 Oct 2024
- 2024A Hybrid Transformer-Mamba Network for Single Image Deraining31 Aug 2024
12 newest of 18 All 18 (JSON)
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2021SegDiff: Image Segmentation with Diffusion Probabilistic Modelscited by 280
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 216
- 2024MegaFusion: Extend Diffusion Models towards Higher-resolution Image Generation without Further Tuningcited by 25
- 2023BuilDiff: 3D Building Shape Generation using Single-Image Conditional Point Cloud Diffusion Modelscited by 6
- 2024Lane Graph Extraction from Aerial Imagery via Lane Segmentation Refinement with Diffusion Modelscited by 5
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Modelscited by 5
- 2025Diffusion Models in Recommendation Systems: A Surveycited by 3
- 2024Faster Diffusion Action Segmentationcited by 2
- 2025IS-Diff: Improving Diffusion-Based Inpainting with Better Initial Seedcited by 2
- 2026Generative Diffusion Models of Stochastic Graph Signalscited by 2
- 2024P-MSDiff: Parallel Multi-Scale Diffusion for Remote Sensing Image Segmentationcited by 0
12 most cited of 16 All 16 (JSON)
- 2026Generative Diffusion Models of Stochastic Graph Signals7 Jul 2026
- 2026AWDiff: An a trous wavelet diffusion model for lung ultrasound image synthesis3 Mar 2026
- 2025Traj-Transformer: Diffusion Models with Transformer for GPS Trajectory Generation7 Oct 2025
- 2025IS-Diff: Improving Diffusion-Based Inpainting with Better Initial Seed15 Sep 2025
- 2025SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Models26 Jul 2025
- 2025Leveraging Stable Diffusion for Monocular Depth Estimation via Image Semantic Encoding1 Feb 2025
- 2025Diffusion Models in Recommendation Systems: A Survey17 Jan 2025
- 2024TD-Paint: Faster Diffusion Inpainting Through Time Aware Pixel Conditioning11 Oct 2024
- 2024MegaFusion: Extend Diffusion Models towards Higher-resolution Image Generation without Further Tuning20 Aug 2024
- 2024Faster Diffusion Action Segmentation4 Aug 2024
- 2024P-MSDiff: Parallel Multi-Scale Diffusion for Remote Sensing Image Segmentation30 May 2024
- 2024Lane Graph Extraction from Aerial Imagery via Lane Segmentation Refinement with Diffusion Models1 May 2024
12 newest of 16 All 16 (JSON)
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2024CoReS: Orchestrating the Dance of Reasoning and Segmentationcited by 25
- 2024ConceptSearch: Towards Efficient Program Search Using LLMs for Abstraction and Reasoning Corpus (ARC)cited by 8
- 2025Think Before You Segment: High-Quality Reasoning Segmentation with GPT Chain of Thoughtscited by 7
- 2022Suspected Object Matters: Rethinking Model's Prediction for One-stage Visual Groundingcited by 4
- 2026CoT-Seg: Rethinking Segmentation with Chain-of-Thought Reasoning and Self-Correctioncited by 3
- 20262D Spatial Reasoning with Adaptive Neural Cellular Automatacited by 0
- 20262D Spatial Reasoning with Adaptive Neural Cellular Automata6 Oct 2026
- 2026CoT-Seg: Rethinking Segmentation with Chain-of-Thought Reasoning and Self-Correction24 Jan 2026
- 2025Think Before You Segment: High-Quality Reasoning Segmentation with GPT Chain of Thoughts10 Mar 2025
- 2024ConceptSearch: Towards Efficient Program Search Using LLMs for Abstraction and Reasoning Corpus (ARC)10 Dec 2024
- 2024CoReS: Orchestrating the Dance of Reasoning and Segmentation8 Apr 2024
- 2023LISA: Reasoning Segmentation via Large Language Model1 Aug 2023
- 2022Suspected Object Matters: Rethinking Model's Prediction for One-stage Visual Grounding10 Mar 2022
- 2021Efficient Medical Image Segmentation Based on Knowledge Distillationcited by 43
- 2023Semi-Supervised Semantic Segmentation via Gentle Teaching Assistantcited by 34
- 2022TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentationcited by 17
- 2022FAKD: Feature Augmented Knowledge Distillation for Semantic Segmentationcited by 14
- 2023Feature Adversarial Distillation for Point Cloud Classificationcited by 0
- 2026RTFDNet: Fusion-Decoupling for Robust RGB-T Segmentationcited by 0
- 2026RTFDNet: Fusion-Decoupling for Robust RGB-T Segmentation10 Mar 2026
- 2023Feature Adversarial Distillation for Point Cloud Classification25 Jun 2023
- 2023Semi-Supervised Semantic Segmentation via Gentle Teaching Assistant18 Jan 2023
- 2022FAKD: Feature Augmented Knowledge Distillation for Semantic Segmentation30 Aug 2022
- 2022TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentation27 Feb 2022
- 2021Efficient Medical Image Segmentation Based on Knowledge Distillation23 Aug 2021
- 2024DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMscited by 75
- 2023See, Say, and Segment: Teaching LMMs to Overcome False Premisescited by 41
- 2024Accelerating Pre-training of Multimodal LLMs via Chain-of-Sightcited by 4
- 2024MROVSeg: Breaking the Resolution Curse of Vision-Language Models in Open-Vocabulary Image Segmentationcited by 1
- 2024MROVSeg: Breaking the Resolution Curse of Vision-Language Models in Open-Vocabulary Image Segmentation27 Aug 2024
- 2024Accelerating Pre-training of Multimodal LLMs via Chain-of-Sight22 Jul 2024
- 2024DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMs6 Jun 2024
- 2023See, Say, and Segment: Teaching LMMs to Overcome False Premises13 Dec 2023
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2024VMamba: Visual State Space Modelcited by 969
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2021Multi-Stage Progressive Image Restorationcited by 816
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
- 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 532
- 2021Semi-Supervised Semantic Segmentation with Cross Pseudo Supervisioncited by 463
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 339
12 most cited of 1,072 All 1,072 (JSON)
- 2026Merit: Making every modality earn its contribution in multimodal attention decoding13 Oct 2026
- 2026Learning from synthetic photorealistic raindrop for single image raindrop removal29 Sep 2026
- 2026TaskIR: Task-Driven Image Restoration via Degradation Adaptation and Task Feedback25 Sep 2026
- 2026BarkNet-Lite: A Lightweight Texture and Colour Network with the BarkBD Benchmark for Bark-Based Tree Species Recognition in Bangladesh7 Sep 2026
- 2026Multimodal Shared Latent Representation of Narration, Microscope and iOCT Images for Phase Recognition in Vitreoretinal Surgery31 Aug 2026
- 2026Behavioral Latency as Weak Event-Time Supervision for EEG Reaction-Time Decoding29 Aug 2026
- 2026Distributed Semantic Segmentation With Improved Rate-Distortion Trade-Off26 Aug 2026
- 2026Group-Shared Low-Rank Approximation for Mobile-Efficient Pointwise Convolutions in Large-Kernel CNNs26 Aug 2026
- 2026MV2GF: Multi-view Pedestrian Detection with a Visual Geometric Foundation Model21 Aug 2026
- 2026Multi-Scale Fruit Capsules: Dilated Convolutions and Dynamic Routing for In-the-Wild Explainable Fruit Recognition20 Aug 2026
- 2026Beyond receptive fields: sequence-pooled normalization can supply most of a sequence labeler's context19 Aug 2026
- 2026NanoSleep: A Parameter-Efficient Hybrid Temporal Convolutional Network for Single-Channel Sleep Stage Classification19 Aug 2026
12 newest of 1,072 All 1,072 (JSON)