# Real-time Semantic Segmentation with Context Aggregation Network

arXiv: https://arxiv.org/abs/2011.00993 · HTML: https://mlsanity.com/paper/2011.00993/

## Key facts

- Cited by 14 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 2 Nov 2020.

## Built on by (most cited first, 14 of 14)

- [Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenes](https://mlsanity.com/paper/2101.06085/) (2021)
- [PIDNet: A Real-time Semantic Segmentation Network Inspired by PID Controllers](https://mlsanity.com/paper/2206.02066/) (2022)
- [Frequency-Adaptive Dilated Convolution for Semantic Segmentation](https://mlsanity.com/paper/2403.05369/) (2024)
- [Phase-aggregated Dual-branch Network for Efficient Fingerprint Dense Registration](https://mlsanity.com/paper/2404.17159/) (2024)
- [Exploiting Low-level Representations for Ultra-Fast Road Segmentation](https://mlsanity.com/paper/2402.02430/) (2024)
- [Memory-Constrained Semantic Segmentation for Ultra-High Resolution UAV Imagery](https://mlsanity.com/paper/2310.04721/) (2023)
- [ADAPT: An Open-Source sUAS Payload for Real-Time Disaster Prediction and Response with AI](https://mlsanity.com/paper/2201.10366/) (2022)
- [A Dual-Cycled Cross-View Transformer Network for Unified Road Layout Estimation and 3D Object Detection in the Bird's-Eye-View](https://mlsanity.com/paper/2209.08844/) (2022)
- [Feature Reuse and Fusion for Real-time Semantic segmentation](https://mlsanity.com/paper/2105.12964/) (2021)
- [Boundary Corrected Multi-scale Fusion Network for Real-time Semantic Segmentation](https://mlsanity.com/paper/2203.00436/) (2022)
- [Distortion-Aware Network Pruning and Feature Reuse for Real-time Video Segmentation](https://mlsanity.com/paper/2206.09604/) (2022)
- [Efficient Context Integration through Factorized Pyramidal Learning for Ultra-Lightweight Semantic Segmentation](https://mlsanity.com/paper/2302.11785/) (2023)
- [Autonomous Robotic Drilling System for Mice Cranial Window Creation](https://mlsanity.com/paper/2406.14135/) (2024)
- [ICFRNet: Image Complexity Prior Guided Feature Refinement for Real-time Semantic Segmentation](https://mlsanity.com/paper/2408.13771/) (2024)

## Abstract (arXiv)

With the increasing demand of autonomous systems, pixelwise semantic segmentation for visual scene understanding needs to be not only accurate but also efficient for potential real-time applications. In this paper, we propose Context Aggregation Network, a dual branch convolutional neural network, with significantly lower computational costs as compared to the state-of-the-art, while maintaining a competitive prediction accuracy. Building upon the existing dual branch architectures for high-speed semantic segmentation, we design a cheap high resolution branch for effective spatial detailing and a context branch with light-weight versions of global aggregation and local distribution blocks, potent to capture both long-range and local contextual dependencies required for accurate semantic segmentation, with low computational overheads. We evaluate our method on two semantic segmentation datasets, namely Cityscapes dataset and UAVid dataset. For Cityscapes test set, our model achieves state-of-the-art results with mIOU of 75.9%, at 76 FPS on an NVIDIA RTX 2080Ti and 8 FPS on a Jetson Xavier NX. With regards to UAVid dataset, our proposed network achieves mIOU score of 63.5% with high execution speed (15 FPS).