# Concurrent Spatial and Channel Squeeze & Excitation in Fully Convolutional Networks

arXiv: https://arxiv.org/abs/1803.02579 · HTML: https://mlsanity.com/paper/1803.02579/

## Key facts

- Cited by 122 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 7 Mar 2018.

## Built on by (most cited first, 30 of 122)

- [Dynamic Neural Networks: A Survey](https://mlsanity.com/paper/2102.04906/) (2021)
- [U-Net Transformer: Self and Cross Attention for Medical Image Segmentation](https://mlsanity.com/paper/2103.06104/) (2021)
- [Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review](https://mlsanity.com/paper/2304.10410/) (2023)
- [AAU-net: An Adaptive Attention U-net for Breast Lesions Segmentation in Ultrasound Images](https://mlsanity.com/paper/2204.12077/) (2022)
- [Latent Correlation Representation Learning for Brain Tumor Segmentation with Missing MRI Modalities](https://mlsanity.com/paper/2104.06231/) (2021)
- [High-fidelity GAN Inversion with Padding Space](https://mlsanity.com/paper/2203.11105/) (2022)
- [PitVQA: Image-grounded Text Embedding LLM for Visual Question Answering in Pituitary Surgery](https://mlsanity.com/paper/2405.13949/) (2024)
- [Medical Image Segmentation with Limited Supervision: A Review of Deep Network Models](https://mlsanity.com/paper/2103.00429/) (2021)
- [HS-FPN: High Frequency and Spatial Perception FPN for Tiny Object Detection](https://mlsanity.com/paper/2412.10116/) (2024)
- [Augmenting Deep Classifiers with Polynomial Neural Networks](https://mlsanity.com/paper/2104.07916/) (2021)
- [Focus U-Net: A novel dual attention-gated CNN for polyp segmentation during colonoscopy](https://mlsanity.com/paper/2105.07467/) (2021)
- [ST-MTL: Spatio-Temporal Multitask Learning Model to Predict Scanpath While Tracking Instruments in Robotic Surgery](https://mlsanity.com/paper/2112.08189/) (2021)
- [A Dynamic Residual Self-Attention Network for Lightweight Single Image Super-Resolution](https://mlsanity.com/paper/2112.04488/) (2021)
- [The Change You Want to See (Now in 3D)](https://mlsanity.com/paper/2308.10417/) (2023)
- [Stage-Aware Feature Alignment Network for Real-Time Semantic Segmentation of Street Scenes](https://mlsanity.com/paper/2203.04031/) (2022)
- [Feature-enhanced Generation and Multi-modality Fusion based Deep Neural Network for Brain Tumor Segmentation with Missing MR Modalities](https://mlsanity.com/paper/2111.04735/) (2021)
- [Rethinking the Unpretentious U-net for Medical Ultrasound Image Segmentation](https://mlsanity.com/paper/2209.07193/) (2022)
- [FatNet: A Feature-attentive Network for 3D Point Cloud Processing](https://mlsanity.com/paper/2104.03427/) (2021)
- [A Tri-attention Fusion Guided Multi-modal Segmentation Network](https://mlsanity.com/paper/2111.01623/) (2021)
- [Anatomy-Constrained Contrastive Learning for Synthetic Segmentation without Ground-truth](https://mlsanity.com/paper/2107.05482/) (2021)
- [Attention Mechanisms in Medical Image Segmentation: A Survey](https://mlsanity.com/paper/2305.17937/) (2023)
- [Anatomy-guided Multimodal Registration by Learning Segmentation without Ground Truth: Application to Intraprocedural CBCT/MR Liver Segmentation and Registration](https://mlsanity.com/paper/2104.07056/) (2021)
- [CpT: Convolutional Point Transformer for 3D Point Cloud Processing](https://mlsanity.com/paper/2111.10866/) (2021)
- [Video-based Formative and Summative Assessment of Surgical Tasks using Deep Learning](https://mlsanity.com/paper/2203.09589/) (2022)
- [DSNet: A Dual-Stream Framework for Weakly-Supervised Gigapixel Pathology Image Analysis](https://mlsanity.com/paper/2109.05788/) (2021)
- [Attentive Dual Stream Siamese U-net for Flood Detection on Multi-temporal Sentinel-1 Data](https://mlsanity.com/paper/2204.09387/) (2022)
- [A Spatial-channel-temporal-fused Attention for Spiking Neural Networks](https://mlsanity.com/paper/2209.10837/) (2022)
- [ESKNet-An enhanced adaptive selection kernel convolution for breast tumors segmentation](https://mlsanity.com/paper/2211.02915/) (2022)
- [LATUP-Net: A Lightweight 3D Attention U-Net with Parallel Convolutions for Brain Tumor Segmentation](https://mlsanity.com/paper/2404.05911/) (2024)
- [Patient-specific virtual spine straightening and vertebra inpainting: An automatic framework for osteoplasty planning](https://mlsanity.com/paper/2103.07279/) (2021)

## Abstract (arXiv)

Fully convolutional neural networks (F-CNNs) have set the state-of-the-art in image segmentation for a plethora of applications. Architectural innovations within F-CNNs have mainly focused on improving spatial encoding or network connectivity to aid gradient flow. In this paper, we explore an alternate direction of recalibrating the feature maps adaptively, to boost meaningful features, while suppressing weak ones. We draw inspiration from the recently proposed squeeze & excitation (SE) module for channel recalibration of feature maps for image classification. Towards this end, we introduce three variants of SE modules for image segmentation, (i) squeezing spatially and exciting channel-wise (cSE), (ii) squeezing channel-wise and exciting spatially (sSE) and (iii) concurrent spatial and channel squeeze & excitation (scSE). We effectively incorporate these SE modules within three different state-of-the-art F-CNNs (DenseNet, SD-Net, U-Net) and observe consistent improvement of performance across all architectures, while minimally effecting model complexity. Evaluations are performed on two challenging applications: whole brain segmentation on MRI scans (Multi-Atlas Labelling Challenge Dataset) and organ segmentation on whole body contrast enhanced CT scans (Visceral Dataset).