# Recalibrating Fully Convolutional Networks with Spatial and Channel 'Squeeze & Excitation' Blocks

arXiv: https://arxiv.org/abs/1808.08127 · HTML: https://mlsanity.com/paper/1808.08127/

## Key facts

- Cited by 76 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Aug 2018.

## Built on by (most cited first, 30 of 76)

- [Attention Mechanisms in Computer Vision: A Survey](https://mlsanity.com/paper/2111.07624/) (2021)
- [Learning Dynamic Graph Representation of Brain Connectome with Spatio-Temporal Attention](https://mlsanity.com/paper/2105.13495/) (2021)
- [Capturing Humans in Motion: Temporal-Attentive 3D Human Pose and Shape Estimation from Monocular Video](https://mlsanity.com/paper/2203.08534/) (2022)
- [EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question Answering](https://mlsanity.com/paper/2312.12222/) (2023)
- [MIS-FM: 3D Medical Image Segmentation using Foundation Models Pretrained on a Large-Scale Unannotated Dataset](https://mlsanity.com/paper/2306.16925/) (2023)
- [Global Guidance Network for Breast Lesion Segmentation in Ultrasound Images](https://mlsanity.com/paper/2104.01896/) (2021)
- [Cross-Modality Deep Feature Learning for Brain Tumor Segmentation](https://mlsanity.com/paper/2201.02356/) (2022)
- [Continual Barlow Twins: continual self-supervised learning for remote sensing semantic segmentation](https://mlsanity.com/paper/2205.11319/) (2022)
- [BDANet: Multiscale Convolutional Neural Network with Cross-directional Attention for Building Damage Assessment from Satellite Images](https://mlsanity.com/paper/2105.07364/) (2021)
- [Medical Image Segmentation with 3D Convolutional Neural Networks: A Survey](https://mlsanity.com/paper/2108.08467/) (2021)
- [A survey on attention mechanisms for medical applications: are we moving towards better algorithms?](https://mlsanity.com/paper/2204.12406/) (2022)
- [Semi-Supervised Segmentation of Radiation-Induced Pulmonary Fibrosis from Lung CT Scans with Multi-Scale Guided Dense Attention](https://mlsanity.com/paper/2109.14172/) (2021)
- [PyMIC: A deep learning toolkit for annotation-efficient medical image segmentation](https://mlsanity.com/paper/2208.09350/) (2022)
- [ProstAttention-Net: A deep attention model for prostate cancer segmentation by aggressiveness in MRI scans](https://mlsanity.com/paper/2211.13238/) (2022)
- [FUSegNet: A Deep Convolutional Neural Network for Foot Ulcer Segmentation](https://mlsanity.com/paper/2305.02961/) (2023)
- [Brain Networks and Intelligence: A Graph Neural Network Based Approach to Resting State fMRI Data](https://mlsanity.com/paper/2311.03520/) (2023)
- [Exploring the Synergies of Hybrid CNNs and ViTs Architectures for Computer Vision: A survey](https://mlsanity.com/paper/2402.02941/) (2024)
- [Image Quality-aware Diagnosis via Meta-knowledge Co-embedding](https://mlsanity.com/paper/2303.15038/) (2023)
- [GCA-Net : Utilizing Gated Context Attention for Improving Image Forgery Localization and Detection](https://mlsanity.com/paper/2112.04298/) (2021)
- [Domain Adaptation for Medical Image Segmentation using Transformation-Invariant Self-Training](https://mlsanity.com/paper/2307.16660/) (2023)
- [AWSnet: An Auto-weighted Supervision Attention Network for Myocardial Scar and Edema Segmentation in Multi-sequence Cardiac Magnetic Resonance Images](https://mlsanity.com/paper/2201.05344/) (2022)
- [ReCal-Net: Joint Region-Channel-Wise Calibrated Network for Semantic Segmentation in Cataract Surgery Videos](https://mlsanity.com/paper/2109.12448/) (2021)
- [Semi-supervised Pathological Image Segmentation via Cross Distillation of Multiple Attentions](https://mlsanity.com/paper/2305.18830/) (2023)
- [Cataract-1K: Cataract Surgery Dataset for Scene Segmentation, Phase Recognition, and Irregularity Detection](https://mlsanity.com/paper/2312.06295/) (2023)
- [DeepPyramid: Enabling Pyramid View and Deformable Pyramid Reception for Semantic Segmentation in Cataract Surgery Videos](https://mlsanity.com/paper/2207.01453/) (2022)
- [Stable deep neural network architectures for mitochondria segmentation on electron microscopy volumes](https://mlsanity.com/paper/2104.03577/) (2021)
- [Multi-Task Learning based Video Anomaly Detection with Attention](https://mlsanity.com/paper/2210.07697/) (2022)
- [Dual Attention U-Net with Feature Infusion: Pushing the Boundaries of Multiclass Defect Segmentation](https://mlsanity.com/paper/2312.14053/) (2023)
- [Remote Sensing Image Segmentation Using Vision Mamba and Multi-Scale Multi-Frequency Feature Fusion](https://mlsanity.com/paper/2410.05624/) (2024)
- [Synthesizing Multi-Tracer PET Images for Alzheimer's Disease Patients using a 3D Unified Anatomy-aware Cyclic Adversarial Network](https://mlsanity.com/paper/2107.05491/) (2021)

## Abstract (arXiv)

In a wide range of semantic segmentation tasks, fully convolutional neural networks (F-CNNs) have been successfully leveraged to achieve state-of-the-art performance. Architectural innovations of F-CNNs have mainly been on improving spatial encoding or network connectivity to aid gradient flow. In this article, we aim towards an alternate direction of recalibrating the learned feature maps adaptively; boosting meaningful features while suppressing weak ones. The recalibration is achieved by simple computational blocks that can be easily integrated in F-CNNs architectures. We draw our inspiration from the recently proposed 'squeeze & excitation' (SE) modules for channel recalibration for image classification. Towards this end, we introduce three variants of SE modules for segmentation, (i) squeezing spatially and exciting channel-wise, (ii) squeezing channel-wise and exciting spatially and (iii) joint spatial and channel 'squeeze & excitation'. We effectively incorporate the proposed SE blocks in three state-of-the-art F-CNNs and demonstrate a consistent improvement of segmentation accuracy on three challenging benchmark datasets. Importantly, SE blocks only lead to a minimal increase in model complexity of about 1.5%, while the Dice score increases by 4-9% in the case of U-Net. Hence, we believe that SE blocks can be an integral part of future F-CNN architectures.