# SCTransNet: Spatial-channel Cross Transformer Network for Infrared Small Target Detection

arXiv: https://arxiv.org/abs/2401.15583 · HTML: https://mlsanity.com/paper/2401.15583/

## Key facts

- Cited by 62 papers in the map (data through 14 Oct 2026).
- Builds on 25 of its 70 references that are in the map.
- First posted on arXiv 28 Jan 2024.

## Builds on (most cited first, 25 of 25)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification](https://mlsanity.com/paper/1502.01852/) (2015)
- [Restormer: Efficient Transformer for High-Resolution Image Restoration](https://mlsanity.com/paper/2111.09881/) (2021)
- [TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation](https://mlsanity.com/paper/2102.04306/) (2021)
- [UNet++: A Nested U-Net Architecture for Medical Image Segmentation](https://mlsanity.com/paper/1807.10165/) (2018)
- [MLP-Mixer: An all-MLP Architecture for Vision](https://mlsanity.com/paper/2105.01601/) (2021)
- [Instance Normalization: The Missing Ingredient for Fast Stylization](https://mlsanity.com/paper/1607.08022/) (2016)
- [CCNet: Criss-Cross Attention for Semantic Segmentation](https://mlsanity.com/paper/1811.11721/) (2018)
- [ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks](https://mlsanity.com/paper/1910.03151/) (2019)
- [MetaFormer Is Actually What You Need for Vision](https://mlsanity.com/paper/2111.11418/) (2021)
- [ResMLP: Feedforward networks for image classification with data-efficient training](https://mlsanity.com/paper/2105.03404/) (2021)
- [Learning A Sparse Transformer Network for Effective Image Deraining](https://mlsanity.com/paper/2303.11950/) (2023)
- [UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformer](https://mlsanity.com/paper/2109.04335/) (2021)
- [Asymmetric Contextual Modulation for Infrared Small Target Detection](https://mlsanity.com/paper/2009.14530/) (2020)
- [Dense Nested Attention Network for Infrared Small Target Detection](https://mlsanity.com/paper/2106.00487/) (2021)
- [UIU-Net: U-Net in U-Net for Infrared Small Object Detection](https://mlsanity.com/paper/2212.00968/) (2022)
- [Attentional Local Contrast Networks for Infrared Small Target Detection](https://mlsanity.com/paper/2012.08573/) (2020)
- [Mapping Degeneration Meets Label Evolution: Learning Infrared Small Target Detection with Single Point Supervision](https://mlsanity.com/paper/2304.01484/) (2023)
- [MTU-Net: Multi-level TransUNet for Space-based Infrared Tiny Ship Detection](https://mlsanity.com/paper/2209.13756/) (2022)
- [ABC: Attention with Bilinear Correlation for Infrared Small Target Detection](https://mlsanity.com/paper/2303.10321/) (2023)
- [Infrared Small-Dim Target Detection with Transformer under Complex Backgrounds](https://mlsanity.com/paper/2109.14379/) (2021)
- [A Multi-task Framework for Infrared Small Target Detection and Segmentation](https://mlsanity.com/paper/2206.06923/) (2022)

## Built on by (most cited first, 30 of 62)

- [Multi-Scale Direction-Aware Network for Infrared Small Target Detection](https://mlsanity.com/paper/2406.02037/) (2024)
- [DATransNet: Dynamic Attention Transformer Network for Infrared Small Target Detection](https://mlsanity.com/paper/2409.19599/) (2024)
- [Probing Deep into Temporal Profile Makes the Infrared Small Target Detector Much Better](https://mlsanity.com/paper/2506.12766/) (2025)
- [DRPCA-Net: Make Robust PCA Great Again for Infrared Small Target Detection](https://mlsanity.com/paper/2507.09541/) (2025)
- [Beyond Full Labels: Energy-Double-Guided Single-Point Prompt for Infrared Small Target Label Generation](https://mlsanity.com/paper/2408.08191/) (2024)
- [Seeing Through the Noise: Improving Infrared Small Target Detection and Segmentation from Noise Suppression Perspective](https://mlsanity.com/paper/2508.06878/) (2025)
- [Deep learning based infrared small object segmentation: Challenges and future directions](https://mlsanity.com/paper/2502.14168/) (2025)
- [Text-IRSTD: Leveraging Semantic Text to Promote Infrared Small Target Detection in Complex Scenes](https://mlsanity.com/paper/2503.07249/) (2025)
- [Rethinking Generalizable Infrared Small Target Detection: A Real-scene Benchmark and Cross-view Representation Learning](https://mlsanity.com/paper/2504.16487/) (2025)
- [SDS-Net: Shallow-Deep Synergism-detection Network for infrared small target detection](https://mlsanity.com/paper/2506.06042/) (2025)
- [Lightweight Deep Unfolding Networks with Enhanced Robustness for Infrared Small Target Detection](https://mlsanity.com/paper/2509.08205/) (2025)
- [Rethinking Evaluation of Infrared Small Target Detection](https://mlsanity.com/paper/2509.16888/) (2025)
- [Dynamic High-frequency Convolution for Infrared Small Target Detection](https://mlsanity.com/paper/2602.02969/) (2026)
- [Hybrid Mask Generation for Infrared Small Target Detection with Single-Point Supervision](https://mlsanity.com/paper/2409.04011/) (2024)
- [YOLO-MST: Multiscale deep learning method for infrared small target detection based on super-resolution and YOLO](https://mlsanity.com/paper/2412.19878/) (2024)
- [A Simple Detector with Frame Dynamics is a Strong Tracker](https://mlsanity.com/paper/2505.04917/) (2025)
- [MSCA-Net:Multi-Scale Context Aggregation Network for Infrared Small Target Detection](https://mlsanity.com/paper/2503.17193/) (2025)
- [CSPENet: Contour-Aware and Saliency Priors Embedding Network for Infrared Small Target Detection](https://mlsanity.com/paper/2505.09943/) (2025)
- [AuxDet: Auxiliary Metadata Matters for Omni-Domain Infrared Small Target Detection](https://mlsanity.com/paper/2505.15184/) (2025)
- [RRCANet: Recurrent Reusable-Convolution Attention Network for Infrared Small Target Detection](https://mlsanity.com/paper/2506.02393/) (2025)
- [It's Not the Target, It's the Background: Rethinking Infrared Small Target Detection via Deep Patch-Free Low-Rank Representations](https://mlsanity.com/paper/2506.10425/) (2025)
- [Revisiting the Scale Loss Function and Gaussian-Shape Convolution for Infrared Small Target Detection](https://mlsanity.com/paper/2604.09991/) (2026)
- [DestripeCycleGAN: Stripe Simulation CycleGAN for Unsupervised Infrared Image Destriping](https://mlsanity.com/paper/2402.09101/) (2024)
- [The First Competition on Resource-Limited Infrared Small Target Detection Challenge: Methods and Results](https://mlsanity.com/paper/2408.09615/) (2024)
- [Target Driven Adaptive Loss For Infrared Small Target Detection](https://mlsanity.com/paper/2506.01349/) (2025)
- [Weakly-supervised Contrastive Learning with Quantity Prompts for Moving Infrared Small Target Detection](https://mlsanity.com/paper/2507.02454/) (2025)
- [Exploiting Gaussian Agnostic Representation Learning with Diffusion Priors for Enhanced Infrared Small Target Detection](https://mlsanity.com/paper/2507.18260/) (2025)
- [Beyond Motion Cues and Structural Sparsity: Revisiting Small Moving Target Detection](https://mlsanity.com/paper/2509.07654/) (2025)
- [Ivan-ISTD: Rethinking Cross-domain Heteroscedastic Noise Perturbations in Infrared Small Target Detection](https://mlsanity.com/paper/2510.12241/) (2025)
- [Point-to-Mask: From Arbitrary Point Annotations to Mask-Level Infrared Small Target Detection](https://mlsanity.com/paper/2603.16257/) (2026)

## Abstract (arXiv)

Infrared small target detection (IRSTD) has recently benefitted greatly from U-shaped neural models. However, largely overlooking effective global information modeling, existing techniques struggle when the target has high similarities with the background. We present a Spatial-channel Cross Transformer Network (SCTransNet) that leverages spatial-channel cross transformer blocks (SCTBs) on top of long-range skip connections to address the aforementioned challenge. In the proposed SCTBs, the outputs of all encoders are interacted with cross transformer to generate mixed features, which are redistributed to all decoders to effectively reinforce semantic differences between the target and clutter at full scales. Specifically, SCTB contains the following two key elements: (a) spatial-embedded single-head channel-cross attention (SSCA) for exchanging local spatial features and full-level global channel information to eliminate ambiguity among the encoders and facilitate high-level semantic associations of the images, and (b) a complementary feed-forward network (CFN) for enhancing the feature discriminability via a multi-scale strategy and cross-spatial-channel information interaction to promote beneficial information transfer. Our SCTransNet effectively encodes the semantic differences between targets and backgrounds to boost its internal representation for detecting small infrared targets accurately. Extensive experiments on three public datasets, NUDT-SIRST, NUAA-SIRST, and IRSTD-1k, demonstrate that the proposed SCTransNet outperforms existing IRSTD methods. Our code will be made public at https://github.com/xdFai.