FEANet: Feature-Enhanced Attention Network for RGB-Thermal Real-time Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
The RGB-Thermal (RGB-T) information for semantic segmentation has been extensively explored in recent years. However, most existing RGB-T semantic segmentation usually compromises spatial resolution to achieve real-time inference speed, which leads to poor performance. To better extract detail spatial information, we propose a two-stage Feature-Enhanced Attention Network (FEANet) for the RGB-T semantic segmentation task. Specifically, we introduce a Feature-Enhanced Attention Module (FEAM) to excavate and enhance multi-level features from both the channel and spatial views. Benefited from the proposed FEAM module, our FEANet can preserve the spatial information and shift more attention to high-resolution features from the fused RGB-T images. Extensive experiments on the urban scene dataset demonstrate that our FEANet outperforms other state-of-the-art (SOTA) RGB-T methods in terms of objective metrics and subjective visual comparison (+2.6% in global mAcc and +0.8% in global mIoU). For the 480 x 640 RGB-T test images, our FEANet can run with a real-time speed on an NVIDIA GeForce RTX 2080 Ti card.
Key facts. Cited by 45 papers in the map (data through 13 Oct 2026). Builds on 15 of its 30 references that are in the map. First posted on arXiv 18 Oct 2021.
Builds on
15 of 30 references.
References · 15
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,991
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,849
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,435
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,216
- 2018CBAM: Convolutional Block Attention Modulecited by 2,469
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,287
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,484
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2016ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentationcited by 291
- 2019Probabilistic End-to-end Noise Correction for Learning with Noisy Labelscited by 210
3 more
- 2017A Review on Deep Learning Techniques Applied to Semantic Segmentationcited by 122
- 2019PST900: RGB-Thermal Calibration, Dataset and Segmentation Networkcited by 85
- 2018Depth-aware CNN for RGB-D Segmentationcited by 73
Built on by
Citing papers per year: 2022: 4; 2023: 12; 2024: 9; 2025: 12; 2026: 8.
45 papers.
Sort:
By area:
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 230
- 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 128
- 2023Delivering Arbitrary-Modal Semantic Segmentationcited by 116
- 2024Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentationcited by 71
- 2023Explicit Attention-Enhanced Fusion for RGB-Thermal Perception Taskscited by 41
- 2022RGB-T Semantic Segmentation with Location, Activation, and Sharpeningcited by 39
- 2024StitchFusion: Weaving Any Visual Modalities to Enhance Multimodal Semantic Segmentationcited by 38
- 2024Text-DiFuse: An Interactive Multi-Modal Image Fusion Framework based on Text-modulated Diffusion Modelcited by 31
- 2023Robust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptationcited by 28
- 2023Complementary Random Masking for RGB-Thermal Semantic Segmentationcited by 27
- 2024Context-Aware Interaction Network for RGB-T Semantic Segmentationcited by 21
- 2025Benchmarking Multi-modal Semantic Segmentation under Sensor Failures: Missing and Noisy Modality Robustnesscited by 18
33 more
- 2022DooDLeNet: Double DeepLab Enhanced Feature Fusion for Thermal-color Semantic Segmentationcited by 12
- 2023MMSFormer: Multimodal Transformer for Material and Semantic Segmentationcited by 12
- 2024U3M: Unbiased Multiscale Modal Fusion Model for Multimodal Semantic Segmentationcited by 12
- 2024HAPNet: Toward Superior RGB-Thermal Scene Parsing via Hybrid, Asymmetric, and Progressive Heterogeneous Feature Fusioncited by 10
- 2025Unveiling the Potential of Segment Anything Model 2 for RGB-Thermal Semantic Segmentation with Language Guidancecited by 9
- 2025MemorySAM: Memorize Modalities and Semantics with Segment Anything Model 2 for Multi-modal Semantic Segmentationcited by 9
- 2025M-SpecGene: Generalized Foundation Model for RGBT Multispectral Visioncited by 8
- 2023SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentationcited by 7
- 2023What Happened 3 Seconds Ago? Inferring the Past with Thermal Imagingcited by 7
- 2023Variational Probabilistic Fusion Network for RGB-T Semantic Segmentationcited by 7
- 2023ShareCMP: Polarization-Aware RGB-P Semantic Segmentationcited by 6
- 2024FLAME 3 Dataset: Unleashing the Power of Radiometric Thermal UAV Imagery for Wildfire Managementcited by 6
- 2025Multispectral State-Space Feature Fusion: Bridging Shared and Cross-Parametric Interactions for Object Detectioncited by 6
- 2023Test-Time Adaptation for Nighttime Color-Thermal Semantic Segmentationcited by 4
- 2025Learning Motion and Temporal Cues for Unsupervised Video Object Segmentationcited by 4
- 2024Invisible Gas Detection: An RGB-Thermal Cross Attention Network and A New Benchmarkcited by 3
- 2026Uncertainty-Aware Multimodal Anti-UAV Detection via Evidential Fusion and Conflict-Discounted Belief Aggregationcited by 3
- 2025CM-Diff: A Single Generative Network for Bidirectional Cross-Modality Translation Diffusion Model Between Infrared and Visible Imagescited by 2
- 2025Seeing Heat with Color -- RGB-Only Wildfire Temperature Inference from SAM-Guided Multimodal Distillation using Radiometric Ground Truthcited by 2
- 2025Spectral-Aware Global Fusion for RGB-Thermal Semantic Segmentationcited by 2
- 2022Assessing thermal imagery integration into object detection methods on ground-based and air-based collection platformscited by 1
- 2024CSFNet: A Cosine Similarity Fusion Network for Real-Time RGB-X Semantic Segmentation of Driving Scenescited by 1
- 2025MinkUNeXt-SI: Improving point cloud-based place recognition including spherical coordinates and LiDAR intensitycited by 1
- 2023Channel and Spatial Relation-Propagation Network for RGB-Thermal Semantic Segmentationcited by 0
- 2025BIMII-Net: Brain-Inspired Multi-Iterative Interactive Network for RGB-T Road Scene Semantic Segmentationcited by 0
- 2025SARTM: Segment Any RGB Thermal Model with Language aided Distillationcited by 0
- 2026No Calibration, No Depth, No Problem: Cross-Sensor View Synthesis with 3D Consistencycited by 0
- 2026Adversarial Patch Generation for Visual-Infrared Dense Prediction Tasks via Joint Position-Color Optimizationcited by 0
- 2026RTFDNet: Fusion-Decoupling for Robust RGB-T Segmentationcited by 0
- 2026Graph-based Semantic Calibration Network for Unaligned UAV RGBT Image Semantic Segmentation and A Large-scale Benchmarkcited by 0
- 2026Axial-Relation Guided Fusion State Space Model for Optical-Elevation Sensing Image Segmentationcited by 0
- 2026Frequency-Guided Fusion For RGB-Thermal Semantic Segmentationcited by 0
- 2026CRUISE: Vision-Language Model-Guided Uncertainty-Aware Cross-Modal Sensor Fusion for Robust Autonomous Drivingcited by 0
- 2026Uncertainty-Aware Multimodal Anti-UAV Detection via Evidential Fusion and Conflict-Discounted Belief Aggregation29 Aug 2026
- 2026CRUISE: Vision-Language Model-Guided Uncertainty-Aware Cross-Modal Sensor Fusion for Robust Autonomous Driving10 Aug 2026
- 2026Frequency-Guided Fusion For RGB-Thermal Semantic Segmentation25 May 2026
- 2026Axial-Relation Guided Fusion State Space Model for Optical-Elevation Sensing Image Segmentation16 May 2026
- 2026Graph-based Semantic Calibration Network for Unaligned UAV RGBT Image Semantic Segmentation and A Large-scale Benchmark29 Apr 2026
- 2026RTFDNet: Fusion-Decoupling for Robust RGB-T Segmentation10 Mar 2026
- 2026Adversarial Patch Generation for Visual-Infrared Dense Prediction Tasks via Joint Position-Color Optimization27 Feb 2026
- 2026No Calibration, No Depth, No Problem: Cross-Sensor View Synthesis with 3D Consistency27 Feb 2026
- 2025M-SpecGene: Generalized Foundation Model for RGBT Multispectral Vision22 Jul 2025
- 2025Multispectral State-Space Feature Fusion: Bridging Shared and Cross-Parametric Interactions for Object Detection19 Jul 2025
- 2025MinkUNeXt-SI: Improving point cloud-based place recognition including spherical coordinates and LiDAR intensity23 May 2025
- 2025Spectral-Aware Global Fusion for RGB-Thermal Semantic Segmentation21 May 2025
33 more
- 2025SARTM: Segment Any RGB Thermal Model with Language aided Distillation4 May 2025
- 2025Seeing Heat with Color -- RGB-Only Wildfire Temperature Inference from SAM-Guided Multimodal Distillation using Radiometric Ground Truth3 May 2025
- 2025BIMII-Net: Brain-Inspired Multi-Iterative Interactive Network for RGB-T Road Scene Semantic Segmentation25 Mar 2025
- 2025Benchmarking Multi-modal Semantic Segmentation under Sensor Failures: Missing and Noisy Modality Robustness24 Mar 2025
- 2025CM-Diff: A Single Generative Network for Bidirectional Cross-Modality Translation Diffusion Model Between Infrared and Visible Images12 Mar 2025
- 2025MemorySAM: Memorize Modalities and Semantics with Segment Anything Model 2 for Multi-modal Semantic Segmentation9 Mar 2025
- 2025Unveiling the Potential of Segment Anything Model 2 for RGB-Thermal Semantic Segmentation with Language Guidance4 Mar 2025
- 2025Learning Motion and Temporal Cues for Unsupervised Video Object Segmentation14 Jan 2025
- 2024FLAME 3 Dataset: Unleashing the Power of Radiometric Thermal UAV Imagery for Wildfire Management3 Dec 2024
- 2024Text-DiFuse: An Interactive Multi-Modal Image Fusion Framework based on Text-modulated Diffusion Model31 Oct 2024
- 2024StitchFusion: Weaving Any Visual Modalities to Enhance Multimodal Semantic Segmentation2 Aug 2024
- 2024CSFNet: A Cosine Similarity Fusion Network for Real-Time RGB-X Semantic Segmentation of Driving Scenes1 Jul 2024
- 2024U3M: Unbiased Multiscale Modal Fusion Model for Multimodal Semantic Segmentation24 May 2024
- 2024Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentation5 Apr 2024
- 2024HAPNet: Toward Superior RGB-Thermal Scene Parsing via Hybrid, Asymmetric, and Progressive Heterogeneous Feature Fusion4 Apr 2024
- 2024Invisible Gas Detection: An RGB-Thermal Cross Attention Network and A New Benchmark26 Mar 2024
- 2024Context-Aware Interaction Network for RGB-T Semantic Segmentation3 Jan 2024
- 2023ShareCMP: Polarization-Aware RGB-P Semantic Segmentation6 Dec 2023
- 2023Robust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptation6 Oct 2023
- 2023MMSFormer: Multimodal Transformer for Material and Semantic Segmentation7 Sep 2023
- 2023Channel and Spatial Relation-Propagation Network for RGB-Thermal Semantic Segmentation24 Aug 2023
- 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentation4 Aug 2023
- 2023Variational Probabilistic Fusion Network for RGB-T Semantic Segmentation17 Jul 2023
- 2023Test-Time Adaptation for Nighttime Color-Thermal Semantic Segmentation10 Jul 2023
- 2023What Happened 3 Seconds Ago? Inferring the Past with Thermal Imaging26 Apr 2023
- 2023Complementary Random Masking for RGB-Thermal Semantic Segmentation30 Mar 2023
- 2023Explicit Attention-Enhanced Fusion for RGB-Thermal Perception Tasks28 Mar 2023
- 2023SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentation15 Mar 2023
- 2023Delivering Arbitrary-Modal Semantic Segmentation2 Mar 2023
- 2022Assessing thermal imagery integration into object detection methods on ground-based and air-based collection platforms23 Dec 2022
- 2022RGB-T Semantic Segmentation with Location, Activation, and Sharpening26 Oct 2022
- 2022DooDLeNet: Double DeepLab Enhanced Feature Fusion for Thermal-color Semantic Segmentation21 Apr 2022
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers9 Mar 2022
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 230
- 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 128
- 2023Delivering Arbitrary-Modal Semantic Segmentationcited by 116
- 2023Explicit Attention-Enhanced Fusion for RGB-Thermal Perception Taskscited by 41
- 2022RGB-T Semantic Segmentation with Location, Activation, and Sharpeningcited by 39
- 2024StitchFusion: Weaving Any Visual Modalities to Enhance Multimodal Semantic Segmentationcited by 38
- 2023Robust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptationcited by 28
- 2024Context-Aware Interaction Network for RGB-T Semantic Segmentationcited by 21
- 2025Benchmarking Multi-modal Semantic Segmentation under Sensor Failures: Missing and Noisy Modality Robustnesscited by 18
- 2022DooDLeNet: Double DeepLab Enhanced Feature Fusion for Thermal-color Semantic Segmentationcited by 12
- 2023MMSFormer: Multimodal Transformer for Material and Semantic Segmentationcited by 12
- 2024U3M: Unbiased Multiscale Modal Fusion Model for Multimodal Semantic Segmentationcited by 12
12 most cited of 38 All 38 (JSON)
- 2026Uncertainty-Aware Multimodal Anti-UAV Detection via Evidential Fusion and Conflict-Discounted Belief Aggregation29 Aug 2026
- 2026Frequency-Guided Fusion For RGB-Thermal Semantic Segmentation25 May 2026
- 2026Graph-based Semantic Calibration Network for Unaligned UAV RGBT Image Semantic Segmentation and A Large-scale Benchmark29 Apr 2026
- 2026Adversarial Patch Generation for Visual-Infrared Dense Prediction Tasks via Joint Position-Color Optimization27 Feb 2026
- 2026No Calibration, No Depth, No Problem: Cross-Sensor View Synthesis with 3D Consistency27 Feb 2026
- 2025M-SpecGene: Generalized Foundation Model for RGBT Multispectral Vision22 Jul 2025
- 2025Multispectral State-Space Feature Fusion: Bridging Shared and Cross-Parametric Interactions for Object Detection19 Jul 2025
- 2025MinkUNeXt-SI: Improving point cloud-based place recognition including spherical coordinates and LiDAR intensity23 May 2025
- 2025Spectral-Aware Global Fusion for RGB-Thermal Semantic Segmentation21 May 2025
- 2025SARTM: Segment Any RGB Thermal Model with Language aided Distillation4 May 2025
- 2025Seeing Heat with Color -- RGB-Only Wildfire Temperature Inference from SAM-Guided Multimodal Distillation using Radiometric Ground Truth3 May 2025
- 2025BIMII-Net: Brain-Inspired Multi-Iterative Interactive Network for RGB-T Road Scene Semantic Segmentation25 Mar 2025
12 newest of 38 All 38 (JSON)