Data to 7 Oct 2026

PST900: RGB-Thermal Calibration, Dataset and Segmentation Network

arXiv 1909.10980 ↗First posted 20 Sep 2019cs.CV cs.RO eess.IVcited by 85

Not on the map. Why?

Abstract (arXiv)

In this work we propose long wave infrared (LWIR) imagery as a viable supporting modality for semantic segmentation using learning-based techniques. We first address the problem of RGB-thermal camera calibration by proposing a passive calibration target and procedure that is both portable and easy to use. Second, we present PST900, a dataset of 894 synchronized and calibrated RGB and Thermal image pairs with per pixel human annotations across four distinct classes from the DARPA Subterranean Challenge. Lastly, we propose a CNN architecture for fast semantic segmentation that combines both RGB and Thermal imagery in a way that leverages RGB imagery independently. We compare our method against the state-of-the-art and show that our method outperforms them in our dataset.

Key facts. Cited by 85 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 7; 2023: 19; 2024: 19; 2025: 19; 2026: 17.

85 papers.

Sort:

By area:

2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 215
2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 128
2023Delivering Arbitrary-Modal Semantic Segmentationcited by 115
2024Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentationcited by 71
2021FEANet: Feature-Enhanced Attention Network for RGB-Thermal Real-time Semantic Segmentationcited by 45
2021Edge-aware Guidance Fusion Network for RGB Thermal Scene Parsingcited by 44
2023Explicit Attention-Enhanced Fusion for RGB-Thermal Perception Taskscited by 41
2022RGB-T Semantic Segmentation with Location, Activation, and Sharpeningcited by 39
2024StitchFusion: Weaving Any Visual Modalities to Enhance Multimodal Semantic Segmentationcited by 38
2024Learning Modality-agnostic Representation for Semantic Segmentation from Any Modalitiescited by 29
2022Cross-Spectral Neural Radiance Fieldscited by 27

38 more

2023Complementary Random Masking for RGB-Thermal Semantic Segmentationcited by 27
2022Glass Segmentation with RGB-Thermal Image Pairscited by 26
2023Efficient Multimodal Semantic Segmentation via Dual-Prompt Learningcited by 25
2023What a MESS: Multi-Domain Evaluation of Zero-Shot Semantic Segmentationcited by 24
2024Context-Aware Interaction Network for RGB-T Semantic Segmentationcited by 21
2024Centering the Value of Every Modality: Towards Efficient and Resilient Modality-agnostic Semantic Segmentationcited by 21
2024Caltech Aerial RGB-Thermal Dataset in the Wildcited by 19
2021Self-Supervised Depth and Ego-Motion Estimation for Monocular Thermal Video Using Multi-Spectral Consistency Losscited by 16
2022Semantic Segmentation for Thermal Images: A Comparative Surveycited by 16
2024Thermal3D-GS: Physics-induced 3D Gaussians for Thermal Infrared Novel-view Synthesiscited by 16
2024Exploring Multi-modal Neural Scene Representations With Applications on Thermal Imagingcited by 15
2021From SLAM to Situational Awareness: Challenges and Surveycited by 14
2024Visible-Thermal Multiple Object Tracking: Large-scale Video Dataset and Progressive Fusion Approachcited by 13
2023RGB-D And Thermal Sensor Fusion: A Systematic Literature Reviewcited by 12
2023MMSFormer: Multimodal Transformer for Material and Semantic Segmentationcited by 12
2024U3M: Unbiased Multiscale Modal Fusion Model for Multimodal Semantic Segmentationcited by 12
2024MAGIC++: Efficient and Resilient Modality-Agnostic Semantic Segmentation via Hierarchical Modality Selectioncited by 12
2023Residual Spatial Fusion Network for RGB-Thermal Semantic Segmentationcited by 10
2024HAPNet: Toward Superior RGB-Thermal Scene Parsing via Hybrid, Asymmetric, and Progressive Heterogeneous Feature Fusioncited by 10
2025Unveiling the Potential of Segment Anything Model 2 for RGB-Thermal Semantic Segmentation with Language Guidancecited by 9
2025Reducing Unimodal Bias in Multi-Modal Semantic Segmentation with Multi-Scale Functional Entropy Regularizationcited by 9
2025M-SpecGene: Generalized Foundation Model for RGBT Multispectral Visioncited by 8
2023SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentationcited by 7
2023What Happened 3 Seconds Ago? Inferring the Past with Thermal Imagingcited by 7
2023Variational Probabilistic Fusion Network for RGB-T Semantic Segmentationcited by 7
2024FIReStereo: Forest InfraRed Stereo Dataset for UAS Depth Perception in Visually Degraded Environmentscited by 7
2023Stable Segment Anything Modelcited by 6
2025Multispectral State-Space Feature Fusion: Bridging Shared and Cross-Parametric Interactions for Object Detectioncited by 6
2024High-Quality Mask Tuning Matters for Open-Vocabulary Segmentationcited by 5
2025MonoTher-Depth: Enhancing Thermal Depth Estimation via Confidence-Aware Distillationcited by 5
2026Vision as Unified Multimodal Generationcited by 5
2023GAMUS: A Geometry-aware Multi-modal Semantic Segmentation Benchmark for Remote Sensing Datacited by 4
2023Test-Time Adaptation for Nighttime Color-Thermal Semantic Segmentationcited by 4
2024Unveiling the Depths: A Multi-Modal Fusion Framework for Challenging Scenarioscited by 4
2025Show or Tell? Effectively prompting Vision-Language Models for semantic segmentationcited by 4
2025OmniSegmentor: A Flexible Multi-Modal Learning Framework for Semantic Segmentationcited by 4
2026AnyThermal: Towards Learning Universal Representations for Thermal Perceptioncited by 4
2026Universal computational thermal imaging overcoming the ghosting effectcited by 4

50 most cited of 85 All 85 (JSON)