Aligned Radiometric RGB-Thermal Fusion for UAV Facade Anomaly Screening
Not on the map. Why?
Abstract (arXiv)
Unmanned aerial vehicle facade inspection can combine red, green, and blue (RGB) imagery with thermal measurements to screen surface and subsurface anomalies. However, geometric discrepancies between the sensors and thermal image rendering can obscure spatial correspondence and weak temperature contrasts. This article presents a sensor-level pipeline comprising per-sensor correction, RGB-to-thermal registration, common-support cropping, and signed local contrast encoding of 16-bit radiometric measurements. The encoding preserves the distinction between locally hotter and colder regions and supplies the fourth input channel of a compact single-stream detector. We introduce M3T, a dataset of 674 paired RGB and radiometric thermal samples from five facade-inspection projects covering eight component and anomaly categories. The median residual registration error is 3.384 pixels, and a controlled-displacement analysis characterizes how the local contrast response changes under controlled displacement. Project-grouped four-fold evaluation yields mean average precision of 0.168 over intersection-over-union thresholds from 0.5 to 0.95, using 28.50 billion floating-point operations per image. A separate single-split ablation shows improved delamination detection over RGB-only and alternative thermal inputs, although aggregate accuracy does not improve over RGB alone. Evaluation on RGBT-Tiny shows mixed performance with rendered thermal imagery. These results characterize the category-specific benefits and limitations of aligned radiometric contrast for compact facade screening.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 42 references that are in the map. First posted on arXiv 11 Sep 2026.
Builds on
18 of 42 references.
References · 18
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
- 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 229
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
- 2020Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learningcited by 150
- 2023Delivering Arbitrary-Modal Semantic Segmentationcited by 115
- 2023ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detectioncited by 76
- 2023C2Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detectioncited by 57
- 2024DAMSDet: Dynamic Adaptive Multispectral Detection Transformer with Competitive Query Selection and Adaptive Feature Fusioncited by 28
- 2024Visible-Thermal Tiny Object Detection: A Benchmark Dataset and Baselinescited by 27
- 2025UAVScenes: A Multi-Modal Dataset for UAVscited by 26
- 2024COMO: Cross-Mamba Interaction and Offset-Guided Fusion for Multimodal Object Detectioncited by 18
- 2025WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detectioncited by 14
6 more
- 2024Causal Mode Multiplexer: A Novel Framework for Unbiased Multispectral Pedestrian Detectioncited by 13
- 2024Rethinking Early-Fusion Strategies for Improved Multispectral Object Detectioncited by 9
- 2024Fieldscale: Locality-Aware Field-based Adaptive Rescaling for Thermal Infrared Imagecited by 8
- 2025Multispectral State-Space Feature Fusion: Bridging Shared and Cross-Parametric Interactions for Object Detectioncited by 6
- 2025Fusion Meets Diverse Conditions: A High-diversity Benchmark and Baseline for UAV-based Multimodal Object Detection with Condition Cuescited by 5
- 2024Thermal Chameleon: Task-Adaptive Tone-mapping for Radiometric Thermal-Infrared imagescited by 3
Built on by
Not cited yet.