Maximizing Self-supervision from Thermal Image for Effective Self-supervised Learning of Depth and Ego-motion
Not on the map. Why?
Abstract (arXiv)
Recently, self-supervised learning of depth and ego-motion from thermal images shows strong robustness and reliability under challenging scenarios. However, the inherent thermal image properties such as weak contrast, blurry edges, and noise hinder to generate effective self-supervision from thermal images. Therefore, most research relies on additional self-supervision sources such as well-lit RGB images, generative models, and Lidar information. In this paper, we conduct an in-depth analysis of thermal image characteristics that degenerates self-supervision from thermal images. Based on the analysis, we propose an effective thermal image mapping method that significantly increases image information, such as overall structure, contrast, and details, while preserving temporal consistency. The proposed method shows outperformed depth and pose results than previous state-of-the-art networks without leveraging additional RGB guidance.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 19 of its 35 references that are in the map. First posted on arXiv 12 Jan 2022.
Builds on
19 of 35 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
- 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
- 2019Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Videocited by 244
- 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
- 2020Robust Consistent Video Depth Estimationcited by 188
- 2018Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstructioncited by 159
7 more
- 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
- 2020Semantically-Guided Representation Learning for Self-Supervised Monocular Depthcited by 134
- 2019Self-supervised Learning with Geometric Constraints in Monocular Video: Connecting Flow, Depth, and Cameracited by 130
- 2017SfM-Net: Learning of Structure and Motion from Videocited by 89
- 2021Unsupervised Scale-consistent Depth Learning from Videocited by 69
- 2019Recurrent Neural Network for (Un-)supervised Learning of Monocular VideoVisual Odometry and Depthcited by 50
- 2021Self-Supervised Depth and Ego-Motion Estimation for Monocular Thermal Video Using Multi-Spectral Consistency Losscited by 16
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 5; 2026: 4.
14 papers.
Sort:
- 2023Complementary Random Masking for RGB-Thermal Semantic Segmentationcited by 27
- 2024Fieldscale: Locality-Aware Field-based Adaptive Rescaling for Thermal Infrared Imagecited by 8
- 2024RIDERS: Radar-Infrared Depth Estimation for Robust Sensingcited by 5
- 2025MonoTher-Depth: Enhancing Thermal Depth Estimation via Confidence-Aware Distillationcited by 5
- 2024Unveiling the Depths: A Multi-Modal Fusion Framework for Challenging Scenarioscited by 4
- 2025Deep Depth Estimation from Thermal Image: Dataset, Benchmark, and Challengescited by 4
- 2024Thermal Chameleon: Task-Adaptive Tone-mapping for Radiometric Thermal-Infrared imagescited by 3
- 2025Bridging Spectral-wise and Multi-spectral Depth Estimation via Geometry-guided Contrastive Learningcited by 3
- 2025SLAM in the Dark: Self-Supervised Learning of Pose, Depth and Loop-Closure from Thermal Imagescited by 1
- 2025RGB-Thermal Infrared Fusion for Robust Depth Estimation in Complex Environmentscited by 1
- 2026Thermal Image Refinement with Depth Estimation using Recurrent Networks for Monocular ORB-SLAM3cited by 0
- 2026Thermal is Always Wild: Characterizing and Addressing Challenges in Thermal-Only Novel View Synthesiscited by 0
- 2026TIDY: Thermal Infrared Image Denoising via Wavelet Domain Entropy and Directional Stripe Index18 Jun 2026
- 2026Supercharging Thermal Gaussian Splatting with Depth Estimation28 May 2026
- 2026Thermal is Always Wild: Characterizing and Addressing Challenges in Thermal-Only Novel View Synthesis20 Mar 2026
- 2026Thermal Image Refinement with Depth Estimation using Recurrent Networks for Monocular ORB-SLAM316 Mar 2026
- 2025MonoTher-Depth: Enhancing Thermal Depth Estimation via Confidence-Aware Distillation21 Apr 2025
- 2025Deep Depth Estimation from Thermal Image: Dataset, Benchmark, and Challenges28 Mar 2025
- 2025RGB-Thermal Infrared Fusion for Robust Depth Estimation in Complex Environments5 Mar 2025
- 2025Bridging Spectral-wise and Multi-spectral Depth Estimation via Geometry-guided Contrastive Learning2 Mar 2025
- 2025SLAM in the Dark: Self-Supervised Learning of Pose, Depth and Loop-Closure from Thermal Images26 Feb 2025
- 2024Thermal Chameleon: Task-Adaptive Tone-mapping for Radiometric Thermal-Infrared images24 Oct 2024
- 2024Fieldscale: Locality-Aware Field-based Adaptive Rescaling for Thermal Infrared Image24 May 2024
- 2024Unveiling the Depths: A Multi-Modal Fusion Framework for Challenging Scenarios19 Feb 2024
2 more
- 2023Complementary Random Masking for RGB-Thermal Semantic Segmentationcited by 27
- 2024Fieldscale: Locality-Aware Field-based Adaptive Rescaling for Thermal Infrared Imagecited by 8
- 2024RIDERS: Radar-Infrared Depth Estimation for Robust Sensingcited by 5
- 2025MonoTher-Depth: Enhancing Thermal Depth Estimation via Confidence-Aware Distillationcited by 5
- 2024Unveiling the Depths: A Multi-Modal Fusion Framework for Challenging Scenarioscited by 4
- 2025Deep Depth Estimation from Thermal Image: Dataset, Benchmark, and Challengescited by 4
- 2024Thermal Chameleon: Task-Adaptive Tone-mapping for Radiometric Thermal-Infrared imagescited by 3
- 2025Bridging Spectral-wise and Multi-spectral Depth Estimation via Geometry-guided Contrastive Learningcited by 3
- 2025SLAM in the Dark: Self-Supervised Learning of Pose, Depth and Loop-Closure from Thermal Imagescited by 1
- 2025RGB-Thermal Infrared Fusion for Robust Depth Estimation in Complex Environmentscited by 1
- 2026Thermal Image Refinement with Depth Estimation using Recurrent Networks for Monocular ORB-SLAM3cited by 0
- 2026Thermal is Always Wild: Characterizing and Addressing Challenges in Thermal-Only Novel View Synthesiscited by 0
12 most cited of 14 All 14 (JSON)
- 2026TIDY: Thermal Infrared Image Denoising via Wavelet Domain Entropy and Directional Stripe Index18 Jun 2026
- 2026Supercharging Thermal Gaussian Splatting with Depth Estimation28 May 2026
- 2026Thermal is Always Wild: Characterizing and Addressing Challenges in Thermal-Only Novel View Synthesis20 Mar 2026
- 2026Thermal Image Refinement with Depth Estimation using Recurrent Networks for Monocular ORB-SLAM316 Mar 2026
- 2025MonoTher-Depth: Enhancing Thermal Depth Estimation via Confidence-Aware Distillation21 Apr 2025
- 2025Deep Depth Estimation from Thermal Image: Dataset, Benchmark, and Challenges28 Mar 2025
- 2025RGB-Thermal Infrared Fusion for Robust Depth Estimation in Complex Environments5 Mar 2025
- 2025Bridging Spectral-wise and Multi-spectral Depth Estimation via Geometry-guided Contrastive Learning2 Mar 2025
- 2025SLAM in the Dark: Self-Supervised Learning of Pose, Depth and Loop-Closure from Thermal Images26 Feb 2025
- 2024Thermal Chameleon: Task-Adaptive Tone-mapping for Radiometric Thermal-Infrared images24 Oct 2024
- 2024Fieldscale: Locality-Aware Field-based Adaptive Rescaling for Thermal Infrared Image24 May 2024
- 2024Unveiling the Depths: A Multi-Modal Fusion Framework for Challenging Scenarios19 Feb 2024
12 newest of 14 All 14 (JSON)