mlsanityData to 7 Oct 2026

Maximizing Self-supervision from Thermal Image for Effective Self-supervised Learning of Depth and Ego-motion

arXiv 2201.04387 ↗First posted 12 Jan 2022cs.RO cs.CVcited by 14

Not on the map. Why?

Abstract (arXiv)

Recently, self-supervised learning of depth and ego-motion from thermal images shows strong robustness and reliability under challenging scenarios. However, the inherent thermal image properties such as weak contrast, blurry edges, and noise hinder to generate effective self-supervision from thermal images. Therefore, most research relies on additional self-supervision sources such as well-lit RGB images, generative models, and Lidar information. In this paper, we conduct an in-depth analysis of thermal image characteristics that degenerates self-supervision from thermal images. Based on the analysis, we propose an effective thermal image mapping method that significantly increases image information, such as overall structure, contrast, and details, while preserving temporal consistency. The proposed method shows outperformed depth and pose results than previous state-of-the-art networks without leveraging additional RGB guidance.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 19 of its 35 references that are in the map. First posted on arXiv 12 Jan 2022.

Builds on

19 of 35 references.

References · 19

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  4. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  5. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
  6. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
  7. 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
  8. 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
  9. 2019Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Videocited by 244
  10. 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
  11. 2020Robust Consistent Video Depth Estimationcited by 188
  12. 2018Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstructioncited by 159
7 more
  1. 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
  2. 2020Semantically-Guided Representation Learning for Self-Supervised Monocular Depthcited by 134
  3. 2019Self-supervised Learning with Geometric Constraints in Monocular Video: Connecting Flow, Depth, and Cameracited by 130
  4. 2017SfM-Net: Learning of Structure and Motion from Videocited by 89
  5. 2021Unsupervised Scale-consistent Depth Learning from Videocited by 69
  6. 2019Recurrent Neural Network for (Un-)supervised Learning of Monocular VideoVisual Odometry and Depthcited by 50
  7. 2021Self-Supervised Depth and Ego-Motion Estimation for Monocular Thermal Video Using Multi-Spectral Consistency Losscited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 4; 2025: 5; 2026: 4.

14 papers.

Sort: