mlsanityData to 14 Oct 2026

What Happened 3 Seconds Ago? Inferring the Past with Thermal Imaging

arXiv 2304.13651 ↗First posted 26 Apr 2023cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Inferring past human motion from RGB images is challenging due to the inherent uncertainty of the prediction problem. Thermal images, on the other hand, encode traces of past human-object interactions left in the environment via thermal radiation measurement. Based on this observation, we collect the first RGB-Thermal dataset for human motion analysis, dubbed Thermal-IM. Then we develop a three-stage neural network model for accurate past human pose estimation. Comprehensive experiments show that thermal cues significantly reduce the ambiguities of this task, and the proposed model achieves remarkable performance. The dataset is available at https://github.com/ZitianTang/Thermal-IM.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 30 of its 48 references that are in the map. First posted on arXiv 26 Apr 2023.

Builds on

30 of 48 references.

References · 30

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
  4. 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
  5. 2017On human motion prediction using recurrent neural networkscited by 338
  6. 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 246
  7. 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
  8. 2020Long-term Human Motion Prediction with Scene Contextcited by 192
  9. 2019ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imagingcited by 147
  10. 2018RGB-T Object Tracking:Benchmark and Baselinecited by 121
  11. 2018Convolutional Sequence to Sequence Model for Human Dynamicscited by 115
  12. 2018Human Motion Prediction via Spatio-Temporal Inpaintingcited by 114
18 more
  1. 2020Exemplar Fine-Tuning for 3D Human Model Fitting Towards In-the-Wild 3D Human Pose Estimationcited by 113
  2. 2021LasHeR: A Large-scale High-diversity Benchmark for RGBT Trackingcited by 96
  3. 2022Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baselinecited by 91
  4. 2017The Pose Knows: Video Forecasting by Generating Pose Futurescited by 88
  5. 2019PST900: RGB-Thermal Calibration, Dataset and Segmentation Networkcited by 85
  6. 2019Putting Humans in a Scene: Learning Affordance in 3D Indoor Environmentscited by 72
  7. 2021Scene-aware Generative Network for Human Motion Synthesiscited by 70
  8. 2019Multi-Modal Fusion for End-to-End RGB-T Trackingcited by 63
  9. 2018Photo Wake-Up: 3D Character Animation from a Single Photocited by 60
  10. 2019Predicting 3D Human Dynamics from Videocited by 51
  11. 2020Jointly Modeling Motion and Appearance Cues for Robust RGB-T Trackingcited by 48
  12. 2022Spatio-Temporal Gating-Adjacency GCN for Human Motion Predictioncited by 48
  13. 2021FEANet: Feature-Enhanced Attention Network for RGB-Thermal Real-time Semantic Segmentationcited by 45
  14. 2021Edge-aware Guidance Fusion Network for RGB Thermal Scene Parsingcited by 45
  15. 2020HeatNet: Bridging the Day-Night Domain Gap in Semantic Segmentation with Thermal Imagescited by 41
  16. 2022Glass Segmentation with RGB-Thermal Image Pairscited by 26
  17. 2017Forecasting Human Dynamics from Static Imagescited by 17
  18. 2021Siamese Infrared and Visible Light Fusion Network for RGB-T Trackingcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 3.

8 papers.

  1. 2024CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusioncited by 17
  2. 2025Self-Supervised Spatial Correspondence Across Modalitiescited by 3
  3. 2025An LLM-Empowered Low-Resolution Vision System for On-Device Human Behavior Understandingcited by 1
  4. 2025See the past: Time-Reversed Scene Reconstruction from Thermal Traces Using Visual Language Modelscited by 1
  5. 20253M-TI: High-Quality Mobile Thermal Imaging via Calibration-free Multi-Camera Cross-Modal Diffusioncited by 1
  6. 2026Time-Reversed Imaging: A Multimodal Benchmark and Framework for Reconstructing Past Human-Environment Interactionscited by 0
  7. 2026BeyondFusion: Self-Aligned Latent Diffusion for Calibration-Free Infrared Super-Resolution and Infrared-Visible Fusioncited by 0
  8. 2026Towards Privacy-Preserving Thermal Human Perception from Dataset to Deploymentcited by 0