mlsanityData to 14 Oct 2026

Humans as Light Bulbs: 3D Human Reconstruction from Thermal Reflection

arXiv 2305.01652 ↗First posted 2 May 2023cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

The relatively hot temperature of the human body causes people to turn into long-wave infrared light sources. Since this emitted light has a larger wavelength than visible light, many surfaces in typical scenes act as infrared mirrors with strong specular reflections. We exploit the thermal reflections of a person onto objects in order to locate their position and reconstruct their pose, even if they are not visible to a normal camera. We propose an analysis-by-synthesis framework that jointly models the objects, people, and their thermal reflections, which allows us to combine generative models with differentiable rendering of reflections. Quantitative and qualitative experiments show our approach works in highly challenging cases, such as with curved mirrors or when the person is completely unseen by a normal camera.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 52 of its 84 references that are in the map. First posted on arXiv 2 May 2023.

Builds on

52 of 84 references.

References · 52

  1. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  2. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  3. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  4. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  6. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  7. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  8. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  9. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  10. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
  11. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
  12. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
38 more
  1. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
  2. 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
  3. 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
  4. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
  5. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  6. 2017Neural 3D Mesh Renderercited by 437
  7. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  8. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 418
  9. 2016RMPE: Regional Multi-person Pose Estimationcited by 340
  10. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
  11. 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
  12. 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 307
  13. 2020I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Imagecited by 274
  14. 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 258
  15. 2019HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimationcited by 247
  16. 2019Unsupervised Learning of Probably Symmetric Deformable 3D Objects from Images in the Wildcited by 180
  17. 2019SDFDiff: Differentiable Rendering of Signed Distance Fields for 3D Shape Optimizationcited by 159
  18. 2019ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imagingcited by 147
  19. 2016Generative and Discriminative Voxel Modeling with Convolutional Neural Networkscited by 128
  20. 2020Self-supervised Single-view 3D Reconstruction via Semantic Consistencycited by 127
  21. 2020Deformed Implicit Field: Modeling 3D Shapes with Learned Dense Correspondencecited by 119
  22. 2020BlazePose: On-device Real-time Body Pose trackingcited by 113
  23. 2020SoftFlow: Probabilistic Framework for Normalizing Flow on Manifoldscited by 98
  24. 2019Single-Stage Multi-Person Pose Machinescited by 95
  25. 2020Discrete Point Flow Networks for Efficient Point Cloud Generationcited by 87
  26. 2022Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fieldscited by 85
  27. 2020DualSDF: Semantic Shape Manipulation using a Two-Level Representationcited by 82
  28. 2019Autolabeling 3D Objects with Differentiable Rendering of SDF Shape Priorscited by 74
  29. 2022ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimizationcited by 72
  30. 2021Shelf-Supervised Mesh Prediction in the Wildcited by 65
  31. 20213D Shape Generation with Grid-based Implicit Functionscited by 48
  32. 2020Progressive Point Cloud Deconvolution Generation Networkcited by 46
  33. 2019Simple Pose: Rethinking and Improving a Bottom-up Approach for Multi-Person Pose Estimationcited by 27
  34. 2016Space-Time Representation of People Based on 3D Skeletal Data: A Reviewcited by 24
  35. 2018SAGNet:Structure-aware Generative Network for 3D-Shape Modelingcited by 20
  36. 2019Spectral-GANs for High-Resolution 3D Point-cloud Generationcited by 17
  37. 2022Semantic Segmentation for Thermal Images: A Comparative Surveycited by 16
  38. 2022Unsupervised RGB-to-Thermal Domain Adaptation via Multi-Domain Attention Networkcited by 13

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 6; 2025: 0; 2026: 1.

10 papers.

  1. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  2. 2024GES: Generalized Exponential Splatting for Efficient Radiance Field Renderingcited by 92
  3. 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
  4. 2023Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shapecited by 29
  5. 2024Differentiable Robot Renderingcited by 21
  6. 2024ThermalNeRF: Thermal Radiance Fieldscited by 13
  7. 2023Seeing the World through Your Eyescited by 5
  8. 2024Amodal Depth Anything: Amodal Depth Estimation in the Wildcited by 5
  9. 2024ThermoHands: A Benchmark for 3D Hand Pose Estimation from Egocentric Thermal Imagescited by 4
  10. 2026DarkVGGT: Seeing Through Darkness Using Thermal Geometrycited by 0