mlsanityData to 7 Oct 2026

People as Scene Probes

arXiv 2007.09209 ↗First posted 17 Jul 2020cs.CVcited by 14

Not on the map. Why?

Abstract (arXiv)

By analyzing the motion of people and other objects in a scene, we demonstrate how to infer depth, occlusion, lighting, and shadow information from video taken from a single camera viewpoint. This information is then used to composite new objects into the same scene with a high degree of automation and realism. In particular, when a user places a new object (2D cut-out) in the image, it is automatically rescaled, relit, occluded properly, and casts realistic shadows in the correct direction relative to the sun, and which conform properly to scene geometry. We demonstrate results (best viewed in supplementary video) on a range of scenes and compare to alternative methods for depth estimation and shadow compositing.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Jul 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 7; 2022: 1; 2023: 4; 2024: 0; 2025: 1; 2026: 1.

14 papers.

Sort:

  1. 2021GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Drivingcited by 75
  2. 2023OBJECT 3DIT: Language-guided 3D-aware Image Editingcited by 62
  3. 2021Omnimatte: Associating Objects and Their Effects in Videocited by 50
  4. 2021Learning from Synthetic Shadows for Shadow Detection and Removalcited by 26
  5. 2022Controllable Shadow Generation Using Pixel Height Mapscited by 22
  6. 2023PixHt-Lab: Pixel Height Based Light Effect Generation for Image Compositingcited by 15
  7. 2023Lasagna: Layered Score Distillation for Disentangled Object Relightingcited by 7
  8. 2021Repopulating Street Scenescited by 6
  9. 2021Temporal Feature Warping for Video Shadow Detectioncited by 5
  10. 2021SAC-GAN: Structure-Aware Image Compositioncited by 5
  11. 2023Animating Street Viewcited by 3
  12. 2021SIRfyN: Single Image Relighting from your Neighborscited by 1
2 more
  1. 2025Cast and Attached Shadow Detection via Iterative Light and Geometry Reasoningcited by 0
  2. 2026WildHSR: Metric Feed-Forward 4D People-Scene Reconstruction from a 3D Foundation Modelcited by 0