mlsanityData to 14 Oct 2026

Animating Street View

arXiv 2310.08534 ↗First posted 12 Oct 2023cs.CV cs.GRcited by 3

Not on the map. Why?

Abstract (arXiv)

We present a system that automatically brings street view imagery to life by populating it with naturally behaving, animated pedestrians and vehicles. Our approach is to remove existing people and vehicles from the input image, insert moving objects with proper scale, angle, motion, and appearance, plan paths and traffic behavior, as well as render the scene with plausible occlusion and shadowing effects. The system achieves these by reconstructing the still image street scene, simulating crowd behavior, and rendering with consistent lighting, visibility, occlusions, and shadows. We demonstrate results on a diverse range of street scenes including regular still images and panoramas.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 42 of its 64 references that are in the map. First posted on arXiv 12 Oct 2023.

Builds on

42 of 64 references.

References · 42

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  4. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  5. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
  6. 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
  7. 2021Image Segmentation Using Text and Image Promptscited by 512
  8. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  9. 2018Unity: A General Platform for Intelligent Agentscited by 236
  10. 2019Few-shot Video-to-Video Synthesiscited by 197
  11. 2023Conditional Image-to-Video Generation with Latent Flow Diffusion Modelscited by 181
  12. 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
30 more
  1. 2021DriveGAN: Towards a Controllable High-Quality Neural Simulationcited by 125
  2. 2018ST-GAN: Spatial Transformer Generative Adversarial Networks for Image Compositingcited by 90
  3. 2022GIRAFFE HD: A High-Resolution 3D-aware Generative Modelcited by 86
  4. 2021GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Drivingcited by 75
  5. 2019Rendering Synthetic Objects into Legacy Photographscited by 72
  6. 2023Directed Diffusion: Direct Control of Object Placement through Attention Guidancecited by 69
  7. 2018Spatial Fusion GAN for Image Synthesiscited by 68
  8. 2019Deep Sky Modeling for Single Image Outdoor Lighting Estimationcited by 66
  9. 2021Playable Video Generationcited by 64
  10. 2022DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesiscited by 61
  11. 2018Photo Wake-Up: 3D Character Animation from a Single Photocited by 60
  12. 2020Animating Pictures with Eulerian Motion Fieldscited by 55
  13. 2020Pose-Guided Human Animation from a Single Image in the Wildcited by 53
  14. 2022Implicit Warping for Animation with Image Setscited by 45
  15. 2018Context-Aware Synthesis and Placement of Object Instancescited by 41
  16. 2022One-shot Implicit Animatable Avatars with Model-based Priorscited by 38
  17. 2019Automatic Scene Inference for 3D Object Compositingcited by 36
  18. 2022ObjectStitch: Generative Object Compositingcited by 36
  19. 2021Shadow Generation for Composite Image in Real-world Scenescited by 35
  20. 2022Neural Light Field Estimation for Street Scenes with Differentiable Virtual Object Insertioncited by 35
  21. 2020Vid2Player: Controllable Video Sprites that Behave and Appear like Professional Tennis Playerscited by 30
  22. 2022Playable Environments: Video Manipulation in Space and Timecited by 29
  23. 2020People as Scene Probescited by 14
  24. 2020Modular Action Concept Grounding in Semantic Video Predictioncited by 12
  25. 2019Inserting Videos into Videoscited by 7
  26. 2016Find your Way by Observing the Sun and Other Semantic Cuescited by 6
  27. 2021Repopulating Street Scenescited by 6
  28. 2022Controllable Video Generation through Global and Local Motion Dynamicscited by 6
  29. 2020Hidden Footprints: Learning Contextual Walkability from 3D Human Trailscited by 4
  30. 2022Physically Plausible Animation of Human Upper Body from a Single Imagecited by 2

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.

  1. 2025Relative Pose Estimation through Affine Corrections of Monocular Depth Priorscited by 18
  2. 2024Learning to Generate Diverse Pedestrian Movements from Web Videos with Noisy Labelscited by 4
  3. 2025Populate-A-Scene: Affordance-Aware Human Video Generationcited by 1