AnimateScene: Camera-controllable Animation in Any Scene
Not on the map. Why?
Abstract (arXiv)
Recent advances in 3D scene reconstruction and 4D human animation have broadened adoption, but integrating the two remains difficult. Key challenges include placing humans at plausible locations and scales without interpenetration, aligning lighting and style between humans and background, and handling dynamic camera trajectories. We introduce AnimateScene, a unified framework addressing these issues. First, an accurate placement module automatically determines realistic 3D positions and prevents collisions during motion. Second, we propose a training-free style alignment method that adapts the 4D human to match background illumination and appearance, achieving coherent composites. Finally, we design a joint post-reconstruction approach that incorporates camera trajectories for smooth, visually engaging motion videos. Experiments across diverse scenes and actions demonstrate that AnimateScene generates dynamic results with high geometric detail and strong spatiotemporal coherence. The project page is available at https://whynothaha.github.io/AnimateScene/AnimateScene.html.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 52 of its 77 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
52 of 77 references.
References · 52
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Visual Instruction Tuningcited by 7,869
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
38 more
- 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 223
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 182
- 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 180
- 2023WonderJourney: Going from Anywhere to Everywherecited by 158
- 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 140
- 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 139
- 2025Video World Models with Long-term Spatial Memorycited by 136
- 2024GameGen-X: Interactive Open-world Game Video Generationcited by 128
- 2021Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Controlcited by 106
- 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
- 2024Loong: Generating Minute-level Long Videos with Autoregressive Language Modelscited by 99
- 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 93
- 2018ST-GAN: Spatial Transformer Generative Adversarial Networks for Image Compositingcited by 90
- 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 77
- 2023Set-the-Scene: Global-Local Training for Generating Controllable NeRF Scenescited by 75
- 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priorscited by 74
- 2025LHM: Large Animatable Human Reconstruction Model from a Single Image in Secondscited by 61
- 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
- 2019Learning to Generate Synthetic Data via Compositingcited by 52
- 2024GenXD: Generating Any 3D and 4D Scenescited by 50
- 2023PERF: Panoramic Neural Radiance Field from a Single Panoramacited by 45
- 2024VistaDream: Sampling multiview consistent images for single-view scene reconstructioncited by 38
- 2024GS-CPR: Efficient Camera Pose Refinement via 3D Gaussian Splattingcited by 31
- 2024Imagine360: Immersive 360 Video Generation from Perspective Anchorcited by 29
- 2022Neural Novel Actor: Learning a Generalized Animatable Neural Representation for Human Actorscited by 28
- 2025VideoScene: Distilling Video Diffusion Model to Generate 3D Scenes in One Stepcited by 27
- 20243DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splattingcited by 25
- 20233D Cinemagraphy from a Single Imagecited by 24
- 2024Layout-your-3D: Controllable and Precise 3D Generation with 2D Blueprintcited by 21
- 2022Learning Object Placement via Dual-path Graph Completioncited by 20
- 2018On the Importance of Visual Context for Data Augmentation in Scene Understandingcited by 19
- 2023HyperDreamer: Hyper-Realistic 3D Content Generation and Editing from a Single Imagecited by 17
- 2023TopNet: Transformer-based Object Placement Network for Image Compositingcited by 16
- 20253R-GS: Best Practice in Optimizing Camera Poses Along with 3DGScited by 11
- 2024SplaTraj: Camera Trajectory Generation with Semantic Gaussian Splattingcited by 10
- 2025TokenMotion: Decoupled Motion Control via Token Disentanglement for Human-centric Video Generationcited by 9
- 2025See In Detail: Enhancing Sparse-view 3D Gaussian Splatting with Local Depth and Semantic Regularizationcited by 8
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scalingcited by 10
- 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasonerscited by 3
- 2026MoZoo:Unleashing Video Diffusion power in animal fur and muscle simulationcited by 1
- 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasoners14 May 2026
- 2026MoZoo:Unleashing Video Diffusion power in animal fur and muscle simulation8 Apr 2026
- 2025RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scaling23 Oct 2025