mlsanityData to 7 Oct 2026

ReCamMaster: Camera-Controlled Generative Rendering from A Single Video

arXiv 2503.11647 ↗First posted 14 Mar 2025cs.CVcited by 278

Not on the map. Why?

Cited by 66 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Camera control has been actively studied in text or image conditioned video generation tasks. However, altering camera trajectories of a given video remains under-explored, despite its importance in the field of video creation. It is non-trivial due to the extra constraints of maintaining multiple-frame appearance and dynamic synchronization. To address this, we present ReCamMaster, a camera-controlled generative video re-rendering framework that reproduces the dynamic scene of an input video at novel camera trajectories. The core innovation lies in harnessing the generative capabilities of pre-trained text-to-video models through a simple yet powerful video conditioning mechanism--its capability is often overlooked in current research. To overcome the scarcity of qualified training data, we construct a comprehensive multi-camera synchronized video dataset using Unreal Engine 5, which is carefully curated to follow real-world filming characteristics, covering diverse scenes and camera movements. It helps the model generalize to in-the-wild videos. Lastly, we further improve the robustness to diverse inputs through a meticulously designed training strategy. Extensive experiments show that our method substantially outperforms existing state-of-the-art approaches. Our method also finds promising applications in video stabilization, super-resolution, and outpainting. Our code and dataset are publicly available at: https://github.com/KwaiVGI/ReCamMaster.

Key facts. Cited by 278 papers in the map (data through 7 Oct 2026). Builds on 60 of its 70 references that are in the map. First posted on arXiv 14 Mar 2025.

Builds on

60 of 70 references.

References · 60

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2022Scalable Diffusion Models with Transformerscited by 5,931
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  8. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  9. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  10. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  11. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
  12. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
38 more
  1. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  2. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
  3. 2023CoTracker: It is Better to Track Togethercited by 516
  4. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  5. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  6. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
  7. 2018Video-to-Video Synthesiscited by 388
  8. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
  9. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  10. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
  11. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
  12. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
  13. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
  14. 2024Global Structure-from-Motion Revisitedcited by 215
  15. 2019Few-shot Video-to-Video Synthesiscited by 196
  16. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
  17. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
  18. 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 172
  19. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
  20. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 163
  21. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
  22. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  23. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
  24. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
  25. 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 139
  26. 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 139
  27. 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 131
  28. 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
  29. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
  30. 2024Training-free Camera Control for Video Generationcited by 119
  31. 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
  32. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 116
  33. 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 115
  34. 2024Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesiscited by 105
  35. 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 104
  36. 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpointscited by 92
  37. 2024GIM: Learning Generalizable Image Matcher From Internet Videoscited by 72
  38. 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 97; 2026: 181.

278 papers.

Sort:

By area:

  1. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  2. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
  3. 2025Video World Models with Long-term Spatial Memorycited by 124
  4. 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 93
  5. 2025Controllable Video Generation: A Surveycited by 93
  6. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
  7. 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 84
  8. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 76
  9. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 72
  10. 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 71
  11. 20253D and 4D World Modeling: A Surveycited by 64
  12. 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 61
38 more
  1. 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 59
  2. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 53
  3. 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoningcited by 49
  4. 2025CamCloneMaster: Enabling Reference-based Camera Control for Video Generationcited by 44
  5. 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 39
  6. 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
  7. 2025Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Controlcited by 33
  8. 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 33
  9. 2025Spatia: Video Generation with Updatable Spatial Memorycited by 33
  10. 2025OmniNWM: Omniscient Driving Navigation World Modelscited by 32
  11. 2025Astra: General Interactive World Model with Autoregressive Denoisingcited by 30
  12. 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
  13. 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
  14. 2025ShotBench: Expert-Level Cinematic Understanding in Vision-Language Modelscited by 22
  15. 2025Generative Video Motion Editing with 3D Point Trackscited by 21
  16. 2025EPiC: Efficient Video Camera Control Learning with Precise Anchor-Video Guidancecited by 20
  17. 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Modelscited by 20
  18. 2025AnyTalker: Scaling Multi-Person Talking Video Generation with Interactivity Refinementcited by 19
  19. 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modelingcited by 18
  20. 2025FullDiT2: Efficient In-Context Conditioning for Video Diffusion Transformerscited by 17
  21. 2025ORV: 4D Occupancy-centric Robot Video Generationcited by 16
  22. 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
  23. 2025Memorize-and-Generate: Towards Long-Term Consistency in Real-Time Video Generationcited by 15
  24. 2026OmniRoam: World Wandering via Long-Horizon Panoramic Video Generationcited by 15
  25. 2026Vista4D: Video Reshooting with 4D Point Cloudscited by 15
  26. 2025Taming Video Models for 3D and 4D Generation via Zero-Shot Camera Controlcited by 14
  27. 2025Position: Interactive Generative Video as Next-Generation Game Enginecited by 13
  28. 2025True Self-Supervised Novel View Synthesis is Transferablecited by 13
  29. 20253D Scene Prompting for Scene-Consistent Camera-Controllable Video Generationcited by 13
  30. 2025Video-As-Prompt: Unified Semantic Control for Video Generationcited by 13
  31. 2025MotionV2V: Editing Motion in a Videocited by 13
  32. 2026Walk through Paintings: Egocentric World Models from Internet Priorscited by 13
  33. 2026MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic Manipulationcited by 13
  34. 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 13
  35. 2026Wonder: Video World Model Done Bettercited by 13
  36. 2025Dynamic View Synthesis as an Inverse Problemcited by 12
  37. 2025VFXMaster: Unlocking Dynamic Visual Effect Generation via In-Context Learningcited by 12
  38. 2025Exo2EgoSyn: Unlocking Foundation Video Generation Models for Exocentric-to-Egocentric Video Synthesiscited by 12

50 most cited of 278 All 278 (JSON)