mlsanityData to 7 Oct 2026

SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpoints

arXiv 2412.07760 ↗First posted 10 Dec 2024cs.CVcited by 92

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Recent advancements in video diffusion models have shown exceptional abilities in simulating real-world dynamics and maintaining 3D consistency. This progress inspires us to investigate the potential of these models to ensure dynamic consistency across various viewpoints, a highly desirable feature for applications such as virtual filming. Unlike existing methods focused on multi-view generation of single objects for 4D reconstruction, our interest lies in generating open-world videos from arbitrary viewpoints, incorporating 6 DoF camera poses. To achieve this, we propose a plug-and-play module that enhances a pre-trained text-to-video model for multi-camera video generation, ensuring consistent content across different viewpoints. Specifically, we introduce a multi-view synchronization module to maintain appearance and geometry consistency across these viewpoints. Given the scarcity of high-quality training data, we design a hybrid training scheme that leverages multi-camera images and monocular videos to supplement Unreal Engine-rendered multi-camera videos. Furthermore, our method enables intriguing extensions, such as re-rendering a video from novel viewpoints. We also release a multi-view synchronized video dataset, named SynCamVideo-Dataset. Project page: https://jianhongbai.github.io/SynCamMaster/.

Key facts. Cited by 92 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 35 of its 66 references that are in the map. First posted on arXiv 10 Dec 2024.

Builds on

35 of 66 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistency24 Jul
  2. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generation31 May
  3. 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Models26 May
  4. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
  5. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
  6. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug

Other references · 29

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  7. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  8. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  9. 2023ModelScope Text-to-Video Technical Reportcited by 651
  10. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
  11. 2023CoTracker: It is Better to Track Togethercited by 516
  12. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
17 more
  1. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
  2. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
  3. 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 300
  4. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
  5. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 254
  6. 2017GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibriumcited by 208
  7. 2018Stereo Magnification: Learning View Synthesis using Multiplane Imagescited by 206
  8. 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 178
  9. 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 172
  10. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 163
  11. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  12. 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
  13. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 116
  14. 2024GIM: Learning Generalizable Image Matcher From Internet Videoscited by 72
  15. 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
  16. 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Modelcited by 40
  17. 2023StyleCrafter: Enhancing Stylized Text-to-Video Generation with Style Adaptercited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 47; 2026: 45.

92 papers.

Sort:

By area:

  1. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  2. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  3. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
  4. 2025Video World Models with Long-term Spatial Memorycited by 124
  5. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
  6. 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 97
  7. 2025SV4D 2.0: Enhancing Spatio-Temporal Consistency in Multi-View Video Diffusion for High-Quality 4D Generationcited by 44
  8. 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 39
  9. 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
  10. 2025Reangle-A-Video: 4D Video Generation as Video-to-Video Translationcited by 35
  11. 2025Free4D: Tuning-free 4D Scene Generation with Spatial-Temporal Consistencycited by 34
  12. 2025Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Controlcited by 33
38 more
  1. 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 33
  2. 20254DNeX: Feed-Forward 4D Generative Modeling Made Easycited by 31
  3. 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
  4. 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
  5. 2025Generative Video Motion Editing with 3D Point Trackscited by 21
  6. 2025EPiC: Efficient Video Camera Control Learning with Precise Anchor-Video Guidancecited by 20
  7. 2025ShapeGen4D: Towards High Quality 4D Shape Generation from Videoscited by 20
  8. 2025ORV: 4D Occupancy-centric Robot Video Generationcited by 16
  9. 2025Synthetic Video Enhances Physical Fidelity in Video Synthesiscited by 15
  10. 2025Cut2Next: Generating Next Shot via In-Context Tuningcited by 15
  11. 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
  12. 2025Taming Video Models for 3D and 4D Generation via Zero-Shot Camera Controlcited by 14
  13. 2025Video-As-Prompt: Unified Semantic Control for Video Generationcited by 13
  14. 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 13
  15. 2025VFXMaster: Unlocking Dynamic Visual Effect Generation via In-Context Learningcited by 12
  16. 2025BulletTime: Decoupled Control of Time and Camera Pose for Video Generationcited by 12
  17. 2025Vivid4D: Improving 4D Reconstruction from Monocular Video by Video Inpaintingcited by 11
  18. 2025See4D: Pose-Free 4D Generation via Auto-Regressive Video Inpaintingcited by 11
  19. 2026Bernini: Latent Semantic Planning for Video Diffusioncited by 11
  20. 2025Can Video Diffusion Model Reconstruct 4D Geometry?cited by 10
  21. 2026LaVR: Scene Latent Conditioned Generative Video Trajectory Re-Rendering using Large 4D Reconstruction Modelscited by 10
  22. 2025SpaceTimePilot: Generative Rendering of Dynamic Scenes Across Space and Timecited by 9
  23. 2026Plenoptic Video Generationcited by 9
  24. 2026ShareVerse: Multi-Agent Consistent Video Generation for Shared World Modelingcited by 9
  25. 2026SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generationcited by 9
  26. 2026SpatialVAM:Spatial-Aware Multi-View Video Diffusion as a Data-Efficient Robot Policycited by 8
  27. 2026Prisma-World: Camera-Controllable Multi-Agent Video World Modelcited by 8
  28. 2025RoboTransfer: Controllable Geometry-Consistent Video Diffusion for Manipulation Policy Transfercited by 7
  29. 2025Vid-CamEdit: Video Camera Trajectory Editing with Generative Rendering from Estimated Geometrycited by 7
  30. 2025Taming Camera-Controlled Video Generation with Verifiable Geometry Rewardcited by 7
  31. 2026ShotVerse: Advancing Cinematic Camera Control for Text-Driven Multi-Shot Video Creationcited by 7
  32. 2025InverseCrafter: Efficient Video ReCapture as a Latent Domain Inverse Problemcited by 6
  33. 2026RoboVIP: Multi-View Video Generation with Visual Identity Prompting Augments Robot Manipulationcited by 6
  34. 2026Compression and Retrieval: Implicit Memory Retrieval for Video World Modelscited by 6
  35. 2025ShotDirector: Directorially Controllable Multi-Shot Video Generation with Cinematographic Transitionscited by 5
  36. 2026AVControl: Efficient Framework for Training Audio-Visual Controlscited by 5
  37. 2026Full-4D: Generating Full-Scope 4D Scenes from a Single-View Videocited by 5
  38. 2025MV-Performer: Taming Video Diffusion Model for Faithful and Synchronized Multi-view Performer Synthesiscited by 4

50 most cited of 92 All 92 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024VideoMV: Consistent Multi-View Generation Based on Large Video Generative Model
  2. 2024Vid3D: Synthesis of Dynamic 3D Scenes using 2D Video Diffusion
  3. 2025View-Consistent Diffusion Representations for 3D-Consistent Video Generation
  4. 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion
  5. 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories
  6. 2026ConsID-Gen: View-Consistent and Identity-Preserving Image-to-Video Generation
  7. 20244Real-Video: Learning Generalizable Photo-Realistic 4D Video Diffusion
  8. 2025FlexWorld: Progressively Expanding 3D Scenes for Flexiable-View Synthesis