mlsanityData to 14 Oct 2026

CineMaster: A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generation

arXiv 2502.08639 ↗First posted 12 Feb 2025cs.CVcited by 74

Not on the map. Why?

Abstract (arXiv)

In this work, we present CineMaster, a novel framework for 3D-aware and controllable text-to-video generation. Our goal is to empower users with comparable controllability as professional film directors: precise placement of objects within the scene, flexible manipulation of both objects and camera in 3D space, and intuitive layout control over the rendered frames. To achieve this, CineMaster operates in two stages. In the first stage, we design an interactive workflow that allows users to intuitively construct 3D-aware conditional signals by positioning object bounding boxes and defining camera movements within the 3D space. In the second stage, these control signals--comprising rendered depth maps, camera trajectories and object class labels--serve as the guidance for a text-to-video diffusion model, ensuring to generate the user-intended video content. Furthermore, to overcome the scarcity of in-the-wild datasets with 3D object motion and camera pose annotations, we carefully establish an automated data annotation pipeline that extracts 3D bounding boxes and camera trajectories from large-scale video data. Extensive qualitative and quantitative experiments demonstrate that CineMaster significantly outperforms existing methods and implements prominent 3D-aware text-to-video generation. Project page: https://cinemaster-dev.github.io/.

Key facts. Cited by 74 papers in the map (data through 14 Oct 2026). Builds on 31 of its 50 references that are in the map. First posted on arXiv 12 Feb 2025.

Builds on

31 of 50 references.

References · 31

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  6. 2013Auto-Encoding Variational Bayescited by 4,053
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  9. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  10. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  11. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  12. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
19 more
  1. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
  2. 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 304
  3. 2017Are GANs Created Equal? A Large-Scale Studycited by 267
  4. 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 229
  5. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
  6. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 181
  7. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
  8. 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 164
  9. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  10. 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 120
  11. 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 93
  12. 2023CCEdit: Creative and Controllable Video Editing via Diffusion Modelscited by 82
  13. 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
  14. 2023LooseControl: Lifting ControlNet for Generalized Depth Conditioningcited by 68
  15. 2024Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Modelcited by 66
  16. 2024Trajectory Attention for Fine-grained Video Motion Controlcited by 63
  17. 2025GS-DiT: Advancing Video Generation with Pseudo 4D Gaussian Fields through Efficient Dense 3D Point Trackingcited by 39
  18. 2025Perception-as-Control: Fine-grained Controllable Image Animation with 3D-aware Motion Representationcited by 23
  19. 2024EasyControl: Transfer ControlNet to Video Diffusion for Controllable Generation and Interpolationcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 32; 2026: 42.

74 papers.

Sort:

By area:

  1. 2025Controllable Video Generation: A Surveycited by 98
  2. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  3. 2025MagicMotion: Controllable Video Generation with Dense-to-Sparse Trajectory Guidancecited by 61
  4. 2025CamCloneMaster: Enabling Reference-based Camera Control for Video Generationcited by 46
  5. 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 46
  6. 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
  7. 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 41
  8. 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 36
  9. 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memorycited by 35
  10. 2025Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Controlcited by 28
  11. 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 28
  12. 2026ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytellingcited by 28
38 more
  1. 2025Generative Video Motion Editing with 3D Point Trackscited by 23
  2. 2025PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generationcited by 23
  3. 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
  4. 2026BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment Maskscited by 20
  5. 2025T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generationcited by 19
  6. 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
  7. 2025Survey of Video Diffusion Models: Foundations, Implementations, and Applicationscited by 14
  8. 2025VFXMaster: Unlocking Dynamic Visual Effect Generation via In-Context Learningcited by 12
  9. 2025DualCamCtrl: Dual-Branch Diffusion Model for Geometry-Aware Camera-Controlled Video Generationcited by 11
  10. 2025OmniCam: Unified Multimodal Video Generation via Camera Controlcited by 9
  11. 2025SceneDesigner: Controllable Multi-Object Image Generation with 9-DoF Pose Manipulationcited by 9
  12. 2026PerpetualWonder: Long-Horizon Action-Conditioned 4D Scene Generationcited by 9
  13. 2025CoT-lized Diffusion: Let's Reinforce T2I Generation Step-by-stepcited by 8
  14. 2025ToonComposer: Streamlining Cartoon Production with Generative Post-Keyframingcited by 8
  15. 2025ByteLoom: Weaving Geometry-Consistent Human-Object Interactions through Progressive Curriculum Learningcited by 7
  16. 2026Future Optical Flow Prediction Improves Robot Control & Video Generationcited by 7
  17. 2026ShotVerse: Advancing Cinematic Camera Control for Text-Driven Multi-Shot Video Creationcited by 7
  18. 2026Evolution of Video Generative Foundationscited by 7
  19. 2025FlexTraj: Image-to-Video Generation with Flexible Point Trajectory Controlcited by 6
  20. 2025SemanticGen: Video Generation in Semantic Spacecited by 6
  21. 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfercited by 6
  22. 20263D-Aware Implicit Motion Control for View-Adaptive Human Video Generationcited by 6
  23. 2026OmniDirector: General Multi-Shot Camera Cloning without Cross-Paired Datacited by 6
  24. 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gatingcited by 6
  25. 2026FlashMotion: Few-Step Controllable Video Generation with Trajectory Guidancecited by 5
  26. 2025LAMP: Language-Assisted Motion Planning for Controllable Video Generationcited by 4
  27. 2025VHOI: Controllable Video Generation of Human-Object Interactions from Sparse Trajectories via Motion Densificationcited by 4
  28. 2025CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generationcited by 4
  29. 2026SeeThrough3D: Occlusion Aware 3D Control in Text-to-Image Generationcited by 4
  30. 2026Controllable Egocentric Video Generation via Occlusion-Aware Sparse 3D Hand Jointscited by 4
  31. 2025Cyc3D: Fine-grained Controllable 3D Generation via Cycle Consistency Regularizationcited by 3
  32. 2026VERTIGO: Visual Preference Optimization for Cinematic Camera Trajectory Generationcited by 3
  33. 2025Sketch3DVE: Sketch-based 3D-Aware Scene Video Editingcited by 2
  34. 2025ChronosObserver: Taming 4D World with Hyperspace Diffusion Samplingcited by 2
  35. 2026Composing Driving Worlds through Disentangled Control for Adversarial Scenario Generationcited by 2
  36. 2026Lighting-grounded Video Generation with Renderer-based Agent Reasoningcited by 2
  37. 2026OmniDrive: An LLM-Choreographed Multi-Agent World Model with Unified Latent Co-Compression for Multi-View Driving Video Generationcited by 2
  38. 2026ParaScale: Scale-Calibrated Camera-Motion Transfer via a Gauge-Invariant Parallax Numbercited by 2

50 most cited of 74 All 74 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control
  2. 2025MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generation
  3. 2024Can video generation replace cinematographers? Research on the cinematic language of generated video
  4. 2023TrailBlazer: Trajectory Control for Diffusion-Based Video Generation
  5. 2024Compositional 3D-aware Video Generation with LLM Director
  6. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generation
  7. 2026Beyond Inpainting: Unleash 3D Understanding for Precise Camera-Controlled Video Generation
  8. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Control