mlsanityData to 14 Oct 2026

Zero-Shot Personalized Camera Motion Control for Image-to-Video Synthesis

arXiv 2504.09472 ↗First posted 13 Apr 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Specifying nuanced and compelling camera motion remains a significant hurdle for non-expert creators using generative tools, creating an "expressive gap" where generic text prompts fail to capture cinematic vision. This barrier limits individual creativity and restricts the accessibility of cinematic production for small-scale industries and educational content creators. To address this, we present a zero-shot diffusion-based framework for personalized camera motion control, enabling the transfer of cinematic movements from a single reference video onto a user-provided static image without requiring 3D data, predefined trajectories, or complex graphical interfaces. Our technical contribution involves an inference-time optimization strategy using dual Low-Rank Adaptation (LoRA) networks, with an orthogonality regularizer that encourages separation between spatial appearance and temporal motion updates, alongside a homography-based refinement strategy that provides weak geometric guidance. We evaluate our approach using a new metric, CameraScore, and two distinct user studies. A 72-participant perceptual study demonstrates that our method significantly outperforms existing baselines in motion accuracy (90.45% preference) and scene preservation (70.31% preference). Furthermore, a 12-participant task-based interaction study confirms that our workflow significantly improves usability and creative control (p < 0.001) compared to standard text- or preset-based prompts. We hope this work lays a foundation for future advancements in camera motion transfer across diverse scenes.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 57 of its 84 references that are in the map. First posted on arXiv 13 Apr 2025.

Builds on

57 of 84 references.

References · 57

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  10. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  12. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
38 more
  1. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  2. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  3. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  4. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  5. 2024Genie: Generative Interactive Environmentscited by 747
  6. 2023ModelScope Text-to-Video Technical Reportcited by 658
  7. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  8. 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 602
  9. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  10. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  11. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  12. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
  13. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
  14. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 345
  15. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
  16. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
  17. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
  18. 2017Pose Guided Person Image Generationcited by 251
  19. 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 225
  20. 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsitycited by 217
  21. 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
  22. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 173
  23. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  24. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
  25. 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
  26. 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 93
  27. 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Modelscited by 86
  28. 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 77
  29. 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 70
  30. 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Modelscited by 55
  31. 2024MotionMaster: Training-free Camera Motion Transfer For Video Generationcited by 51
  32. 2023NOPE: Novel Object Pose Estimation from a Single Imagecited by 38
  33. 2023PIA: Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image Modelscited by 30
  34. 2024Imagine yourself: Tuning-Free Personalized Image Generationcited by 30
  35. 2023CustomNet: Zero-shot Object Customization with Variable-Viewpoints in Text-to-Image Diffusion Modelscited by 25
  36. 2024Tuning-Free Image Customization with Image and Text Guidancecited by 25
  37. 2023MotionCrafter: One-Shot Motion Customization of Diffusion Modelscited by 20
  38. 2024Cinematographic Camera Diffusion Modelcited by 18

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.