Zero-Shot Personalized Camera Motion Control for Image-to-Video Synthesis
Not on the map. Why?
Abstract (arXiv)
Specifying nuanced and compelling camera motion remains a significant hurdle for non-expert creators using generative tools, creating an "expressive gap" where generic text prompts fail to capture cinematic vision. This barrier limits individual creativity and restricts the accessibility of cinematic production for small-scale industries and educational content creators. To address this, we present a zero-shot diffusion-based framework for personalized camera motion control, enabling the transfer of cinematic movements from a single reference video onto a user-provided static image without requiring 3D data, predefined trajectories, or complex graphical interfaces. Our technical contribution involves an inference-time optimization strategy using dual Low-Rank Adaptation (LoRA) networks, with an orthogonality regularizer that encourages separation between spatial appearance and temporal motion updates, alongside a homography-based refinement strategy that provides weak geometric guidance. We evaluate our approach using a new metric, CameraScore, and two distinct user studies. A 72-participant perceptual study demonstrates that our method significantly outperforms existing baselines in motion accuracy (90.45% preference) and scene preservation (70.31% preference). Furthermore, a 12-participant task-based interaction study confirms that our workflow significantly improves usability and creative control (p < 0.001) compared to standard text- or preset-based prompts. We hope this work lays a foundation for future advancements in camera motion transfer across diverse scenes.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 57 of its 84 references that are in the map. First posted on arXiv 13 Apr 2025.
Builds on
57 of 84 references.
References · 57
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
38 more
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2024Genie: Generative Interactive Environmentscited by 747
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 602
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 345
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2017Pose Guided Person Image Generationcited by 251
- 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 225
- 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsitycited by 217
- 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
- 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 173
- 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
- 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
- 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 93
- 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Modelscited by 86
- 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 77
- 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 70
- 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Modelscited by 55
- 2024MotionMaster: Training-free Camera Motion Transfer For Video Generationcited by 51
- 2023NOPE: Novel Object Pose Estimation from a Single Imagecited by 38
- 2023PIA: Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image Modelscited by 30
- 2024Imagine yourself: Tuning-Free Personalized Image Generationcited by 30
- 2023CustomNet: Zero-shot Object Customization with Variable-Viewpoints in Text-to-Image Diffusion Modelscited by 25
- 2024Tuning-Free Image Customization with Image and Text Guidancecited by 25
- 2023MotionCrafter: One-Shot Motion Customization of Diffusion Modelscited by 20
- 2024Cinematographic Camera Diffusion Modelcited by 18
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.