Taming Camera-Controlled Video Generation with Verifiable Geometry Reward
On the map: Diffusion models → Video generation
Abstract (arXiv)
Recent advances in video diffusion models have remarkably improved camera-controlled video generation, but most methods rely solely on supervised fine-tuning (SFT), leaving online reinforcement learning (RL) post-training largely underexplored. In this work, we introduce an online RL post-training framework that optimizes a pretrained video generator for precise camera control. To make RL effective in this setting, we design a verifiable geometry reward that delivers dense segment-level feedback to guide model optimization. Specifically, we estimate the 3D camera trajectories for both generated and reference videos, divide each trajectory into short segments, and compute segment-wise relative poses. The reward function then compares each generated-reference segment pair and assigns an alignment score as the reward signal, which helps alleviate reward sparsity and improve optimization efficiency. Moreover, we construct a comprehensive dataset featuring diverse large-amplitude camera motions and scenes with varied subject dynamics. Extensive experiments show that our online RL post-training clearly outperforms SFT baselines across multiple aspects, including camera-control accuracy, geometric consistency, and visual quality, demonstrating its superiority in advancing camera-controlled video generation.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 58 of its 62 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
58 of 62 references.
Closest ancestors · 21
Same direction, newest first
- 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Models13 Mar
- 2025Improving Video Generation with Human Feedback23 Jan
- 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generation18 Dec
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers27 Nov
- 2024Cavia: Camera-controllable Multi-view Video Diffusion with View-Integrated Attention14 Oct
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control17 Jul
- 2024Training-free Camera Control for Video Generation14 Jun
- 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Model12 Jun
- 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generation4 Jun
- 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Control27 May
9 more
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generation2 Apr
- 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
- 2023Photorealistic Video Generation with Diffusion Models11 Dec
- 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Models28 Nov
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
- 2022Video Diffusion Models7 Apr
Other references · 37
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
25 more
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
- 2021Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptionscited by 226
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
- 2025GameFactory: Creating New Games with Generative Interactive Videoscited by 124
- 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpointscited by 92
- 2021Make It Move: Controllable Image-to-Video Generation with Text Descriptionscited by 88
- 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 79
- 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
- 2024I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strengthcited by 38
- 2019A Purely Algebraic Justification of the Kabsch-Umeyama Algorithmcited by 24
- 2025MMGen: Unified Multi-modal Image Generation and Understanding in One Gocited by 10
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 13
- 2026Geo-Align: Video Generation Alignment via Metric Geometry Rewardcited by 2
- 2026Advances in GRPO for Generation Models: A Surveycited by 1
- 2026Delving into the Temporal Challenges of Unified Video Protection Against Image-to-Video and Fine-Tuning-based Customizationcited by 1
- 2026RNA-FM: Flow-Matching Generative Model for Genome-wide RNA-Seq Predictioncited by 0
- 2026ReFree: Towards Realistic Co-Speech Video Generation via Reward-Free RL and Multilevel Speech Guidancecited by 0
- 2026PACE: Precise AI Cinematic Expressioncited by 0
- 2026PACE: Precise AI Cinematic Expression17 Sep 2026
- 2026Delving into the Temporal Challenges of Unified Video Protection Against Image-to-Video and Fine-Tuning-based Customization14 Jul 2026
- 2026ReFree: Towards Realistic Co-Speech Video Generation via Reward-Free RL and Multilevel Speech Guidance11 Jun 2026
- 2026Geo-Align: Video Generation Alignment via Metric Geometry Reward22 May 2026
- 2026RNA-FM: Flow-Matching Generative Model for Genome-wide RNA-Seq Prediction12 May 2026
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
- 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories16 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026PartiCam: Camera Controlled Video Generation with Reward Guidance
- 2026CamPilot: Improving Camera Control in Video Diffusion Model with Efficient Camera Reward Feedback
- 2026VIGOR: VIdeo Geometry-Oriented Reward for Temporal Generative Alignment
- 2025CETCAM: Camera-Controllable Video Generation via Consistent and Extensible Tokenization
- 2025RLGF: Reinforcement Learning with Geometric Feedback for Autonomous Driving Video Generation
- 2026A Systematic Post-Train Framework for Video Generation
- 2026CreFlow: Corrective Reflow for Sparse-Reward Embodied Video Diffusion RL
- 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Reward