Geo-Align: Video Generation Alignment via Metric Geometry Reward
Not on the map. Why?
Abstract (arXiv)
Camera-controlled video generation has achieved remarkable progress in recent years. However, existing video-to-video re-rendering methods primarily rely on Supervised Fine-Tuning using synthetic datasets. At present, there is an extreme scarcity of synchronized, multi-view real-world video data. Consequently, the prevailing paradigm often exhibits limited generalization when processing out-of-distribution real-world videos, with models struggling to accurately adhere to physical scales and camera trajectories. To bridge this gap, we propose Geo-Align, the first Reinforcement Learning framework specifically designed for camera-controlled video re-rendering. Built upon a pretrained model, we optimize the model through a scale-aware perceptual reward mechanism. Specifically, we introduce a metric 3D estimator to extract precise camera trajectories from generated videos, explicitly penalizing deviations in rotation and translation. Furthermore, we meticulously designed a data pipeline strategy based on real-world conditioning videos and target camera trajectories derived from synthetic data, eliminating the reliance on paired data. Extensive experiments demonstrate that Geo-Align consistently outperforms existing supervised learning baselines in both precise camera controllability and visual fidelity, indicating the effectiveness of our method.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 57 of its 64 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
57 of 64 references.
References · 57
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
38 more
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 20243D Reconstruction with Spatial Memorycited by 269
- 2025Improving Video Generation with Human Feedbackcited by 267
- 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 202
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 202
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
- 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
- 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 168
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 116
- 2025VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequencescited by 107
- 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
- 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 91
- 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 86
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 76
- 2025LongCat-Video Technical Reportcited by 73
- 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 68
- 2025Sekai: A Video Dataset towards World Explorationcited by 64
- 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 59
- 2025Reangle-A-Video: 4D Video Generation as Video-to-Video Translationcited by 35
- 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
- 2025WinT3R: Window-Based Streaming Reconstruction with Camera Token Poolcited by 32
- 2025SRPO: Self-Referential Policy Optimization for Vision-Language-Action Modelscited by 25
- 2025Epipolar Geometry Improves Video Generation Modelscited by 22
- 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Rewardcited by 19
- 2025SteerX: Creating Any Camera-Free 3D and 4D Scenes with Geometric Steeringcited by 13
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.