mlsanityData to 7 Oct 2026

Geo-Align: Video Generation Alignment via Metric Geometry Reward

arXiv 2605.23903 ↗First posted 22 May 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Camera-controlled video generation has achieved remarkable progress in recent years. However, existing video-to-video re-rendering methods primarily rely on Supervised Fine-Tuning using synthetic datasets. At present, there is an extreme scarcity of synchronized, multi-view real-world video data. Consequently, the prevailing paradigm often exhibits limited generalization when processing out-of-distribution real-world videos, with models struggling to accurately adhere to physical scales and camera trajectories. To bridge this gap, we propose Geo-Align, the first Reinforcement Learning framework specifically designed for camera-controlled video re-rendering. Built upon a pretrained model, we optimize the model through a scale-aware perceptual reward mechanism. Specifically, we introduce a metric 3D estimator to extract precise camera trajectories from generated videos, explicitly penalizing deviations in rotation and translation. Furthermore, we meticulously designed a data pipeline strategy based on real-world conditioning videos and target camera trajectories derived from synthetic data, eliminating the reliance on paired data. Extensive experiments demonstrate that Geo-Align consistently outperforms existing supervised learning baselines in both precise camera controllability and visual fidelity, indicating the effectiveness of our method.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 57 of its 64 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

57 of 64 references.

References · 57

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  6. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  7. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  8. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  9. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  10. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
  11. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  12. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
38 more
  1. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  2. 2025Continuous 3D Perception Model with Persistent Statecited by 527
  3. 2023CoTracker: It is Better to Track Togethercited by 516
  4. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  5. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
  6. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
  7. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
  8. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
  9. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  10. 20243D Reconstruction with Spatial Memorycited by 269
  11. 2025Improving Video Generation with Human Feedbackcited by 267
  12. 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 202
  13. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 202
  14. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
  15. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
  16. 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
  17. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 168
  18. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
  19. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
  20. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
  21. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 116
  22. 2025VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequencescited by 107
  23. 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
  24. 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
  25. 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 91
  26. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 86
  27. 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 76
  28. 2025LongCat-Video Technical Reportcited by 73
  29. 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 68
  30. 2025Sekai: A Video Dataset towards World Explorationcited by 64
  31. 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 59
  32. 2025Reangle-A-Video: 4D Video Generation as Video-to-Video Translationcited by 35
  33. 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
  34. 2025WinT3R: Window-Based Streaming Reconstruction with Camera Token Poolcited by 32
  35. 2025SRPO: Self-Referential Policy Optimization for Vision-Language-Action Modelscited by 25
  36. 2025Epipolar Geometry Improves Video Generation Modelscited by 22
  37. 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Rewardcited by 19
  38. 2025SteerX: Creating Any Camera-Free 3D and 4D Scenes with Geometric Steeringcited by 13

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.