mlsanityData to 14 Oct 2026

DEVIS-GRPO: Unleashing GRPO on Dynamic Extreme View Synthesis

arXiv 2605.16937 ↗First posted 16 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Trajectory-controlled video generation has become essential for controllable video generation. While current methods perform well under small-view camera motions, they degrade significantly with large-view motions. Existing solutions for extreme-view synthesis typically require dedicated video pairs, demanding substantial annotation effort. To address these limitations, we propose Dynamic Extreme VIew Synthesis-GRPO (DEVIS-GRPO), a GRPO-based framework for trajectory-controlled video generation, the first online policy gradient method for extreme view video generation. Central to our approach is a novel sampling strategy: Accumulative Dynamic Extreme VIew Synthesis (ADEVIS), which achieves large-view camera motions by progressively accumulating small-view increments. This method delivers two key advantages: 1) enhanced training efficiency, as it eliminates the need to warm-start the policy model by collecting expensive paired large-view videos, and 2) increased sampling diversity, achieved by flexibly varying trajectory configurations. Finally, we designed a multi-level consistency-quality reward function to select high-quality samples for model optimization. Experiments on the Kubric-4D, iPhone, and DL3DV datasets demonstrate our method's superiority. On Kubric-4D, we achieve relative improvements of 21.57% in PSNR and 7.31% in SSIM over the second-best method in non-occlusion areas. On iPhone, LPIPS is reduced by 18.56%.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 47 references that are in the map. First posted on arXiv 16 May 2026.

Builds on

37 of 47 references.

References · 37

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  6. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  9. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  10. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  11. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  12. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
25 more
  1. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  2. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  3. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  4. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  5. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
  6. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  7. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
  8. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  9. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  10. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
  11. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
  12. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  13. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
  14. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
  15. 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
  16. 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 200
  17. 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 189
  18. 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 141
  19. 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 120
  20. 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
  21. 2022Waymo Open Dataset: Panoramic Video Panoptic Segmentationcited by 58
  22. 2022Look Outside the Room: Synthesizing A Consistent Long-Term 3D Scene Video from A Single Imagecited by 55
  23. 20253D Scene Prompting for Scene-Consistent Camera-Controllable Video Generationcited by 13
  24. 2025Light-X: Generative 4D Video Rendering with Camera and Illumination Controlcited by 12
  25. 2024Edit-Your-Motion: Space-Time Diffusion Decoupling Learning for Video Motion Editingcited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesis
  2. 2025Diverse Video Generation with Determinantal Point Process-Guided Policy Optimization
  3. 2026AnyView: Synthesizing Any Novel View in Dynamic Scenes
  4. 2025Dynamic View Synthesis as an Inverse Problem
  5. 2026CamLit: Unified Video Diffusion with Explicit Camera and Lighting Control
  6. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Models
  7. 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Models
  8. 2026PartiCam: Camera Controlled Video Generation with Reward Guidance