mlsanityData to 7 Oct 2026

UniGeo: Unifying Geometric Guidance for Camera-Controllable Image Editing via Video Models

arXiv 2604.17565 ↗First posted 19 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Camera-controllable image editing aims to synthesize novel views of a given scene under varying camera poses while strictly preserving cross-view geometric consistency. However, existing methods typically rely on fragmented geometric guidance, such as only injecting point clouds at the representation level despite models containing multiple levels, and are mainly based on image diffusion models that operate on discrete view mappings. These two limitations jointly lead to geometric drift and structural degradation under continuous camera motion. We observe that while leveraging video models provides continuous viewpoint priors for camera-controllable image editing, they still struggle to form stable geometric understanding if geometric guidance remains fragmented. To systematically address this, we inject unified geometric guidance across three levels that jointly determine the generative output: representation, architecture, and loss function. To this end, we propose UniGeo, a novel camera-controllable editing framework. Specifically, at the representation level, UniGeo incorporates a frame-decoupled geometric reference injection mechanism to provide robust cross-view geometry context. At the architecture level, it introduces geometric anchor attention to align multi-view features. At the loss function level, it proposes a trajectory-endpoint geometric supervision strategy to explicitly reinforce the structural fidelity of target views. Comprehensive experiments across multiple public benchmarks, encompassing both extensive and limited camera motion settings, demonstrate that UniGeo significantly outperforms existing methods in both visual quality and geometric consistency.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 78 of its 91 references that are in the map. First posted on arXiv 19 Apr 2026.

Builds on

78 of 91 references.

References · 78

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  9. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  12. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
38 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  2. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  3. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  4. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  5. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  6. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  7. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  8. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
  9. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  10. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  11. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  12. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  13. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  14. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  15. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  16. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  17. 2023Zero-shot Image-to-Image Translationcited by 503
  18. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  19. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  20. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  21. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  22. 2024OmniGen: Unified Image Generationcited by 388
  23. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  24. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
  25. 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
  26. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  27. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
  28. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
  29. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
  30. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
  31. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  32. 2024Taming Rectified Flow for Inversion and Editingcited by 200
  33. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
  34. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  35. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
  36. 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 172
  37. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
  38. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 163

50 most cited of 78 All 78 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CameraEditor: Camera-Controlled Image Editing via Video-Prior Sequential Modeling
  2. 2026SierpinskiCam: Camera-Controlled Video Retaking with Sierpinski Triangle Pattern Cues
  3. 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation
  4. 2026Geometrically Consistent Multi-View Scene Generation from Freehand Sketches
  5. 2026GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoising
  6. 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis
  7. 2026Probing into Camera Control of Video Models
  8. 2026PE-Field 4D: Video Generation Models as Canvas