GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoising
Not on the map. Why?
Abstract (arXiv)
Precisely manipulating objects in a single photograph (translation, rotation, scaling) while obeying 3D physical constraints remains unsolved for diffusion-based editors. Current 2D methods lack spatial awareness and produce perspective violations. Forcing structural proxies into the latent space also disrupts variance homogeneity, and the resulting self-attention leakage leads to ghosting and background blur. The core difficulty is asymmetric: the relocated object must follow a rigid geometry, yet the uncovered background needs freedom to synthesize plausible content. We present GeoEdit, a training-free Lift-Manipulate-Render-Denoise pipeline that satisfies both constraints. We decouple scene and object in 3D, align them through point correspondence, and render a geometry-aligned proxy with a structural depth map. A Dual-Branch Denoising stage then refines this proxy: a video diffusion backbone preserves object identity, while 3D constraints are injected into the foreground within a narrow denoising window at matching noise variance (variance-homogeneous injection). The background denoises freely. Because the injected signal matches the native latent statistics, self-attention stays undisturbed. We also introduce GeoEditBench, a pose-aware benchmark covering object translation, object rotation, and camera movement with pose-aware evaluation metrics. Experiments confirm consistent gains in geometric accuracy, identity fidelity, and background quality. Our codes are available at https://github.com/Heey731/GeoEdit.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 68 of its 83 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
68 of 83 references.
References · 68
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
38 more
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2015Holistically-Nested Edge Detectioncited by 590
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
- 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 410
- 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
- 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 293
- 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218
- 2024Taming Rectified Flow for Inversion and Editingcited by 200
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
- 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 100
- 2025Controllable Video Generation: A Surveycited by 93
- 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generationcited by 87
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2023OBJECT 3DIT: Language-guided 3D-aware Image Editingcited by 62
- 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
- 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 61
- 2023Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3Dcited by 59
- 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 59
- 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
- 2024Image Sculpting: Precise Object Editing with 3D Geometry Controlcited by 45
- 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 41
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Geometric Image Editing via Effects-Sensitive In-Context Inpainting with Diffusion Transformers
- 2025Training-free Geometric Image Editing on Diffusion Models
- 2024Diffusion Models are Geometry Critics: Single Image 3D Editing Using Pre-Trained Diffusion Priors
- 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis
- 2025V2Edit: Versatile Video Diffusion Editor for Videos and 3D Scenes
- 2024Move Anything with Layered Scene Diffusion
- 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceivers
- 2026GenNVS: Geometry-enhanced Novel View Synthesis via Disentangled 3D Prior