mlsanityData to 7 Oct 2026

VEIGAR: View-consistent Explicit Inpainting and Geometry Alignment for 3D object Removal

arXiv 2506.15821 ↗First posted 13 Jun 2025cs.GR cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in Novel View Synthesis (NVS) and 3D generation have significantly improved editing tasks, with a primary emphasis on maintaining cross-view consistency throughout the generative process. Contemporary methods typically address this challenge using a dual-strategy framework: performing consistent 2D inpainting across all views guided by embedded priors either explicitly in pixel space or implicitly in latent space; and conducting 3D reconstruction with additional consistency guidance. Previous strategies, in particular, often require an initial 3D reconstruction phase to establish geometric structure, introducing considerable computational overhead. Even with the added cost, the resulting reconstruction quality often remains suboptimal. In this paper, we present VEIGAR, a computationally efficient framework that outperforms existing methods without relying on an initial reconstruction phase. VEIGAR leverages a lightweight foundation model to reliably align priors explicitly in the pixel space. In addition, we introduce a novel supervision strategy based on scale-invariant depth loss, which removes the need for traditional scale-and-shift operations in monocular depth regularization. Through extensive experimentation, VEIGAR establishes a new state-of-the-art benchmark in reconstruction quality and cross-view consistency, while achieving a threefold reduction in training time compared to the fastest existing method, highlighting its superior balance of efficiency and effectiveness.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 49 of its 65 references that are in the map. First posted on arXiv 13 Jun 2025.

Builds on

49 of 65 references.

References · 49

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  7. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  8. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  9. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  10. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  11. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  12. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
37 more
  1. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  2. 2024Depth Anything V2cited by 1,385
  3. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  4. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  5. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
  6. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
  7. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  8. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  9. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  10. 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
  11. 2018Generative Image Inpainting with Contextual Attentioncited by 578
  12. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  13. 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
  14. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
  15. 2022Blended Latent Diffusioncited by 430
  16. 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
  17. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  18. 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
  19. 2020PatchmatchNet: Learned Multi-View Patchmatch Stereocited by 204
  20. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 184
  21. 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
  22. 2015Stereo Matching by Training a Convolutional Neural Network to Compare Image Patchescited by 151
  23. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
  24. 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
  25. 2020HITNet: Hierarchical Iterative Tile Refinement Network for Real-time Stereo Matchingcited by 120
  26. 2019DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatchcited by 114
  27. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 114
  28. 2022A Keypoint-based Global Association Network for Lane Detectioncited by 68
  29. 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 55
  30. 2024GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removalcited by 39
  31. 2024MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editingcited by 30
  32. 2024Score Distillation Sampling with Learned Manifold Correctivecited by 27
  33. 20253D Gaussian Inpainting with Depth-Guided Cross-View Consistencycited by 23
  34. 2024Semantic Score Distillation Sampling for Compositional Text-to-3D Generationcited by 9
  35. 2024View-consistent Object Removal in Radiance Fieldscited by 7
  36. 2025Geometry-Aware Diffusion Models for Multiview Scene Inpaintingcited by 6
  37. 2023Multi-View Unsupervised Image Generation with Cross Attention Guidancecited by 1

Built on by

Not cited yet.