VEIGAR: View-consistent Explicit Inpainting and Geometry Alignment for 3D object Removal
Not on the map. Why?
Abstract (arXiv)
Recent advances in Novel View Synthesis (NVS) and 3D generation have significantly improved editing tasks, with a primary emphasis on maintaining cross-view consistency throughout the generative process. Contemporary methods typically address this challenge using a dual-strategy framework: performing consistent 2D inpainting across all views guided by embedded priors either explicitly in pixel space or implicitly in latent space; and conducting 3D reconstruction with additional consistency guidance. Previous strategies, in particular, often require an initial 3D reconstruction phase to establish geometric structure, introducing considerable computational overhead. Even with the added cost, the resulting reconstruction quality often remains suboptimal. In this paper, we present VEIGAR, a computationally efficient framework that outperforms existing methods without relying on an initial reconstruction phase. VEIGAR leverages a lightweight foundation model to reliably align priors explicitly in the pixel space. In addition, we introduce a novel supervision strategy based on scale-invariant depth loss, which removes the need for traditional scale-and-shift operations in monocular depth regularization. Through extensive experimentation, VEIGAR establishes a new state-of-the-art benchmark in reconstruction quality and cross-view consistency, while achieving a threefold reduction in training time compared to the fastest existing method, highlighting its superior balance of efficiency and effectiveness.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 49 of its 65 references that are in the map. First posted on arXiv 13 Jun 2025.
Builds on
49 of 65 references.
References · 49
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
37 more
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 2018Generative Image Inpainting with Contextual Attentioncited by 578
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
- 2022Blended Latent Diffusioncited by 430
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
- 2020PatchmatchNet: Learned Multi-View Patchmatch Stereocited by 204
- 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 184
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
- 2015Stereo Matching by Training a Convolutional Neural Network to Compare Image Patchescited by 151
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
- 2020HITNet: Hierarchical Iterative Tile Refinement Network for Real-time Stereo Matchingcited by 120
- 2019DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatchcited by 114
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 114
- 2022A Keypoint-based Global Association Network for Lane Detectioncited by 68
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 55
- 2024GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removalcited by 39
- 2024MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editingcited by 30
- 2024Score Distillation Sampling with Learned Manifold Correctivecited by 27
- 20253D Gaussian Inpainting with Depth-Guided Cross-View Consistencycited by 23
- 2024Semantic Score Distillation Sampling for Compositional Text-to-3D Generationcited by 9
- 2024View-consistent Object Removal in Radiance Fieldscited by 7
- 2025Geometry-Aware Diffusion Models for Multiview Scene Inpaintingcited by 6
- 2023Multi-View Unsupervised Image Generation with Cross Attention Guidancecited by 1
Built on by
Not cited yet.