mlsanityData to 14 Oct 2026

Pose-Free Feed-Forward 3D Inpainting via Learnable Mask Attention and Support Token Refinement

arXiv 2610.11857 ↗First posted 8 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D scene inpainting aims to recover missing or occluded regions in edited 3D scenes, while ensuring geometric and textural consistency. Existing approaches, however, typically require accurately calibrated camera poses, which restricts their applicability in casual, in-the-wild scenarios and introduces additional preprocessing overhead. To overcome this limitation, we present FreeInpaint, a novel feed-forward framework that generates complete and 3D-consistent scenes directly from unposed multi-view images with masked regions. At its core, FreeInpaint extends a 3D foundation model to propagate masked regions from a reference view to other unposed views, bridging 3D reconstruction and scene inpainting while preserving the model's native ability to recover camera poses and scene geometry. Our method addresses two key challenges in adapting feed-forward 3D foundation models to masked inputs. First, masked regions can corrupt cross-view correspondence reasoning, degrading pose estimation and geometry recovery. To address this, we introduce a Learnable Mask Attention mechanism that preserves the spatial anchoring of reliable observations while allowing masked regions to progressively absorb useful context in deeper layers. Second, under severe occlusions, a single forward pass often lacks sufficient appearance evidence for high-fidelity completion. Therefore, we propose a Support Token Refinement strategy, which injects diffusion-generated support evidence as confidence-weighted auxiliary tokens to refine under-observed regions while preserving the original spatial anchor. Extensive experiments across diverse datasets demonstrate that FreeInpaint achieves superior inpainting quality, eliminating the reliance on pre-computed camera poses while keeping a fast inference speed. The project page is https://rorisis.github.io/FreeInpaint/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 50 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

11 of 50 references.

References · 11

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  3. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  4. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  5. 2018Demystifying MMD GANscited by 1,293
  6. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  7. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  8. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
  9. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 314
  10. 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 56
  11. 2024Multi-layer Learnable Attention Mask for Multimodal Taskscited by 4

Built on by

Not cited yet.