ORCA: Occlusion-Aware Refinement and Completion for Novel View Synthesis
Not on the map. Why?
Abstract (arXiv)
Novel-view synthesis from a single image is a fundamentally ambiguous problem. As the camera moves away from the input viewpoint, previously hidden regions become visible, exposing missing geometry and holes in the reconstructed scene. Existing methods often rely on generative models to complete such regions. However, many of these artifacts are small gaps near depth boundaries and do not require generating new scene content. In order to eliminate expensive process of generating image we introduce ORCA, an occlusion-aware method for reconstructing and completing explorable 3D scenes from a single image. ORCA first introduces 3D structure into a Gaussian-anchor representation using monocular depth while preserving the original camera-ray correspondence. During scene exploration, missing regions are handled based on their size and structure. Small disocclusions are repaired using RGB-D information already available in the reconstruction, while generative inpainting is reserved for larger regions that cannot be reliably recovered from the scene. New Gaussian anchors are added and optimized locally without modifying the existing representation. By reducing unnecessary reliance on generative inpainting, ORCA limits generation-induced hallucinations and better preserves the content and structure of the original scene. On DIV2K, ORCA improves novel-view quality over VistaDream across all reported metrics, increasing MUSIQ from 61.60 to 68.71 and CLIP-IQA from 0.474 to 0.574. These results show that many novel-view artifacts can be repaired effectively by reusing information already present in the reconstructed scene.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 23 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
17 of 23 references.
References · 17
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 182
- 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
- 2023Long-Term Photometric Consistent Novel View Synthesis with Diffusion Modelscited by 76
- 2024VistaDream: Sampling multiview consistent images for single-view scene reconstructioncited by 38
- 2024Baking Gaussian Splatting into Diffusion Denoiser for Fast and Scalable Single-stage Image-to-3D Generation and Reconstructioncited by 32
- 2024MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Modelcited by 32
5 more
- 2025DepR: Depth Guided Single-view Scene Reconstruction with Instance-level Diffusioncited by 23
- 20243D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generationcited by 19
- 2026One2Scene: Geometric Consistent Explorable 3D Scene Generation from a Single Imagecited by 11
- 2025Affine-Equivariant Kernel Space Encoding for NeRF Editingcited by 4
- 2025ExScene: Free-View 3D Scene Reconstruction with Gaussian Splatting from a Single Imagecited by 2
Built on by
Not cited yet.