PRISM: Feed-Forward Single-Image 3D Reconstruction via Geometric Warp-Residual Modeling
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Reconstructing 3D scenes from a single image is a fundamental challenge in computer vision, with broad applications in virtual reality, robotics, and content creation. Recent methods achieve outstanding performance by leveraging camera-controlled video diffusion models, but rely on iterative diffusion sampling, which greatly limits their practical deployment. We observe that geometric forward warping alone can cover the majority of a target view directly from the input image, with only a compact residual left for the encoder to correct. Motivated by this observation, we propose PRISM, a feed-forward framework that decomposes multi-view latent prediction into a parameter-free geometric prior and a learned residual correction, with no diffusion sampling required at inference. To enable generalization from purely synthetic training data, we devise a two-stage training strategy combining latents supervised distillation for geometric generalization and perceptual fine-tuning for appearance quality optimization. Extensive experiments on three benchmarks demonstrate that PRISM achieves competitive reconstruction quality compared with diffusion-based methods, while reducing inference time dramatically to only 36 seconds per scene.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 48 of its 55 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
48 of 55 references.
Closest ancestors · 12
Same direction, newest first
- 2025VideoScene: Distilling Video Diffusion Model to Generate 3D Scenes in One Step2 Apr
- 2025Bolt3D: Generating 3D Scenes in Seconds18 Mar
- 2024Wonderland: Navigating 3D Scenes from a Single Image16 Dec
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
- 2024VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Models18 Mar
- 2023ReconFusion: 3D Reconstruction with Diffusion Priors5 Dec
- 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Image27 Oct
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
- 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
Other references · 36
- 2020Denoising Diffusion Probabilistic Modelscited by 20,952
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
- 2020Denoising Diffusion Implicit Modelscited by 9,718
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,170
- 2022Flow Matching for Generative Modelingcited by 5,542
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,712
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,607
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,974
- 2023Consistency Modelscited by 1,797
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,581
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,539
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,497
24 more
- 2024Grounding Image Matching in 3D with MASt3Rcited by 965
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 843
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 738
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 700
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 690
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 673
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 658
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 557
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 521
- 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 362
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 345
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 331
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 293
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 277
- 2020Single-View View Synthesis with Multiplane Imagescited by 263
- 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
- 2024Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Imagecited by 114
- 2021PixelSynth: Generating a 3D-Consistent Experience from a Single Imagecited by 82
- 2024GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warpingcited by 72
- 2022FWD: Real-time Novel View Synthesis with Forward Warping and Depthcited by 39
- 2025AVGGT: Rethinking Global Attention for Accelerating VGGTcited by 14
- 2026TokenSplat: Token-aligned 3D Gaussian Splatting for Feed-forward Pose-free Reconstructioncited by 13
- 2026GlobalSplat: Efficient Feed-Forward 3D Gaussian Splatting via Global Scene Tokenscited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective
- 2024Coherent 3D Scene Diffusion From a Single RGB Image
- 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
- 2025SpatialCrafter: Unleashing the Imagination of Video Diffusion Models for Scene Reconstruction from Limited Observations
- 2025Dream-to-Recon: Monocular 3D Reconstruction with Diffusion-Depth Distillation from Single Images
- 2026Repurposing Geometric Foundation Models for Multi-view Diffusion
- 2025SHaDe: Compact and Consistent Dynamic 3D Reconstruction via Tri-Plane Deformation and Latent Diffusion
- 2026VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesis