Unravel: Recovering an Interactive 3D Scene from a Single Image
Not on the map. Why?
Abstract (arXiv)
We present Unravel, a training-free framework that turns a single image into an interactive 3D scene, where every object is an independent and movable asset. Existing generators either produce one entangled geometry in which no object can be moved, or predict all objects in one feed-forward pass, where a wrong guess cannot be detected or repaired. Unravel instead takes a different approach: it first takes the scene apart, and then puts it back together. Starting from the input image, an agentic harness that iteratively peels the image layer by layer, and adopts point cloud as major modality for spatial relationship recovery. Specifically, a vision-language model plans which objects are fully visible, an image editor removes them and restores the occluded regions. Every edit is verified before being incorporated into the reconstruction. This process gradually turns occluded parts of the scene into direct observation, allowing objects to be reconstructed when they are best exposed rather than hallucinated from the original image alone. The scene is then rebuilt in reverse removal order, so that the supporting objects are naturally placed before the objects they support. Since a single-view image only reveals part of an object, we treat the observed points as a lower bound on its size: an asset may grow to cover its points, but can not shrink away from them. Finally, we physically settle the reconstructed scene to remove floating objects and interpenetrations, followed by an agentic audit that corrects remaining placement errors. Extensive experiments on diverse indoor scenes show that Unravel recovers more objects, places them more faithfully, and produces scenes that are more physically-plausible than existing methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 43 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
41 of 43 references.
References · 41
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Depth Anything V2cited by 1,422
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
29 more
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 20243D Reconstruction with Spatial Memorycited by 277
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
- 2025SAM 3D: 3Dfy Anything in Imagescited by 247
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
- 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 135
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 117
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
- 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 110
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 84
- 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 60
- 2023ControlRoom3D: Room Generation using Semantic Proxy Roomscited by 56
- 2025SceneGen: Single-Image 3D Scene Generation in One Feedforward Passcited by 54
- 2026SAGE: Scalable Agentic 3D Scene Generation for Embodied AIcited by 50
- 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenescited by 46
- 2026SimFoundry: Modular and Automated Scene Generation for Policy Learning and Evaluationcited by 16
- 2026MoGe-3: Fine-Detail Monocular Geometry Estimation with Self-Guided Sparse Volumetric Refinementcited by 8
- 2026SceneAssistant: A Visual Feedback Agent for Open-Vocabulary 3D Scene Generationcited by 6
- 2026Interact3D: Compositional 3D Generation of Interactive Objectscited by 3
- 2025NI-Tex: Non-isometric Image-based Garment Texture Generationcited by 2
- 2026Seeing Through Clutter: Structured 3D Scene Reconstruction via Iterative Object Removalcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Training-Free Instance-Aware 3D Scene Reconstruction and Diffusion-Based View Synthesis from Sparse Images
- 2026REST3D: Reconstructing Physically Stable 3D Scenes from a Single Image
- 2026ReconSplat: Generalizable 3D Scene Reconstruction Beyond Observed Views
- 2025Self-Evolving 3D Scene Generation from a Single Image
- 2026UniMesh: Unifying 3D Mesh Understanding and Generation
- 2026DensiTok: Making Feed-Forward 3D Gaussian Splatting See More Views Than It Is Given
- 2026LEGO-Anything: Coding Agents for 3D Scene Reconstruction
- 2026Thinking in Blender: Staged Executable Inverse Graphics with Vision-Language Models