Restore3D: Breathing Life into Broken Objects with Shape and Texture Restoration
Not on the map. Why?
Abstract (arXiv)
Restoring incomplete or damaged 3D objects is crucial for cultural heritage preservation, occluded object reconstruction, and artistic design. Existing methods primarily focus on geometric completion, often neglecting texture restoration and struggling with relatively complex and diverse objects. We introduce Restore3D, a novel framework that simultaneously restores both the shape and texture of broken objects using multi-view images. To address limited training data, we develop an automated data generation pipeline that synthesizes paired incomplete-complete samples from large-scale 3D datasets. Central to Restore3D is a multi-view model, enhanced by a carefully designed Mask Self-Perceiver module with a Depth-Aware Mask Rectifier. The rectified masks learned by the self-perceiver guide an image integration and enhancement phase, helping retain observed shape and texture patterns while refining the generated regions and mitigating the low-resolution limitations of the base model, yielding high-resolution, semantically coherent, and view-consistent multi-view images. A coarse-to-fine reconstruction strategy is then employed to recover detailed textured 3D meshes from refined multi-view images. Experiments on synthetic and real broken-object benchmarks show that Restore3D improves multi-view restoration quality and textured-mesh reconstruction over representative inpainting, completion, and reconstruction baselines in the evaluated settings. Project Page: restore3dx.github.io
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 87 of its 91 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
87 of 91 references.
References · 87
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
38 more
- 2024Depth Anything V2cited by 1,385
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
- 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 213
- 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
- 2023Scalable 3D Captioning with Pretrained Modelscited by 201
- 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
- 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
50 most cited of 87 All 87 (JSON)
Built on by
Not cited yet.