PhotoShape: Photorealistic Materials for Large-Scale Shape Collections
Not on the map. Why?
Abstract (arXiv)
Existing online 3D shape repositories contain thousands of 3D models but lack photorealistic appearance. We present an approach to automatically assign high-quality, realistic appearance models to large scale 3D shape collections. The key idea is to jointly leverage three types of online data -- shape collections, material collections, and photo collections, using the photos as reference to guide assignment of materials to shapes. By generating a large number of synthetic renderings, we train a convolutional neural network to classify materials in real photos, and employ 3D-2D alignment techniques to transfer materials to different parts of each shape model. Our system produces photorealistic, relightable, 3D shapes (PhotoShapes).
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 6; 2024: 6; 2025: 2.
21 papers.
Sort:
By area:
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
- 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 220
- 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
- 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 94
- 2023AutoDecoding Latent 3D Diffusion Modelscited by 50
- 2024L3DG: Latent 3D Gaussian Diffusioncited by 42
- 2024MaterialFusion: Enhancing Inverse Rendering with Material Diffusion Priorscited by 28
- 2023GINA-3D: Learning to Generate Implicit Neural Assets in the Wildcited by 25
- 2022PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenescited by 22
- 2024EASI-Tex: Edge-Aware Mesh Texturing from Single Imagecited by 20
9 more
- 2024NeRFs in Robotics: A Surveycited by 16
- 2023Patch-based 3D Natural Scene Generation from a Single Examplecited by 15
- 2024Looking 3D: Anomaly Detection with 2D-3D Alignmentcited by 13
- 2022Generative Deformable Radiance Fields for Disentangled Image Synthesis of Topology-Varying Objectscited by 8
- 2022Photo-to-Shape Material Transfer for Diverse Structurescited by 5
- 2025MatCLIP: Light- and Shape-Insensitive Assignment of PBR Material Modelscited by 2
- 2025MaRI: Material Retrieval Integration across Domainscited by 2
- 20233DGEN: A GAN-based approach for generating novel 3D models from image datacited by 1
- 20243D-COCO: extension of MS-COCO dataset for image detection and 3D reconstruction modulescited by 0
- 2025MaRI: Material Retrieval Integration across Domains11 Mar 2025
- 2025MatCLIP: Light- and Shape-Insensitive Assignment of PBR Material Models27 Jan 2025
- 2024L3DG: Latent 3D Gaussian Diffusion17 Oct 2024
- 2024MaterialFusion: Enhancing Inverse Rendering with Material Diffusion Priors23 Sep 2024
- 2024Looking 3D: Anomaly Detection with 2D-3D Alignment27 Jun 2024
- 2024EASI-Tex: Edge-Aware Mesh Texturing from Single Image27 May 2024
- 2024NeRFs in Robotics: A Survey2 May 2024
- 20243D-COCO: extension of MS-COCO dataset for image detection and 3D reconstruction modules8 Apr 2024
- 20233DGEN: A GAN-based approach for generating novel 3D models from image data13 Dec 2023
- 2023AutoDecoding Latent 3D Diffusion Models7 Jul 2023
- 2023Patch-based 3D Natural Scene Generation from a Single Example25 Apr 2023
- 2023GINA-3D: Learning to Generate Implicit Neural Assets in the Wild4 Apr 2023
9 more
- 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field23 Mar 2023
- 2023MVImgNet: A Large-scale Dataset of Multi-view Images10 Mar 2023
- 2022Objaverse: A Universe of Annotated 3D Objects15 Dec 2022
- 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusion2 Dec 2022
- 2022Generative Deformable Radiance Fields for Disentangled Image Synthesis of Topology-Varying Objects9 Sep 2022
- 2022PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenes2 Jul 2022
- 2022Photo-to-Shape Material Transfer for Diverse Structures9 May 2022
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields9 Dec 2021
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understanding12 Oct 2021
- 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
- 2023AutoDecoding Latent 3D Diffusion Modelscited by 50
- 2024MaterialFusion: Enhancing Inverse Rendering with Material Diffusion Priorscited by 28
- 2024EASI-Tex: Edge-Aware Mesh Texturing from Single Imagecited by 20
- 2024MaterialFusion: Enhancing Inverse Rendering with Material Diffusion Priors23 Sep 2024
- 2024EASI-Tex: Edge-Aware Mesh Texturing from Single Image27 May 2024
- 2023AutoDecoding Latent 3D Diffusion Models7 Jul 2023
- 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusion2 Dec 2022
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
- 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 220
- 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 94
- 2024L3DG: Latent 3D Gaussian Diffusioncited by 42
- 2023GINA-3D: Learning to Generate Implicit Neural Assets in the Wildcited by 25
- 2022PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenescited by 22
- 2024NeRFs in Robotics: A Surveycited by 16
- 2023Patch-based 3D Natural Scene Generation from a Single Examplecited by 15
- 2024Looking 3D: Anomaly Detection with 2D-3D Alignmentcited by 13
- 2022Generative Deformable Radiance Fields for Disentangled Image Synthesis of Topology-Varying Objectscited by 8
12 most cited of 17 All 17 (JSON)
- 2025MaRI: Material Retrieval Integration across Domains11 Mar 2025
- 2025MatCLIP: Light- and Shape-Insensitive Assignment of PBR Material Models27 Jan 2025
- 2024L3DG: Latent 3D Gaussian Diffusion17 Oct 2024
- 2024Looking 3D: Anomaly Detection with 2D-3D Alignment27 Jun 2024
- 2024NeRFs in Robotics: A Survey2 May 2024
- 20243D-COCO: extension of MS-COCO dataset for image detection and 3D reconstruction modules8 Apr 2024
- 20233DGEN: A GAN-based approach for generating novel 3D models from image data13 Dec 2023
- 2023Patch-based 3D Natural Scene Generation from a Single Example25 Apr 2023
- 2023GINA-3D: Learning to Generate Implicit Neural Assets in the Wild4 Apr 2023
- 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field23 Mar 2023
- 2023MVImgNet: A Large-scale Dataset of Multi-view Images10 Mar 2023
- 2022Objaverse: A Universe of Annotated 3D Objects15 Dec 2022
12 newest of 17 All 17 (JSON)