D2IM-Net: Learning Detail Disentangled Implicit Fields from Single Images
Not on the map. Why?
Abstract (arXiv)
We present the first single-view 3D reconstruction network aimed at recovering geometric details from an input image which encompass both topological shape structures and surface features. Our key idea is to train the network to learn a detail disentangled reconstruction consisting of two functions, one implicit field representing the coarse 3D shape and the other capturing the details. Given an input image, our network, coined D2IM-Net, encodes it into global and local features which are respectively fed into two decoders. The base decoder uses the global features to reconstruct a coarse implicit field, while the detail decoder reconstructs, from the local features, two displacement maps, defined over the front and back sides of the captured object. The final 3D reconstruction is a fusion between the base shape and the displacement maps, with three losses enforcing the recovery of coarse shape, overall structure, and surface details via a novel Laplacian term.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 9; 2023: 15; 2024: 7; 2025: 5; 2026: 1.
42 papers.
Sort:
By area:
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
- 2022HF-NeuS: Improved Surface Reconstruction Using High-Frequency Detailscited by 120
- 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
- 2021Geometry-Consistent Neural Shape Representation with Implicit Displacement Fieldscited by 60
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshescited by 34
- 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulationcited by 27
- 2022ANISE: Assembly-based Neural Implicit Surface rEconstructioncited by 16
- 2023Cross-domain Compositing with Pretrained Diffusion Modelscited by 13
- 2023Slice3D: Multi-Slice, Occlusion-Revealing, Single View 3D Reconstructioncited by 13
- 2023DeFormer: Integrating Transformers with Deformable Models for 3D Shape Abstraction from a Single Imagecited by 11
- 2021Object Wake-up: 3D Object Rigging from a Single Imagecited by 8
30 more
- 2022PatchRD: Detail-Preserving Shape Completion by Learning Patch Retrieval and Deformationcited by 7
- 2023Deformable Model-Driven Neural Rendering for High-Fidelity 3D Reconstruction of Human Heads Under Low-View Settingscited by 7
- 2023LIST: Learning Implicitly from Spatial Transformers for Single-View 3D Reconstructioncited by 6
- 2024SweepNet: Unsupervised Learning Shape Abstraction via Neural Sweeperscited by 5
- 2023Parameterization-driven Neural Surface Reconstruction for Object-oriented Editing in Neural Renderingcited by 4
- 2022VPFusion: Joint 3D Volume and Pixel-Aligned Feature Fusion for Single and Multi-view 3D Reconstructioncited by 3
- 2023A Review of Deep Learning-Powered Mesh Reconstruction Methodscited by 3
- 2023Attention-based Part Assembly for 3D Volumetric Shape Modelingcited by 3
- 2022ARO-Net: Learning Implicit Fields from Anchored Radial Observationscited by 2
- 2023Self-supervised Adaptive Pre-training of Multilingual Speech Models for Language and Dialect Identificationcited by 2
- 2021Neural Implicit 3D Shapes from Single Images with Spatial Patternscited by 0
- 2021Signal Transformer: Complex-valued Attention and Meta-Learning for Signal Recognitioncited by 0
- 2022Inferring Implicit 3D Representations from Human Figures on Pictorial Mapscited by 0
- 2023Analysis of Sampling Strategies for Implicit 3D Reconstructioncited by 0
- 2023Pix2Repair: Implicit Shape Restoration from Imagescited by 0
- 2023Enhancing Multilingual Speech Recognition through Language Prompt Tuning and Frame-Level Language Adaptercited by 0
- 2023GMTR: Graph Matching Transformerscited by 0
- 2023DarkShot: Lighting Dark Images with Low-Compute and High-Qualitycited by 0
- 2024TRLS: A Time Series Representation Learning Framework via Spectrogram for Medical Signal Processingcited by 0
- 2024TEN-GUARD: Tensor Decomposition for Backdoor Attack Detection in Deep Neural Networkscited by 0
- 2024T-Pixel2Mesh: Combining Global and Local Transformer for 3D Mesh Generation from a Single Imagecited by 0
- 2024Strategic Arms with Side Communication Prevail Over Low-Regret MAB Algorithmscited by 0
- 2024Towards General Deepfake Detection with Dynamic Curriculumcited by 0
- 2024Attr-Int: A Simple and Effective Entity Alignment Framework for Heterogeneous Knowledge Graphscited by 0
- 2025Realistic Clothed Human and Object Joint Reconstruction from a Single Imagecited by 0
- 2025X2BR: High-Fidelity 3D Bone Reconstruction from a Planar X-Ray Image with Hybrid Neural Implicit Methodscited by 0
- 2025Mask6D: Masked Pose Priors For 6D Object Pose Estimationcited by 0
- 2025HPR3D: Hierarchical Proxy Representation for High-Fidelity 3D Reconstruction and Controllable Editingcited by 0
- 2025Radar2Shape: 3D Shape Reconstruction from High-Frequency Radar using Multiresolution Signed Distance Functionscited by 0
- 2026Appearance-Preserving Refinement of Generated 3D Assets for Monochromatic Fabricationcited by 0
- 2026Appearance-Preserving Refinement of Generated 3D Assets for Monochromatic Fabrication25 Jun 2026
- 2025Radar2Shape: 3D Shape Reconstruction from High-Frequency Radar using Multiresolution Signed Distance Functions21 Nov 2025
- 2025HPR3D: Hierarchical Proxy Representation for High-Fidelity 3D Reconstruction and Controllable Editing16 Jul 2025
- 2025Mask6D: Masked Pose Priors For 6D Object Pose Estimation9 Jul 2025
- 2025X2BR: High-Fidelity 3D Bone Reconstruction from a Planar X-Ray Image with Hybrid Neural Implicit Methods11 Apr 2025
- 2025Realistic Clothed Human and Object Joint Reconstruction from a Single Image25 Feb 2025
- 2024Attr-Int: A Simple and Effective Entity Alignment Framework for Heterogeneous Knowledge Graphs17 Oct 2024
- 2024Towards General Deepfake Detection with Dynamic Curriculum15 Oct 2024
- 2024Strategic Arms with Side Communication Prevail Over Low-Regret MAB Algorithms30 Aug 2024
- 2024SweepNet: Unsupervised Learning Shape Abstraction via Neural Sweepers8 Jul 2024
- 2024T-Pixel2Mesh: Combining Global and Local Transformer for 3D Mesh Generation from a Single Image20 Mar 2024
- 2024TEN-GUARD: Tensor Decomposition for Backdoor Attack Detection in Deep Neural Networks6 Jan 2024
30 more
- 2024TRLS: A Time Series Representation Learning Framework via Spectrogram for Medical Signal Processing6 Jan 2024
- 2023DarkShot: Lighting Dark Images with Low-Compute and High-Quality28 Dec 2023
- 2023Self-supervised Adaptive Pre-training of Multilingual Speech Models for Language and Dialect Identification12 Dec 2023
- 2023Slice3D: Multi-Slice, Occlusion-Revealing, Single View 3D Reconstruction3 Dec 2023
- 2023GMTR: Graph Matching Transformers14 Nov 2023
- 2023Parameterization-driven Neural Surface Reconstruction for Object-oriented Editing in Neural Rendering9 Oct 2023
- 2023DeFormer: Integrating Transformers with Deformable Models for 3D Shape Abstraction from a Single Image22 Sep 2023
- 2023Enhancing Multilingual Speech Recognition through Language Prompt Tuning and Frame-Level Language Adapter18 Sep 2023
- 2023LIST: Learning Implicitly from Spatial Transformers for Single-View 3D Reconstruction23 Jul 2023
- 2023Pix2Repair: Implicit Shape Restoration from Images29 May 2023
- 2023Attention-based Part Assembly for 3D Volumetric Shape Modeling17 Apr 2023
- 2023Analysis of Sampling Strategies for Implicit 3D Reconstruction8 Apr 2023
- 2023Deformable Model-Driven Neural Rendering for High-Fidelity 3D Reconstruction of Human Heads Under Low-View Settings24 Mar 2023
- 2023A Review of Deep Learning-Powered Mesh Reconstruction Methods6 Mar 2023
- 2023Cross-domain Compositing with Pretrained Diffusion Models20 Feb 2023
- 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulation1 Feb 2023
- 2022ARO-Net: Learning Implicit Fields from Anchored Radial Observations19 Dec 2022
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generation19 Sep 2022
- 2022Inferring Implicit 3D Representations from Human Figures on Pictorial Maps30 Aug 2022
- 2022PatchRD: Detail-Preserving Shape Completion by Learning Patch Retrieval and Deformation24 Jul 2022
- 2022HF-NeuS: Improved Surface Reconstruction Using High-Frequency Details15 Jun 2022
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshes10 Jun 2022
- 2022ANISE: Assembly-based Neural Implicit Surface rEconstruction27 May 2022
- 2022Towards Implicit Text-Guided 3D Shape Generation28 Mar 2022
- 2022VPFusion: Joint 3D Volume and Pixel-Aligned Feature Fusion for Single and Multi-view 3D Reconstruction14 Mar 2022
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesis8 Nov 2021
- 2021Object Wake-up: 3D Object Rigging from a Single Image5 Aug 2021
- 2021Geometry-Consistent Neural Shape Representation with Implicit Displacement Fields9 Jun 2021
- 2021Neural Implicit 3D Shapes from Single Images with Spatial Patterns6 Jun 2021
- 2021Signal Transformer: Complex-valued Attention and Meta-Learning for Signal Recognition5 Jun 2021
- 2023Cross-domain Compositing with Pretrained Diffusion Modelscited by 13
- 2023Cross-domain Compositing with Pretrained Diffusion Models20 Feb 2023
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
- 2022HF-NeuS: Improved Surface Reconstruction Using High-Frequency Detailscited by 120
- 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
- 2021Geometry-Consistent Neural Shape Representation with Implicit Displacement Fieldscited by 60
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshescited by 34
- 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulationcited by 27
- 2022ANISE: Assembly-based Neural Implicit Surface rEconstructioncited by 16
- 2023Slice3D: Multi-Slice, Occlusion-Revealing, Single View 3D Reconstructioncited by 13
- 2023DeFormer: Integrating Transformers with Deformable Models for 3D Shape Abstraction from a Single Imagecited by 11
- 2021Object Wake-up: 3D Object Rigging from a Single Imagecited by 8
- 2022PatchRD: Detail-Preserving Shape Completion by Learning Patch Retrieval and Deformationcited by 7
12 most cited of 41 All 41 (JSON)
- 2026Appearance-Preserving Refinement of Generated 3D Assets for Monochromatic Fabrication25 Jun 2026
- 2025Radar2Shape: 3D Shape Reconstruction from High-Frequency Radar using Multiresolution Signed Distance Functions21 Nov 2025
- 2025HPR3D: Hierarchical Proxy Representation for High-Fidelity 3D Reconstruction and Controllable Editing16 Jul 2025
- 2025Mask6D: Masked Pose Priors For 6D Object Pose Estimation9 Jul 2025
- 2025X2BR: High-Fidelity 3D Bone Reconstruction from a Planar X-Ray Image with Hybrid Neural Implicit Methods11 Apr 2025
- 2025Realistic Clothed Human and Object Joint Reconstruction from a Single Image25 Feb 2025
- 2024Attr-Int: A Simple and Effective Entity Alignment Framework for Heterogeneous Knowledge Graphs17 Oct 2024
- 2024Towards General Deepfake Detection with Dynamic Curriculum15 Oct 2024
- 2024Strategic Arms with Side Communication Prevail Over Low-Regret MAB Algorithms30 Aug 2024
- 2024SweepNet: Unsupervised Learning Shape Abstraction via Neural Sweepers8 Jul 2024
- 2024T-Pixel2Mesh: Combining Global and Local Transformer for 3D Mesh Generation from a Single Image20 Mar 2024
- 2024TEN-GUARD: Tensor Decomposition for Backdoor Attack Detection in Deep Neural Networks6 Jan 2024
12 newest of 41 All 41 (JSON)