Geometry-Consistent Neural Shape Representation with Implicit Displacement Fields
Not on the map. Why?
Abstract (arXiv)
We present implicit displacement fields, a novel representation for detailed 3D geometry. Inspired by a classic surface deformation technique, displacement mapping, our method represents a complex surface as a smooth base surface plus a displacement along the base's normal directions, resulting in a frequency-based shape decomposition, where the high frequency signal is constrained geometrically by the low frequency signal. Importantly, this disentanglement is unsupervised thanks to a tailored architectural design that has an innate frequency hierarchy by construction. We explore implicit displacement field surface reconstruction and detail transfer and demonstrate superior representational power, training stability and generalizability.
Key facts. Cited by 60 papers in the map (data through 14 Oct 2026). Builds on 38 of its 62 references that are in the map. First posted on arXiv 9 Jun 2021.
Builds on
38 of 62 references.
References · 38
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2020Neural Sparse Voxel Fieldscited by 959
26 more
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020Convolutional Occupancy Networkscited by 761
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2020Local Implicit Grid Representations for 3D Scenescited by 373
- 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 206
- 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
- 2016Thingi10K: A Dataset of 10,000 3D-Printing Modelscited by 183
- 2018Training behavior of deep neural network in frequency domaincited by 174
- 2019CvxNet: Learnable Convex Decompositioncited by 174
- 2019NASA: Neural Articulated Shape Approximationcited by 149
- 2020Frequency Bias in Neural Networks for Input of Non-Uniform Densitycited by 140
- 2020Adversarial Generation of Continuous Imagescited by 135
- 2019Neural Cages for Detail-Preserving 3D Deformationscited by 106
- 2020DualSDF: Semantic Shape Manipulation using a Two-Level Representationcited by 82
- 2020PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representationscited by 81
- 2020Deep Geometric Texture Synthesiscited by 51
- 2020DECOR-GAN: 3D Shape Detailization by Conditional Refinementcited by 45
- 2018Understanding training and generalization in deep learning by Fourier analysiscited by 44
- 2020D2IM-Net: Learning Detail Disentangled Implicit Fields from Single Imagescited by 42
Built on by
Citing papers per year: 2021: 6; 2022: 11; 2023: 14; 2024: 16; 2025: 10; 2026: 3.
60 papers.
Sort:
By area:
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2021Advances in Neural Renderingcited by 365
- 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 143
- 2022HF-NeuS: Improved Surface Reconstruction Using High-Frequency Detailscited by 121
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
- 2021DiGS : Divergence guided shape implicit neural representation for unoriented point cloudscited by 77
- 2024Advances in 3D Generation: A Surveycited by 63
- 2022Physics Informed Neural Fields for Smoke Reconstruction with Sparse Datacited by 52
- 2023Neural-Singular-Hessian: Implicit Neural Representation of Unoriented Point Clouds by Enforcing Singular Hessiancited by 35
- 2023GETAvatar: Generative Textured Meshes for Animatable Human Avatarscited by 27
- 2021Unsupervised Learning of Fine Structure Generation for 3D Point Clouds by 2D Projection Matchingcited by 26
- 2022Residual Multiplicative Filter Networks for Multiscale Reconstructioncited by 25
38 more
- 2023Robust Zero Level-Set Extraction from Unsigned Distance Fields Based on Double Coveringcited by 22
- 2022MINER: Multiscale Implicit Neural Representationscited by 20
- 2022Intrinsic Neural Fields: Learning Functions on Manifoldscited by 20
- 2022PINs: Progressive Implicit Networks for Multi-Scale Neural Representationscited by 19
- 2024Tuning the Frequencies: Robust Training for Sinusoidal Neural Networkscited by 19
- 2022NeuForm: Adaptive Overfitting for Neural Shape Editingcited by 18
- 2023Text2Scene: Text-driven Indoor Scene Stylization with Part-aware Detailscited by 18
- 2024URHand: Universal Relightable Handscited by 17
- 2023AvatarStudio: High-fidelity and Animatable 3D Avatar Creation from Textcited by 16
- 2024NeurCADRecon: Neural Representation for Reconstructing CAD Surfaces by Enforcing Zero Gaussian Curvaturecited by 12
- 2022Spelunking the Deep: Guaranteed Queries on General Neural Implicit Surfaces via Range Analysiscited by 11
- 2023ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 10
- 2022Neural Convolutional Surfacescited by 9
- 2024NeurCross: A Neural Approach to Computing Cross Fields for Quad Mesh Generationcited by 9
- 2024Neural Experts: Mixture of Experts for Implicit Neural Representationscited by 9
- 20232S-UDF: A Novel Two-stage UDF Learning Method for Robust Non-watertight Model Reconstruction from Multi-view Imagescited by 8
- 2023Deformable Model-Driven Neural Rendering for High-Fidelity 3D Reconstruction of Human Heads Under Low-View Settingscited by 7
- 2023NeuroGF: A Neural Representation for Fast Geodesic Distance and Path Queriescited by 7
- 2024Details Enhancement in Unsigned Distance Field Learning for High-fidelity 3D Surface Reconstructioncited by 7
- 2024Implicit Filtering for Learning Neural Signed Distance Functions from 3D Point Cloudscited by 7
- 2022ROAD: Learning an Implicit Recursive Octree Auto-Decoder to Efficiently Encode 3D Shapescited by 6
- 2023OrthoPlanes: A Novel Representation for Better 3D-Awareness of GANscited by 6
- 2025ART-DECO: Arbitrary Text Guidance for 3D Detailizer Constructioncited by 6
- 2023Harnessing Low-Frequency Neural Fields for Few-Shot View Synthesiscited by 5
- 2023Parameterization-driven Neural Surface Reconstruction for Object-oriented Editing in Neural Renderingcited by 4
- 2024DCUDF2: Improving Efficiency and Accuracy in Extracting Zero Level Sets from Unsigned Distance Fieldscited by 4
- 2025Geometric implicit neural representations for signed distance functionscited by 4
- 2024ImplicitTerrain: a Continuous Surface Model for Terrain Data Analysiscited by 3
- 2024Slot-guided Volumetric Object Radiance Fieldscited by 2
- 2024ReFiNe: Recursive Field Networks for Cross-modal Multi-scene Representationcited by 2
- 2024A Latent Implicit 3D Shape Model for Multiple Levels of Detailcited by 2
- 2025Mesh Compression with Quantized Neural Displacement Fieldscited by 2
- 2025Low-Rank Adaptation of Neural Fieldscited by 2
- 2024NeRF-Texture: Synthesizing Neural Radiance Field Texturescited by 1
- 2025VI3NR: Variance Informed Initialization for Implicit Neural Representationscited by 1
- 2025A Divide-and-Conquer Approach for Global Orientation of Non-Watertight Scene-Level Point Clouds Using 0-1 Integer Optimizationcited by 1
- 2025NeuVAS: Neural Implicit Surfaces for Variational Shape Modelingcited by 1
- 2025Hierarchical Neural Surfaces for 3D Mesh Compressioncited by 1
50 most cited of 60 All 60 (JSON)
- 2026M-plicits: Neural Implicit Surfaces via Nested Multiscale Residuals23 Sep 2026
- 2026Appearance-Preserving Refinement of Generated 3D Assets for Monochromatic Fabrication25 Jun 2026
- 2026SharpNet: Enhancing MLPs to Represent Functions with Controlled Non-differentiability27 Jan 2026
- 2025Hierarchical Neural Surfaces for 3D Mesh Compression17 Dec 2025
- 2025Geometric implicit neural representations for signed distance functions10 Nov 2025
- 2025Adaptive Training of INRs via Pruning and Densification27 Oct 2025
- 2025NeuVAS: Neural Implicit Surfaces for Variational Shape Modeling16 Jun 2025
- 2025MIND: Material Interface Generation from UDFs for Non-Manifold Surface Reconstruction3 Jun 2025
- 2025A Divide-and-Conquer Approach for Global Orientation of Non-Watertight Scene-Level Point Clouds Using 0-1 Integer Optimization29 May 2025
- 2025ART-DECO: Arbitrary Text Guidance for 3D Detailizer Construction26 May 2025
- 2025VI3NR: Variance Informed Initialization for Implicit Neural Representations27 Apr 2025
- 2025Low-Rank Adaptation of Neural Fields22 Apr 2025
38 more
- 2025Mesh Compression with Quantized Neural Displacement Fields28 Mar 2025
- 2024NeRF-Texture: Synthesizing Neural Radiance Field Textures13 Dec 2024
- 2024Geometry Distributions25 Nov 2024
- 2024Neural Experts: Mixture of Experts for Implicit Neural Representations29 Oct 2024
- 2024A Latent Implicit 3D Shape Model for Multiple Levels of Detail10 Sep 2024
- 2024NESI: Shape Representation via Neural Explicit Surface Intersection9 Sep 2024
- 2024DCUDF2: Improving Efficiency and Accuracy in Extracting Zero Level Sets from Unsigned Distance Fields30 Aug 2024
- 2024Tuning the Frequencies: Robust Training for Sinusoidal Neural Networks30 Jul 2024
- 2024Implicit Filtering for Learning Neural Signed Distance Functions from 3D Point Clouds18 Jul 2024
- 2024ReFiNe: Recursive Field Networks for Cross-modal Multi-scene Representation6 Jun 2024
- 2024Details Enhancement in Unsigned Distance Field Learning for High-fidelity 3D Surface Reconstruction1 Jun 2024
- 2024ImplicitTerrain: a Continuous Surface Model for Terrain Data Analysis31 May 2024
- 2024NeurCross: A Neural Approach to Computing Cross Fields for Quad Mesh Generation22 May 2024
- 2024NeurCADRecon: Neural Representation for Reconstructing CAD Surfaces by Enforcing Zero Gaussian Curvature20 Apr 2024
- 2024Advances in 3D Generation: A Survey31 Jan 2024
- 2024URHand: Universal Relightable Hands10 Jan 2024
- 2024Slot-guided Volumetric Object Radiance Fields4 Jan 2024
- 2023ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representations7 Dec 2023
- 2023AvatarStudio: High-fidelity and Animatable 3D Avatar Creation from Text29 Nov 2023
- 2023HYVE: Hybrid Vertex Encoder for Neural Distance Fields10 Oct 2023
- 2023Parameterization-driven Neural Surface Reconstruction for Object-oriented Editing in Neural Rendering9 Oct 2023
- 2023Robust Zero Level-Set Extraction from Unsigned Distance Fields Based on Double Covering5 Oct 2023
- 2023GETAvatar: Generative Textured Meshes for Animatable Human Avatars4 Oct 2023
- 2023OrthoPlanes: A Novel Representation for Better 3D-Awareness of GANs27 Sep 2023
- 2023Neural-Singular-Hessian: Implicit Neural Representation of Unoriented Point Clouds by Enforcing Singular Hessian4 Sep 2023
- 2023Text2Scene: Text-driven Indoor Scene Stylization with Part-aware Details31 Aug 2023
- 2023NeuroGF: A Neural Representation for Fast Geodesic Distance and Path Queries1 Jun 2023
- 2023CN-DHF: Compact Neural Double Height-Field Representations of 3D Shapes29 Mar 2023
- 20232S-UDF: A Novel Two-stage UDF Learning Method for Robust Non-watertight Model Reconstruction from Multi-view Images27 Mar 2023
- 2023Deformable Model-Driven Neural Rendering for High-Fidelity 3D Reconstruction of Human Heads Under Low-View Settings24 Mar 2023
- 2023Harnessing Low-Frequency Neural Fields for Few-Shot View Synthesis15 Mar 2023
- 2022ROAD: Learning an Implicit Recursive Octree Auto-Decoder to Efficiently Encode 3D Shapes12 Dec 2022
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collections10 Oct 2022
- 2022NeuForm: Adaptive Overfitting for Neural Shape Editing18 Jul 2022
- 2022HF-NeuS: Improved Surface Reconstruction Using High-Frequency Details15 Jun 2022
- 2022Physics Informed Neural Fields for Smoke Reconstruction with Sparse Data14 Jun 2022
- 2022Residual Multiplicative Filter Networks for Multiscale Reconstruction1 Jun 2022
- 2022Neural Convolutional Surfaces5 Apr 2022
50 newest of 60 All 60 (JSON)
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2021Advances in Neural Renderingcited by 365
- 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 143
- 2022HF-NeuS: Improved Surface Reconstruction Using High-Frequency Detailscited by 121
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
- 2021DiGS : Divergence guided shape implicit neural representation for unoriented point cloudscited by 77
- 2024Advances in 3D Generation: A Surveycited by 63
- 2022Physics Informed Neural Fields for Smoke Reconstruction with Sparse Datacited by 52
- 2023Neural-Singular-Hessian: Implicit Neural Representation of Unoriented Point Clouds by Enforcing Singular Hessiancited by 35
- 2023GETAvatar: Generative Textured Meshes for Animatable Human Avatarscited by 27
- 2021Unsupervised Learning of Fine Structure Generation for 3D Point Clouds by 2D Projection Matchingcited by 26
- 2022Residual Multiplicative Filter Networks for Multiscale Reconstructioncited by 25
12 most cited of 58 All 58 (JSON)
- 2026M-plicits: Neural Implicit Surfaces via Nested Multiscale Residuals23 Sep 2026
- 2026Appearance-Preserving Refinement of Generated 3D Assets for Monochromatic Fabrication25 Jun 2026
- 2026SharpNet: Enhancing MLPs to Represent Functions with Controlled Non-differentiability27 Jan 2026
- 2025Hierarchical Neural Surfaces for 3D Mesh Compression17 Dec 2025
- 2025Geometric implicit neural representations for signed distance functions10 Nov 2025
- 2025Adaptive Training of INRs via Pruning and Densification27 Oct 2025
- 2025NeuVAS: Neural Implicit Surfaces for Variational Shape Modeling16 Jun 2025
- 2025MIND: Material Interface Generation from UDFs for Non-Manifold Surface Reconstruction3 Jun 2025
- 2025A Divide-and-Conquer Approach for Global Orientation of Non-Watertight Scene-Level Point Clouds Using 0-1 Integer Optimization29 May 2025
- 2025ART-DECO: Arbitrary Text Guidance for 3D Detailizer Construction26 May 2025
- 2025VI3NR: Variance Informed Initialization for Implicit Neural Representations27 Apr 2025
- 2025Low-Rank Adaptation of Neural Fields22 Apr 2025
12 newest of 58 All 58 (JSON)