Deep Learning on Implicit Neural Representations of Shapes
Not on the map. Why?
Abstract (arXiv)
Implicit Neural Representations (INRs) have emerged in the last few years as a powerful tool to encode continuously a variety of different signals like images, videos, audio and 3D shapes. When applied to 3D shapes, INRs allow to overcome the fragmentation and shortcomings of the popular discrete representations used so far. Yet, considering that INRs consist in neural networks, it is not clear whether and how it may be possible to feed them into deep learning pipelines aimed at solving a downstream task. In this paper, we put forward this research problem and propose inr2vec, a framework that can compute a compact latent representation for an input INR in a single inference pass. We verify that inr2vec can embed effectively the 3D shapes represented by the input INRs and show how the produced embeddings can be fed into deep learning pipelines to solve several tasks by processing exclusively INRs.
Key facts. Cited by 63 papers in the map (data through 14 Oct 2026). Builds on 77 of its 106 references that are in the map. First posted on arXiv 10 Feb 2023.
Builds on
77 of 106 references.
References · 77
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
38 more
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2020Point Transformercited by 1,470
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
- 2020Convolutional Occupancy Networkscited by 761
- 2020PCT: Point cloud transformercited by 732
- 2018Open3D: A Modern Library for 3D Data Processingcited by 721
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
- 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 657
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
- 2022Git Re-Basin: Merging Models modulo Permutation Symmetriescited by 471
- 2016Geometric deep learning on graphs and manifolds using mixture model CNNscited by 468
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
- 2020Local Implicit Grid Representations for 3D Scenescited by 373
- 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
- 2021The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networkscited by 291
- 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
- 2018SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filterscited by 261
- 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 260
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2016Volumetric and Multi-View CNNs for Object Classification on 3D Datacited by 240
- 2021COIN: COmpression with Implicit Neural representationscited by 233
- 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
- 2021PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Cloudscited by 211
- 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
- 2022From data to functa: Your data point is a function and you can treat it like onecited by 187
- 2016Learning a Predictable and Generative Vector Representation for Objectscited by 173
- 2021Implicit Neural Representations for Image Compressioncited by 162
50 most cited of 77 All 77 (JSON)
Built on by
Citing papers per year: 2023: 10; 2024: 20; 2025: 20; 2026: 13.
63 papers.
Sort:
By area:
- 2023Permutation Equivariant Neural Functionalscited by 70
- 2024Graph Neural Networks for Learning Equivariant Representations of Neural Networkscited by 59
- 2023Graph Metanetworks for Processing Diverse Neural Architecturescited by 57
- 2023Neural Functional Transformerscited by 52
- 2024Towards Scalable and Versatile Weight Space Learningcited by 41
- 2024Universal Neural Functionalscited by 26
- 2024Scale Equivariant Graph Metanetworkscited by 24
- 2024Grounding Continuous Representations in Geometry: Equivariant Neural Fieldscited by 19
- 2024Monomial Matrix Group Equivariant Neural Functional Networkscited by 17
- 2024Deep Linear Probe Generators for Weight Space Learningcited by 17
- 2024FancyVideo: Towards Dynamic and Consistent Video Generation via Cross-frame Textual Guidancecited by 15
- 2023RayDF: Neural Ray-surface Distance Fields with Multi-view Consistencycited by 12
38 more
- 2024Implicit-Zoo: A Large-Scale Dataset of Neural Implicit Functions for 2D Images and 3D Scenescited by 12
- 2023Set-based Neural Network Encoding Without Weight Tyingcited by 9
- 2023Neural Processing of Tri-Plane Hybrid Neural Fieldscited by 8
- 2023In Search of a Data Transformation That Accelerates Neural Field Trainingcited by 7
- 2025End-to-End Implicit Neural Representations for Classificationcited by 7
- 2024Connecting NeRFs, Images, and Textcited by 6
- 2024LLaNA: Large Language and NeRF Assistantcited by 6
- 2025Structure Is Not Enough: Leveraging Behavior for Neural Network Weight Reconstructioncited by 6
- 2025Geometry aware inference of steady state PDEs using Equivariant Neural Fields representationscited by 6
- 2023Deep Learning on Object-centric 3D Neural Fieldscited by 5
- 2024Explaining the Implicit Neural Canvas: Connecting Pixels to Neurons by Tracing their Contributionscited by 5
- 2024Physics-informed Neural Networks for Functional Differential Equations: Cylindrical Approximation and Its Convergence Guaranteescited by 5
- 2025Weight-Space Linear Recurrent Neural Networkscited by 5
- 2024Neural Metamorphosiscited by 4
- 2023Text-guided Image-and-Shape Editing and Generation: A Short Surveycited by 3
- 2024Neural Video Representation for Redundancy Reduction and Consistency Preservationcited by 3
- 2025ARC: Anchored Representation Clouds for High-Resolution INR Classificationcited by 3
- 2025A Model Zoo on Phase Transitions in Neural Networkscited by 3
- 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
- 2024Transport of Algebraic Structure to Latent Embeddingscited by 2
- 2024Diff-INR: Generative Regularization for Electrical Impedance Tomographycited by 2
- 2025Few-shot Implicit Function Generation via Equivariancecited by 2
- 2025Neural Functions for Learning Periodic Signalcited by 2
- 2025Meta-learning Structure-Preserving Dynamicscited by 2
- 2024SpikeMM: Flexi-Magnification of High-Speed Micro-Motionscited by 1
- 2024Selective Test-Time Adaptation for Unsupervised Anomaly Detection using Neural Implicit Representationscited by 1
- 2025Boosting 3D Liver Shape Datasets with Diffusion Models and Implicit Neural Representationscited by 1
- 2025NeuroVoxel-LM: Language-Aligned 3D Perception via Dynamic Voxelization and Meta-Embeddingcited by 1
- 2026Ensuring Semantics in Weights of Implicit Neural Representations through the Implicit Function Theoremcited by 1
- 2026Quasi-Equivariant Metanetworkscited by 1
- 2026Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shadingcited by 1
- 2026Dynamic Neural Graph Encoding of Inference Processes in Deep Weight Spacecited by 1
- 2023Contextualising Implicit Representations for Semantic Taskscited by 0
- 2024Hyper-Representations: Learning from Populations of Neural Networkscited by 0
- 2025MorphoSkel3D: Morphological Skeletonization of 3D Point Clouds for Informed Sampling in Object Classification and Retrievalcited by 0
- 2025INRet: A General Framework for Accurate Retrieval of INRs for Shapescited by 0
- 2025Can We Optimize Deep RL Policy Weights as Trajectory Modeling?cited by 0
- 2025On the Internal Representations of Graph Metanetworkscited by 0
50 most cited of 63 All 63 (JSON)
- 2026Temporal Geometry of Deep Networks: Hyperbolic Representations of Training Dynamics for Intrinsic Explainability2 Oct 2026
- 2026Implicit representations are dead. Long live explicit primitives!7 Aug 2026
- 2026Weight-Space Mixture-of-Experts for Implicit Neural Representation Classification31 Jul 2026
- 2026Observable- and Positional-Encoding-Dependent Symmetry Readout from Neural Network Weights3 Jul 2026
- 2026Dynamic Neural Graph Encoding of Inference Processes in Deep Weight Space2 Jul 2026
- 2026Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shading26 Jun 2026
- 2026A Principled Self-Referenced Early Stopping Approach for Deep Image Prior24 May 2026
- 2026Learning Orthonormal Bases for Function Spaces19 May 2026
- 2026Quasi-Equivariant Metanetworks26 Apr 2026
- 2026Synthesis of Late Gadolinium Enhancement Images via Implicit Neural Representations for Cardiac Scar Segmentation12 Feb 2026
- 2026Escaping Spectral Bias without Backpropagation: Fast Implicit Neural Representations with Extreme Learning Machines7 Feb 2026
- 2026Ensuring Semantics in Weights of Implicit Neural Representations through the Implicit Function Theorem30 Jan 2026
38 more
- 2026Deep Sketch-Based 3D Modeling: A Survey22 Jan 2026
- 2025Metanetworks as Regulatory Operators: Learning to Edit for Requirement Compliance17 Dec 2025
- 2025Symmetry-Aware Graph Metanetwork Autoencoders: Model Merging through Parameter Canonicalization16 Nov 2025
- 2025A Non-Adversarial Approach to Idempotent Generative Modelling4 Nov 2025
- 2025Semi-disentangled spatiotemporal implicit neural representations of longitudinal neuroimaging data for trajectory classification11 Oct 2025
- 2025Meta-learning Structure-Preserving Dynamics15 Aug 2025
- 2025NeuroVoxel-LM: Language-Aligned 3D Perception via Dynamic Voxelization and Meta-Embedding27 Jul 2025
- 2025Neural Functions for Learning Periodic Signal11 Jun 2025
- 2025Weight-Space Linear Recurrent Neural Networks1 Jun 2025
- 2025Boosting 3D Liver Shape Datasets with Diffusion Models and Implicit Neural Representations28 Apr 2025
- 2025A Model Zoo on Phase Transitions in Neural Networks25 Apr 2025
- 2025Geometry aware inference of steady state PDEs using Equivariant Neural Fields representations24 Apr 2025
- 2025Scaling LLaNA: Advancing NeRF-Language Understanding Through Large-Scale Training18 Apr 2025
- 2025End-to-End Implicit Neural Representations for Classification23 Mar 2025
- 2025Structure Is Not Enough: Leveraging Behavior for Neural Network Weight Reconstruction21 Mar 2025
- 2025ARC: Anchored Representation Clouds for High-Resolution INR Classification19 Mar 2025
- 2025On the Internal Representations of Graph Metanetworks12 Mar 2025
- 2025Can We Optimize Deep RL Policy Weights as Trajectory Modeling?6 Mar 2025
- 2025INRet: A General Framework for Accurate Retrieval of INRs for Shapes27 Jan 2025
- 2025MorphoSkel3D: Morphological Skeletonization of 3D Point Clouds for Informed Sampling in Object Classification and Retrieval22 Jan 2025
- 2025Few-shot Implicit Function Generation via Equivariance3 Jan 2025
- 2024Physics-informed Neural Networks for Functional Differential Equations: Cylindrical Approximation and Its Convergence Guarantees23 Oct 2024
- 2024Deep Linear Probe Generators for Weight Space Learning14 Oct 2024
- 2024Neural Metamorphosis10 Oct 2024
- 2024Hyper-Representations: Learning from Populations of Neural Networks7 Oct 2024
- 2024Selective Test-Time Adaptation for Unsupervised Anomaly Detection using Neural Implicit Representations4 Oct 2024
- 2024Neural Video Representation for Redundancy Reduction and Consistency Preservation27 Sep 2024
- 2024Monomial Matrix Group Equivariant Neural Functional Networks18 Sep 2024
- 2024Diff-INR: Generative Regularization for Electrical Impedance Tomography6 Sep 2024
- 2024FancyVideo: Towards Dynamic and Consistent Video Generation via Cross-frame Textual Guidance15 Aug 2024
- 2024Implicit-Zoo: A Large-Scale Dataset of Neural Implicit Functions for 2D Images and 3D Scenes25 Jun 2024
- 2024LLaNA: Large Language and NeRF Assistant17 Jun 2024
- 2024Scale Equivariant Graph Metanetworks15 Jun 2024
- 2024Towards Scalable and Versatile Weight Space Learning14 Jun 2024
- 2024Grounding Continuous Representations in Geometry: Equivariant Neural Fields9 Jun 2024
- 2024SpikeMM: Flexi-Magnification of High-Speed Micro-Motions1 Jun 2024
- 2024Transport of Algebraic Structure to Latent Embeddings27 May 2024
- 2024Connecting NeRFs, Images, and Text11 Apr 2024
50 newest of 63 All 63 (JSON)
- 2025Boosting 3D Liver Shape Datasets with Diffusion Models and Implicit Neural Representationscited by 1
- 2026Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shadingcited by 1
- 2026Synthesis of Late Gadolinium Enhancement Images via Implicit Neural Representations for Cardiac Scar Segmentationcited by 0
- 2026Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shading26 Jun 2026
- 2026Synthesis of Late Gadolinium Enhancement Images via Implicit Neural Representations for Cardiac Scar Segmentation12 Feb 2026
- 2025Boosting 3D Liver Shape Datasets with Diffusion Models and Implicit Neural Representations28 Apr 2025
- 2024Deep Linear Probe Generators for Weight Space Learningcited by 17
- 2024Deep Linear Probe Generators for Weight Space Learning14 Oct 2024
- 2023Permutation Equivariant Neural Functionalscited by 70
- 2024Graph Neural Networks for Learning Equivariant Representations of Neural Networkscited by 59
- 2023Graph Metanetworks for Processing Diverse Neural Architecturescited by 57
- 2023Neural Functional Transformerscited by 52
- 2024Towards Scalable and Versatile Weight Space Learningcited by 41
- 2024Universal Neural Functionalscited by 26
- 2024Scale Equivariant Graph Metanetworkscited by 24
- 2024Grounding Continuous Representations in Geometry: Equivariant Neural Fieldscited by 19
- 2024Monomial Matrix Group Equivariant Neural Functional Networkscited by 17
- 2024FancyVideo: Towards Dynamic and Consistent Video Generation via Cross-frame Textual Guidancecited by 15
- 2023RayDF: Neural Ray-surface Distance Fields with Multi-view Consistencycited by 12
- 2024Implicit-Zoo: A Large-Scale Dataset of Neural Implicit Functions for 2D Images and 3D Scenescited by 12
12 most cited of 54 All 54 (JSON)
- 2026Temporal Geometry of Deep Networks: Hyperbolic Representations of Training Dynamics for Intrinsic Explainability2 Oct 2026
- 2026Implicit representations are dead. Long live explicit primitives!7 Aug 2026
- 2026Observable- and Positional-Encoding-Dependent Symmetry Readout from Neural Network Weights3 Jul 2026
- 2026Dynamic Neural Graph Encoding of Inference Processes in Deep Weight Space2 Jul 2026
- 2026A Principled Self-Referenced Early Stopping Approach for Deep Image Prior24 May 2026
- 2026Learning Orthonormal Bases for Function Spaces19 May 2026
- 2026Quasi-Equivariant Metanetworks26 Apr 2026
- 2026Escaping Spectral Bias without Backpropagation: Fast Implicit Neural Representations with Extreme Learning Machines7 Feb 2026
- 2026Ensuring Semantics in Weights of Implicit Neural Representations through the Implicit Function Theorem30 Jan 2026
- 2026Deep Sketch-Based 3D Modeling: A Survey22 Jan 2026
- 2025Metanetworks as Regulatory Operators: Learning to Edit for Requirement Compliance17 Dec 2025
- 2025Symmetry-Aware Graph Metanetwork Autoencoders: Model Merging through Parameter Canonicalization16 Nov 2025
12 newest of 54 All 54 (JSON)