Learning a Neural 3D Texture Space from 2D Exemplars
Not on the map. Why?
Abstract (arXiv)
We propose a generative model of 2D and 3D natural textures with diversity, visual fidelity and at high computational efficiency. This is enabled by a family of methods that extend ideas from classic stochastic procedural texturing (Perlin noise) to learned, deep, non-linearities. The key idea is a hard-coded, tunable and differentiable step that feeds multiple transformed random 2D or 3D fields into an MLP that can be sampled over infinite domains. Our model encodes all exemplars from a diverse set of textures without a need to be re-trained for each exemplar. Applications include texture interpolation, and learning 3D textures from 2D exemplars.
Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 19; 2023: 7; 2024: 9; 2025: 3.
53 papers.
Sort:
By area:
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
- 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
- 2021Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPscited by 134
- 2021MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesiscited by 133
- 2021A Structured Dictionary Perspective on Implicit Neural Representationscited by 100
- 2021NeuTex: Neural Texture Mapping for Volumetric Neural Renderingcited by 98
- 2021NeRF-SR: High-Quality Neural Radiance Fields using Supersamplingcited by 95
- 2023Texture Generation on 3D Meshes with Point-UV Diffusioncited by 63
- 2021Seeing Implicit Neural Representations as Fourier Seriescited by 50
- 2021Generative Modelling of BRDF Textures from Flash Imagescited by 35
38 more
- 2022RTMV: A Ray-Traced Multi-View Synthetic Dataset for Novel View Synthesiscited by 33
- 2024TexSliders: Diffusion-Based Texture Editing in CLIP Spacecited by 23
- 2021NeuSample: Neural Sample Field for Efficient View Synthesiscited by 21
- 2022UncertaINR: Uncertainty Quantification of End-to-End Implicit Neural Representations for Computed Tomographycited by 19
- 2021Plan2Scene: Converting Floorplans to 3D Scenescited by 17
- 2025Neural Shell Texture Splatting: More Details and Fewer Primitivescited by 14
- 2022CoordX: Accelerating Implicit Neural Representation with a Split MLP Architecturecited by 13
- 2022Random Weight Factorization Improves the Training of Continuous Neural Representationscited by 13
- 2022SinGRAF: Learning a 3D Generative Radiance Field for a Single Scenecited by 11
- 2022X-NeRF: Explicit Neural Radiance Field for Multi-Scene 360circ Insufficient RGB-D Viewscited by 10
- 2023Frequency-Modulated Point Cloud Rendering with Easy Editingcited by 10
- 2023Mesh Neural Cellular Automatacited by 10
- 2021Texture Generation with Neural Cellular Automatacited by 9
- 20223inGAN: Learning a 3D Generative Model from Images of a Self-similar Scenecited by 9
- 2023TUVF: Learning Generalizable Texture UV Radiance Fieldscited by 9
- 2022NeRFocus: Neural Radiance Field for 3D Synthetic Defocuscited by 8
- 2021Learning Positional Embeddings for Coordinate-MLPscited by 7
- 2022GANmouflage: 3D Object Nondetection with Texture Fieldscited by 7
- 2024Superpixel-informed Implicit Neural Representation for Multi-Dimensional Datacited by 7
- 2022On Regularizing Coordinate-MLPscited by 5
- 2022How You Start Matters for Generalizationcited by 5
- 2022Neural apparent BRDF fields for multiview photometric stereocited by 5
- 2024G-Style: Stylized Gaussian Splattingcited by 5
- 2022Paying U-Attention to Textures: Multi-Stage Hourglass Vision Transformer for Universal Texture Synthesiscited by 4
- 2024Compositional Neural Texturescited by 4
- 2022Projective Urban Texturingcited by 3
- 2022Towards Universal Texture Synthesis by Combining Texton Broadcasting with Noise Injection in StyleGAN-2cited by 3
- 2022Exemplar-based Pattern Synthesis with Implicit Periodic Field Networkcited by 3
- 2022Texture Representation via Analysis and Synthesis with Generative Adversarial Networkscited by 3
- 2024ImplicitTerrain: a Continuous Surface Model for Terrain Data Analysiscited by 3
- 2024Multiplane Prior Guided Few-Shot Aerial Scene Renderingcited by 3
- 2021STS-GAN: Can We Synthesize Solid Texture with High Fidelity from Arbitrary 2D Exemplar?cited by 2
- 2023Retargeting Visual Data with Deformation Fieldscited by 2
- 2024Content-aware Tile Generation using Exterior Boundary Inpaintingcited by 2
- 2025Bias for Action: Video Implicit Neural Representations with Bias Modulationcited by 2
- 2022Initialization and Alignment for Adversarial Texture Optimizationcited by 1
- 2023A geometrically aware auto-encoder for multi-texture synthesiscited by 1
- 2023P2I-NET: Mapping Camera Pose to Image via Adversarial Learning for New View Synthesis in Real Indoor Environmentscited by 1
50 most cited of 53 All 53 (JSON)
- 2025T-MLP: Tailed Multi-Layer Perceptron for Level-of-Detail Signal Representation26 Aug 2025
- 2025Neural Shell Texture Splatting: More Details and Fewer Primitives27 Jul 2025
- 2025Bias for Action: Video Implicit Neural Representations with Bias Modulation16 Jan 2025
- 2024NeRF Inpainting with Geometric Diffusion Prior and Balanced Score Distillation23 Nov 2024
- 2024Superpixel-informed Implicit Neural Representation for Multi-Dimensional Data18 Nov 2024
- 2024Content-aware Tile Generation using Exterior Boundary Inpainting21 Sep 2024
- 2024G-Style: Stylized Gaussian Splatting28 Aug 2024
- 2024Multiplane Prior Guided Few-Shot Aerial Scene Rendering7 Jun 2024
- 2024ImplicitTerrain: a Continuous Surface Model for Terrain Data Analysis31 May 2024
- 2024TexSliders: Diffusion-Based Texture Editing in CLIP Space1 May 2024
- 2024Compositional Neural Textures18 Apr 2024
- 2024PDETime: Rethinking Long-Term Multivariate Time Series Forecasting from the perspective of partial differential equations25 Feb 2024
38 more
- 2023Retargeting Visual Data with Deformation Fields22 Nov 2023
- 2023Mesh Neural Cellular Automata6 Nov 2023
- 2023P2I-NET: Mapping Camera Pose to Image via Adversarial Learning for New View Synthesis in Real Indoor Environments27 Sep 2023
- 2023Texture Generation on 3D Meshes with Point-UV Diffusion21 Aug 2023
- 2023TUVF: Learning Generalizable Texture UV Radiance Fields4 May 2023
- 2023Frequency-Modulated Point Cloud Rendering with Easy Editing14 Mar 2023
- 2023A geometrically aware auto-encoder for multi-texture synthesis3 Feb 2023
- 2022Texture Representation via Analysis and Synthesis with Generative Adversarial Networks20 Dec 2022
- 2022SinGRAF: Learning a 3D Generative Radiance Field for a Single Scene30 Nov 2022
- 20223inGAN: Learning a 3D Generative Model from Images of a Self-similar Scene27 Nov 2022
- 2022X-NeRF: Explicit Neural Radiance Field for Multi-Scene 360circ Insufficient RGB-D Views11 Oct 2022
- 2022Random Weight Factorization Improves the Training of Continuous Neural Representations3 Oct 2022
- 2022Initialization and Alignment for Adversarial Texture Optimization28 Jul 2022
- 2022Neural apparent BRDF fields for multiview photometric stereo14 Jul 2022
- 2022How You Start Matters for Generalization17 Jun 2022
- 2022RTMV: A Ray-Traced Multi-View Synthetic Dataset for Novel View Synthesis14 May 2022
- 2022Exemplar-based Pattern Synthesis with Implicit Periodic Field Network4 Apr 2022
- 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image2 Apr 2022
- 2022NeRFocus: Neural Radiance Field for 3D Synthetic Defocus10 Mar 2022
- 2022Towards Universal Texture Synthesis by Combining Texton Broadcasting with Noise Injection in StyleGAN-28 Mar 2022
- 2022Paying U-Attention to Textures: Multi-Stage Hourglass Vision Transformer for Universal Texture Synthesis23 Feb 2022
- 2022UncertaINR: Uncertainty Quantification of End-to-End Implicit Neural Representations for Computed Tomography22 Feb 2022
- 2022On Regularizing Coordinate-MLPs1 Feb 2022
- 2022CoordX: Accelerating Implicit Neural Representation with a Split MLP Architecture28 Jan 2022
- 2022Projective Urban Texturing25 Jan 2022
- 2022GANmouflage: 3D Object Nondetection with Texture Fields18 Jan 2022
- 2021Learning Positional Embeddings for Coordinate-MLPs21 Dec 2021
- 2021A Structured Dictionary Perspective on Implicit Neural Representations3 Dec 2021
- 2021NeRF-SR: High-Quality Neural Radiance Fields using Supersampling3 Dec 2021
- 2021NeuSample: Neural Sample Field for Efficient View Synthesis30 Nov 2021
- 2021Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPs30 Nov 2021
- 2021GeoNeRF: Generalizing NeRF with Geometry Priors26 Nov 2021
- 2021Neural Fields in Visual Computing and Beyond22 Nov 2021
- 2021Seeing Implicit Neural Representations as Fourier Series1 Sep 2021
- 2021Plan2Scene: Converting Floorplans to 3D Scenes9 Jun 2021
- 2021Texture Generation with Neural Cellular Automata15 May 2021
- 2021MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis27 Mar 2021
- 2021NeuTex: Neural Texture Mapping for Volumetric Neural Rendering1 Mar 2021
50 newest of 53 All 53 (JSON)
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
- 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
- 2021Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPscited by 134
- 2021MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesiscited by 133
- 2021A Structured Dictionary Perspective on Implicit Neural Representationscited by 100
- 2021NeuTex: Neural Texture Mapping for Volumetric Neural Renderingcited by 98
- 2021NeRF-SR: High-Quality Neural Radiance Fields using Supersamplingcited by 95
- 2021Seeing Implicit Neural Representations as Fourier Seriescited by 50
- 2021Generative Modelling of BRDF Textures from Flash Imagescited by 35
- 2022RTMV: A Ray-Traced Multi-View Synthetic Dataset for Novel View Synthesiscited by 33
12 most cited of 50 All 50 (JSON)
- 2025T-MLP: Tailed Multi-Layer Perceptron for Level-of-Detail Signal Representation26 Aug 2025
- 2025Neural Shell Texture Splatting: More Details and Fewer Primitives27 Jul 2025
- 2025Bias for Action: Video Implicit Neural Representations with Bias Modulation16 Jan 2025
- 2024Superpixel-informed Implicit Neural Representation for Multi-Dimensional Data18 Nov 2024
- 2024Content-aware Tile Generation using Exterior Boundary Inpainting21 Sep 2024
- 2024G-Style: Stylized Gaussian Splatting28 Aug 2024
- 2024Multiplane Prior Guided Few-Shot Aerial Scene Rendering7 Jun 2024
- 2024ImplicitTerrain: a Continuous Surface Model for Terrain Data Analysis31 May 2024
- 2024Compositional Neural Textures18 Apr 2024
- 2024PDETime: Rethinking Long-Term Multivariate Time Series Forecasting from the perspective of partial differential equations25 Feb 2024
- 2023Retargeting Visual Data with Deformation Fields22 Nov 2023
- 2023Mesh Neural Cellular Automata6 Nov 2023
12 newest of 50 All 50 (JSON)