SeamlessGAN: Self-Supervised Synthesis of Tileable Texture Maps
Not on the map. Why?
Abstract (arXiv)
We present SeamlessGAN, a method capable of automatically generating tileable texture maps from a single input exemplar. In contrast to most existing methods, focused solely on solving the synthesis problem, our work tackles both problems, synthesis and tileability, simultaneously. Our key idea is to realize that tiling a latent space within a generative network trained using adversarial expansion techniques produces outputs with continuity at the seam intersection that can be then be turned into tileable images by cropping the central area. Since not every value of the latent space is valid to produce high-quality outputs, we leverage the discriminator as a perceptual error metric capable of identifying artifact-free textures during a sampling process. Further, in contrast to previous work on deep texture synthesis, our model is designed and optimized to work with multi-layered texture representations, enabling textures composed of multiple maps such as albedo, normals, etc. We extensively test our design choices for the network architecture, loss function and sampling parameters. We show qualitatively and quantitatively that our approach outperforms previous methods and works for textures of different types.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 60 of its 110 references that are in the map. First posted on arXiv 13 Jan 2022.
Builds on
60 of 110 references.
References · 60
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
38 more
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
- 2017Mixed Precision Trainingcited by 1,135
- 2017Deep Image Priorcited by 1,097
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2016HyperNetworkscited by 1,003
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
- 2018Everybody Dance Nowcited by 313
- 2017"Zero-Shot" Super-Resolution using Deep Internal Learningcited by 285
- 2020Neural Architecture Search without Trainingcited by 241
- 2016Generating Images with Perceptual Similarity Metrics based on Deep Networkscited by 221
- 2019Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF from a Single Imagecited by 202
- 2016Texture Networks: Feed-forward Synthesis of Textures and Stylized Imagescited by 173
- 2020A U-Net Based Discriminator for Generative Adversarial Networkscited by 128
- 2019Orthogonal Convolutional Neural Networkscited by 122
- 2021Generative Adversarial Transformerscited by 120
- 2018Single-Image SVBRDF Capture with a Rendering-Aware Deep Networkcited by 116
- 2018InverseRenderNet: Learning single image inverse renderingcited by 100
- 2016Controlling Perceptual Factors in Neural Style Transfercited by 99
- 2021Generative Models as Distributions of Functionscited by 89
- 2018Batch-Instance Normalization for Adaptively Style-Invariant Neural Networkscited by 77
- 2020Improved Techniques for Training Single-Image GANscited by 77
- 2018Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Datacited by 76
- 2019A critical analysis of self-supervision, or what we can learn from a single imagecited by 75
- 2018Learning Intrinsic Image Decomposition from Watching the Worldcited by 74
- 2018Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Imagecited by 66
- 2018Non-Stationary Texture Synthesis by Adversarial Expansioncited by 66
- 2017Learning Texture Manifolds with the Periodic Spatial GANcited by 53
- 2020Deep Geometric Texture Synthesiscited by 51
- 2019Flexible SVBRDF Capture with a Multi-Image Deep Networkcited by 50
- 2021Negative Data Augmentationcited by 46
- 2016Texture Synthesis with Spatial Generative Adversarial Networkscited by 45
- 2017Self-Supervised Intrinsic Image Decompositioncited by 43
- 2021Generative Modelling of BRDF Textures from Flash Imagescited by 35
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 9; 2025: 3; 2026: 2.
19 papers.
Sort:
By area:
- 2024TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusioncited by 51
- 2023Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shapecited by 29
- 2022TileGen: Tileable, Controllable Material Generation and Capturecited by 27
- 2023UMat: Uncertainty-Aware Single Image High Resolution Material Capturecited by 11
- 2024Tiled Diffusioncited by 9
- 2024Generating Non-Stationary Textures using Self-Rectificationcited by 8
- 2024TexTile: A Differentiable Metric for Texture Tileabilitycited by 7
- 2023NeuBTF: Neural fields for BTF encoding and transfercited by 5
- 2023Generative Escher Meshescited by 5
- 2024Learning Images Across Scales Using Adversarial Trainingcited by 3
- 2025ShapeShifter: 3D Variations Using Multiscale and Sparse Point-Voxel Diffusioncited by 3
- 2024One Noise to Rule Them All: Learning a Unified Model of Spatially-Varying Noise Patternscited by 2
7 more
- 2024Multi-Texture Synthesis through Signal Responsive Neural Cellular Automatacited by 1
- 2025Single-image Reflectance and Transmittance Estimation from Any Flatbed Scannercited by 1
- 2024CTGAN: Semantic-guided Conditional Texture Generator for 3D Shapescited by 0
- 2024On Synthetic Texture Datasets: Challenges, Creation, and Curationcited by 0
- 2025LoopGen: Training-Free Loopable Music Generationcited by 0
- 2026FabricGen: Microstructure-Aware Woven Fabric Generationcited by 0
- 2026Text-based Tactile Graphics Generation for the Visually Impairedcited by 0
- 2026Text-based Tactile Graphics Generation for the Visually Impaired10 Jul 2026
- 2026FabricGen: Microstructure-Aware Woven Fabric Generation7 Mar 2026
- 2025LoopGen: Training-Free Loopable Music Generation6 Apr 2025
- 2025Single-image Reflectance and Transmittance Estimation from Any Flatbed Scanner20 Feb 2025
- 2025ShapeShifter: 3D Variations Using Multiscale and Sparse Point-Voxel Diffusion4 Feb 2025
- 2024Tiled Diffusion19 Dec 2024
- 2024On Synthetic Texture Datasets: Challenges, Creation, and Curation16 Sep 2024
- 2024Multi-Texture Synthesis through Signal Responsive Neural Cellular Automata8 Jul 2024
- 2024Learning Images Across Scales Using Adversarial Training13 Jun 2024
- 2024One Noise to Rule Them All: Learning a Unified Model of Spatially-Varying Noise Patterns25 Apr 2024
- 2024TexTile: A Differentiable Metric for Texture Tileability19 Mar 2024
- 2024CTGAN: Semantic-guided Conditional Texture Generator for 3D Shapes8 Feb 2024
7 more
- 2024TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion17 Jan 2024
- 2024Generating Non-Stationary Textures using Self-Rectification5 Jan 2024
- 2023Generative Escher Meshes25 Sep 2023
- 2023NeuBTF: Neural fields for BTF encoding and transfer3 Jul 2023
- 2023UMat: Uncertainty-Aware Single Image High Resolution Material Capture25 May 2023
- 2023Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shape24 May 2023
- 2022TileGen: Tileable, Controllable Material Generation and Capture12 Jun 2022
- 2024TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusioncited by 51
- 2022TileGen: Tileable, Controllable Material Generation and Capturecited by 27
- 2023UMat: Uncertainty-Aware Single Image High Resolution Material Capturecited by 11
- 2024Tiled Diffusioncited by 9
- 2024Generating Non-Stationary Textures using Self-Rectificationcited by 8
- 2024TexTile: A Differentiable Metric for Texture Tileabilitycited by 7
- 2023NeuBTF: Neural fields for BTF encoding and transfercited by 5
- 2023Generative Escher Meshescited by 5
- 2024Learning Images Across Scales Using Adversarial Trainingcited by 3
- 2025ShapeShifter: 3D Variations Using Multiscale and Sparse Point-Voxel Diffusioncited by 3
- 2024One Noise to Rule Them All: Learning a Unified Model of Spatially-Varying Noise Patternscited by 2
- 2024Multi-Texture Synthesis through Signal Responsive Neural Cellular Automatacited by 1
12 most cited of 17 All 17 (JSON)
- 2026Text-based Tactile Graphics Generation for the Visually Impaired10 Jul 2026
- 2025LoopGen: Training-Free Loopable Music Generation6 Apr 2025
- 2025Single-image Reflectance and Transmittance Estimation from Any Flatbed Scanner20 Feb 2025
- 2025ShapeShifter: 3D Variations Using Multiscale and Sparse Point-Voxel Diffusion4 Feb 2025
- 2024Tiled Diffusion19 Dec 2024
- 2024On Synthetic Texture Datasets: Challenges, Creation, and Curation16 Sep 2024
- 2024Multi-Texture Synthesis through Signal Responsive Neural Cellular Automata8 Jul 2024
- 2024Learning Images Across Scales Using Adversarial Training13 Jun 2024
- 2024One Noise to Rule Them All: Learning a Unified Model of Spatially-Varying Noise Patterns25 Apr 2024
- 2024TexTile: A Differentiable Metric for Texture Tileability19 Mar 2024
- 2024CTGAN: Semantic-guided Conditional Texture Generator for 3D Shapes8 Feb 2024
- 2024TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion17 Jan 2024
12 newest of 17 All 17 (JSON)