mlsanityData to 7 Oct 2026

SeamlessGAN: Self-Supervised Synthesis of Tileable Texture Maps

arXiv 2201.05120 ↗First posted 13 Jan 2022cs.CV cs.GR cs.LGcited by 19

Not on the map. Why?

Abstract (arXiv)

We present SeamlessGAN, a method capable of automatically generating tileable texture maps from a single input exemplar. In contrast to most existing methods, focused solely on solving the synthesis problem, our work tackles both problems, synthesis and tileability, simultaneously. Our key idea is to realize that tiling a latent space within a generative network trained using adversarial expansion techniques produces outputs with continuity at the seam intersection that can be then be turned into tileable images by cropping the central area. Since not every value of the latent space is valid to produce high-quality outputs, we leverage the discriminator as a perceptual error metric capable of identifying artifact-free textures during a sampling process. Further, in contrast to previous work on deep texture synthesis, our model is designed and optimized to work with multi-layered texture representations, enabling textures composed of multiple maps such as albedo, normals, etc. We extensively test our design choices for the network architecture, loss function and sampling parameters. We show qualitatively and quantitatively that our approach outperforms previous methods and works for textures of different types.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 60 of its 110 references that are in the map. First posted on arXiv 13 Jan 2022.

Builds on

60 of 110 references.

References · 60

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  7. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  8. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  9. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  10. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  11. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  12. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
38 more
  1. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  2. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  3. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  4. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
  5. 2017Mixed Precision Trainingcited by 1,135
  6. 2017Deep Image Priorcited by 1,097
  7. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  8. 2016HyperNetworkscited by 1,003
  9. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  10. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  11. 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
  12. 2018Everybody Dance Nowcited by 313
  13. 2017"Zero-Shot" Super-Resolution using Deep Internal Learningcited by 285
  14. 2020Neural Architecture Search without Trainingcited by 241
  15. 2016Generating Images with Perceptual Similarity Metrics based on Deep Networkscited by 221
  16. 2019Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF from a Single Imagecited by 202
  17. 2016Texture Networks: Feed-forward Synthesis of Textures and Stylized Imagescited by 173
  18. 2020A U-Net Based Discriminator for Generative Adversarial Networkscited by 128
  19. 2019Orthogonal Convolutional Neural Networkscited by 122
  20. 2021Generative Adversarial Transformerscited by 120
  21. 2018Single-Image SVBRDF Capture with a Rendering-Aware Deep Networkcited by 116
  22. 2018InverseRenderNet: Learning single image inverse renderingcited by 100
  23. 2016Controlling Perceptual Factors in Neural Style Transfercited by 99
  24. 2021Generative Models as Distributions of Functionscited by 89
  25. 2018Batch-Instance Normalization for Adaptively Style-Invariant Neural Networkscited by 77
  26. 2020Improved Techniques for Training Single-Image GANscited by 77
  27. 2018Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Datacited by 76
  28. 2019A critical analysis of self-supervision, or what we can learn from a single imagecited by 75
  29. 2018Learning Intrinsic Image Decomposition from Watching the Worldcited by 74
  30. 2018Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Imagecited by 66
  31. 2018Non-Stationary Texture Synthesis by Adversarial Expansioncited by 66
  32. 2017Learning Texture Manifolds with the Periodic Spatial GANcited by 53
  33. 2020Deep Geometric Texture Synthesiscited by 51
  34. 2019Flexible SVBRDF Capture with a Multi-Image Deep Networkcited by 50
  35. 2021Negative Data Augmentationcited by 46
  36. 2016Texture Synthesis with Spatial Generative Adversarial Networkscited by 45
  37. 2017Self-Supervised Intrinsic Image Decompositioncited by 43
  38. 2021Generative Modelling of BRDF Textures from Flash Imagescited by 35

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 4; 2024: 9; 2025: 3; 2026: 2.

19 papers.

Sort:

By area: