TextureGAN: Controlling Deep Image Synthesis with Texture Patches
Not on the map. Why?
Abstract (arXiv)
In this paper, we investigate deep image synthesis guided by sketch, color, and texture. Previous image synthesis methods can be controlled by sketch and color strokes but we are the first to examine texture control. We allow a user to place a texture patch on a sketch at arbitrary locations and scales to control the desired output texture. Our generative network learns to synthesize objects consistent with these texture suggestions. To achieve this, we develop a local texture loss in addition to adversarial and content loss to train the generative network. We conduct experiments using sketches generated from real images and textures sampled from a separate texture database and results show that our proposed algorithm is able to generate plausible images that are faithful to user controls. Ablation studies show that our proposed pipeline can generate more realistic images than adapting existing methods directly.
Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 8; 2023: 10; 2024: 3; 2025: 5; 2026: 1.
47 papers.
Sort:
By area:
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
- 2021InfinityGAN: Towards Infinite-Pixel Image Synthesiscited by 61
- 2021Language-Driven Image Style Transfercited by 36
- 2021VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformerscited by 28
- 2021Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humanscited by 21
- 2021Intrinsic-Extrinsic Preserved GANs for Unsupervised 3D Pose Transfercited by 20
- 2022CoGS: Controllable Generation and Search from Sketch and Stylecited by 14
- 2021Facial-Sketch Synthesis: A New Challengecited by 13
- 2023FashionTex: Controllable Virtual Try-on with Text and Texturecited by 9
- 2021Model Extraction and Defenses on Generative Adversarial Networkscited by 8
35 more
- 2022SCSNet: An Efficient Paradigm for Learning Simultaneously Image Colorization and Super-Resolutioncited by 8
- 2021An Effective Loss Function for Generating 3D Models from Single 2D Image without Renderingcited by 7
- 2021SemIE: Semantically-aware Image Extrapolationcited by 7
- 2021Focusing on Persons: Colorizing Old Images Learning from Modern Historical Moviescited by 6
- 2024ColorFlow: Retrieval-Augmented Image Sequence Colorizationcited by 6
- 2025Cobra: Efficient Line Art COlorization with BRoAder Referencescited by 6
- 2023Patch of Invisibility: Naturalistic Physical Black-Box Adversarial Attacks on Object Detectorscited by 5
- 2021Smart Fashion: A Review of AI Applications in the Fashion & Apparel Industrycited by 4
- 2022Exemplar-based Pattern Synthesis with Implicit Periodic Field Networkcited by 3
- 2022Texture Generation Using A Graph Generative Adversarial Network And Differentiable Renderingcited by 3
- 2023Improving Sketch Colorization using Adversarial Segmentation Consistencycited by 3
- 2023Directional Texture Editing for 3D Modelscited by 3
- 2025Enhanced Multi-Scale Cross-Attention for Person Image Generationcited by 3
- 2021Adversarial Segmentation Loss for Sketch Colorizationcited by 2
- 2021FBC-GAN: Diverse and Flexible Image Synthesis via Foreground-Background Compositioncited by 2
- 2023Retargeting Visual Data with Deformation Fieldscited by 2
- 2025TriTex: Learning Texture from a Single Mesh via Triplane Semantic Featurescited by 2
- 2021SETGAN: Scale and Energy Trade-off GANs for Image Applications on Mobile Platformscited by 1
- 2021fAshIon after fashion: A Report of AI in Fashioncited by 1
- 2021Texture synthesis via projection onto multiscale, multilayer statisticscited by 1
- 2021Towards Controllable and Photorealistic Region-wise Image Manipulationcited by 1
- 2021Super-Resolution Appearance Transfer for 4D Human Performancescited by 1
- 2022Flexible Portrait Image Editing with Fine-Grained Controlcited by 1
- 2022Unsupervised Structure-Consistent Image-to-Image Translationcited by 1
- 2023FashionFlow: Leveraging Diffusion Models for Dynamic Fashion Video Synthesis from Static Imagerycited by 1
- 2023ARTEMIS: Using GANs with Multiple Discriminators to Generate Artcited by 1
- 2024Multi-Texture Synthesis through Signal Responsive Neural Cellular Automatacited by 1
- 2025UltraZoom: Generating Gigapixel Images from Regular Photoscited by 1
- 2026GarmentZoom: Generating Zoomable Images from Garment Listingscited by 1
- 2021Transferring Knowledge with Attention Distillation for Multi-Domain Image-to-Image Translationcited by 0
- 2022Semi-Supervised Image-to-Image Translation using Latent Space Mappingcited by 0
- 2022Review Neural Networks about Image Transformation Based on IGC Learning Framework with Annotated Informationcited by 0
- 2023Texture Matching GAN for CT Image Enhancementcited by 0
- 2024Mask Guided Gated Convolution for Amodal Content Completioncited by 0
- 2025Introducing Resizable Region Packing Problem in Image Generation, with a Heuristic Solutioncited by 0
- 2026GarmentZoom: Generating Zoomable Images from Garment Listings28 Jun 2026
- 2025Introducing Resizable Region Packing Problem in Image Generation, with a Heuristic Solution19 Sep 2025
- 2025UltraZoom: Generating Gigapixel Images from Regular Photos16 Jun 2025
- 2025Cobra: Efficient Line Art COlorization with BRoAder References16 Apr 2025
- 2025TriTex: Learning Texture from a Single Mesh via Triplane Semantic Features20 Mar 2025
- 2025Enhanced Multi-Scale Cross-Attention for Person Image Generation15 Jan 2025
- 2024ColorFlow: Retrieval-Augmented Image Sequence Colorization16 Dec 2024
- 2024Mask Guided Gated Convolution for Amodal Content Completion21 Jul 2024
- 2024Multi-Texture Synthesis through Signal Responsive Neural Cellular Automata8 Jul 2024
- 2023Texture Matching GAN for CT Image Enhancement20 Dec 2023
- 2023Retargeting Visual Data with Deformation Fields22 Nov 2023
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusion21 Nov 2023
35 more
- 2023ARTEMIS: Using GANs with Multiple Discriminators to Generate Art14 Nov 2023
- 2023FashionFlow: Leveraging Diffusion Models for Dynamic Fashion Video Synthesis from Static Imagery29 Sep 2023
- 2023Directional Texture Editing for 3D Models26 Sep 2023
- 2023FashionTex: Controllable Virtual Try-on with Text and Texture8 May 2023
- 2023Patch of Invisibility: Naturalistic Physical Black-Box Adversarial Attacks on Object Detectors7 Mar 2023
- 2023TEXTure: Text-Guided Texturing of 3D Shapes3 Feb 2023
- 2023Improving Sketch Colorization using Adversarial Segmentation Consistency20 Jan 2023
- 2022Unsupervised Structure-Consistent Image-to-Image Translation24 Aug 2022
- 2022Review Neural Networks about Image Transformation Based on IGC Learning Framework with Annotated Information21 Jun 2022
- 2022Texture Generation Using A Graph Generative Adversarial Network And Differentiable Rendering17 Jun 2022
- 2022Exemplar-based Pattern Synthesis with Implicit Periodic Field Network4 Apr 2022
- 2022Flexible Portrait Image Editing with Fine-Grained Control4 Apr 2022
- 2022Semi-Supervised Image-to-Image Translation using Latent Space Mapping29 Mar 2022
- 2022CoGS: Controllable Generation and Search from Sketch and Style17 Mar 2022
- 2022SCSNet: An Efficient Paradigm for Learning Simultaneously Image Colorization and Super-Resolution12 Jan 2022
- 2021Facial-Sketch Synthesis: A New Challenge31 Dec 2021
- 2021Smart Fashion: A Review of AI Applications in the Fashion & Apparel Industry28 Oct 2021
- 2021Super-Resolution Appearance Transfer for 4D Human Performances31 Aug 2021
- 2021SemIE: Semantically-aware Image Extrapolation31 Aug 2021
- 2021Towards Controllable and Photorealistic Region-wise Image Manipulation19 Aug 2021
- 2021Intrinsic-Extrinsic Preserved GANs for Unsupervised 3D Pose Transfer17 Aug 2021
- 2021Transferring Knowledge with Attention Distillation for Multi-Domain Image-to-Image Translation17 Aug 2021
- 2021Focusing on Persons: Colorizing Old Images Learning from Modern Historical Movies14 Aug 2021
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations2 Aug 2021
- 2021FBC-GAN: Diverse and Flexible Image Synthesis via Foreground-Background Composition7 Jul 2021
- 2021Language-Driven Image Style Transfer1 Jun 2021
- 2021Texture synthesis via projection onto multiscale, multilayer statistics22 May 2021
- 2021fAshIon after fashion: A Report of AI in Fashion7 May 2021
- 2021VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformers14 Apr 2021
- 2021InfinityGAN: Towards Infinite-Pixel Image Synthesis8 Apr 2021
- 2021Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humans31 Mar 2021
- 2021SETGAN: Scale and Energy Trade-off GANs for Image Applications on Mobile Platforms23 Mar 2021
- 2021An Effective Loss Function for Generating 3D Models from Single 2D Image without Rendering5 Mar 2021
- 2021Adversarial Segmentation Loss for Sketch Colorization11 Feb 2021
- 2021Model Extraction and Defenses on Generative Adversarial Networks6 Jan 2021
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
- 2021InfinityGAN: Towards Infinite-Pixel Image Synthesiscited by 61
- 2021Language-Driven Image Style Transfercited by 36
- 2021VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformerscited by 28
- 2021Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humanscited by 21
- 2021Intrinsic-Extrinsic Preserved GANs for Unsupervised 3D Pose Transfercited by 20
- 2022CoGS: Controllable Generation and Search from Sketch and Stylecited by 14
- 2021Facial-Sketch Synthesis: A New Challengecited by 13
- 2023FashionTex: Controllable Virtual Try-on with Text and Texturecited by 9
- 2021Model Extraction and Defenses on Generative Adversarial Networkscited by 8
- 2022SCSNet: An Efficient Paradigm for Learning Simultaneously Image Colorization and Super-Resolutioncited by 8
12 most cited of 44 All 44 (JSON)
- 2026GarmentZoom: Generating Zoomable Images from Garment Listings28 Jun 2026
- 2025Introducing Resizable Region Packing Problem in Image Generation, with a Heuristic Solution19 Sep 2025
- 2025UltraZoom: Generating Gigapixel Images from Regular Photos16 Jun 2025
- 2025Cobra: Efficient Line Art COlorization with BRoAder References16 Apr 2025
- 2025TriTex: Learning Texture from a Single Mesh via Triplane Semantic Features20 Mar 2025
- 2025Enhanced Multi-Scale Cross-Attention for Person Image Generation15 Jan 2025
- 2024Mask Guided Gated Convolution for Amodal Content Completion21 Jul 2024
- 2024Multi-Texture Synthesis through Signal Responsive Neural Cellular Automata8 Jul 2024
- 2023Texture Matching GAN for CT Image Enhancement20 Dec 2023
- 2023Retargeting Visual Data with Deformation Fields22 Nov 2023
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusion21 Nov 2023
- 2023ARTEMIS: Using GANs with Multiple Discriminators to Generate Art14 Nov 2023
12 newest of 44 All 44 (JSON)