TAGE: Trustworthy Attribute Group Editing for Stable Few-shot Image Generation
Not on the map. Why?
Abstract (arXiv)
Generative Adversarial Networks (GANs) have emerged as a prominent research focus for image editing tasks, leveraging the powerful image generation capabilities of the GAN framework to produce remarkable results.However, prevailing approaches are contingent upon extensive training datasets and explicit supervision, presenting a significant challenge in manipulating the diverse attributes of new image classes with limited sample availability. To surmount this hurdle, we introduce TAGE, an innovative image generation network comprising three integral modules: the Codebook Learning Module (CLM), the Code Prediction Module (CPM) and the Prompt-driven Semantic Module (PSM). The CPM module delves into the semantic dimensions of category-agnostic attributes, encapsulating them within a discrete codebook. This module is predicated on the concept that images are assemblages of attributes, and thus, by editing these category-independent attributes, it is theoretically possible to generate images from unseen categories. Subsequently, the CPM module facilitates naturalistic image editing by predicting indices of category-independent attribute vectors within the codebook. Additionally, the PSM module generates semantic cues that are seamlessly integrated into the Transformer architecture of the CPM, enhancing the model's comprehension of the targeted attributes for editing. With these semantic cues, the model can generate images that accentuate desired attributes more prominently while maintaining the integrity of the original category, even with a limited number of samples. We have conducted extensive experiments utilizing the Animal Faces, Flowers, and VGGFaces datasets. The results of these experiments demonstrate that our proposed method not only achieves superior performance but also exhibits a high degree of stability when compared to other few-shot image generation techniques.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 45 references that are in the map. First posted on arXiv 23 Oct 2024.
Builds on
31 of 45 references.
References · 31
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
- 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 305
- 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 230
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2023Token Merging for Fast Stable Diffusioncited by 220
19 more
- 2021Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAEcited by 106
- 2018Photographic Text-to-Image Synthesis with a Hierarchically-nested Adversarial Networkcited by 64
- 2019FIGR: Few-shot Image Generation with Reptilecited by 54
- 2023High-Resolution Document Shadow Removal via A Large-Scale Real-World Dataset and A Frequency-Aware Shadow Erasing Netcited by 36
- 2023CoordFill: Efficient High-Resolution Image Inpainting via Parameterized Coordinate Queryingcited by 34
- 2020F2GAN: Fusing-and-Filling GAN for Few-shot Image Generationcited by 29
- 2020DAWSON: A Domain Adaptive Few Shot Generation Frameworkcited by 27
- 2024Depth-aware Test-Time Training for Zero-shot Video Object Segmentationcited by 27
- 2020MatchingGAN: Matching-based Few-shot Image Generationcited by 26
- 2020DeltaGAN: Towards Diverse Few-shot Image Generation with Sample-Specific Deltacited by 22
- 2023Brain Diffuser: An End-to-End Brain Image to Brain Network Pipelinecited by 21
- 2023Exploring Incompatible Knowledge Transfer in Few-shot Image Generationcited by 19
- 2024Dual-Hybrid Attention Network for Specular Highlight Removalcited by 18
- 2023Devignet: High-Resolution Vignetting Removal via a Dual Aggregated Fusion Transformer With Adaptive Channel Expansioncited by 17
- 2022ShaDocNet: Learning Spatial-Aware Tokens in Transformer for Document Shadow Removalcited by 16
- 2022Attribute Group Editing for Reliable Few-shot Image Generationcited by 15
- 2024SMAFormer: Synergistic Multi-Attention Transformer for Medical Image Segmentationcited by 14
- 2024Test-Time Intensity Consistency Adaptation for Shadow Detectioncited by 11
- 2023DocDeshadower: Frequency-Aware Transformer for Document Shadow Removalcited by 9
Built on by
Not cited yet.