Few-shot Image Generation with Elastic Weight Consolidation
Not on the map. Why?
Cited by 24 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Few-shot image generation seeks to generate more data of a given domain, with only few available training examples. As it is unreasonable to expect to fully infer the distribution from just a few observations (e.g., emojis), we seek to leverage a large, related source domain as pretraining (e.g., human faces). Thus, we wish to preserve the diversity of the source domain, while adapting to the appearance of the target. We adapt a pretrained model, without introducing any additional parameters, to the few examples of the target domain. Crucially, we regularize the changes of the weights during this adaptation, in order to best preserve the information of the source dataset, while fitting the target. We demonstrate the effectiveness of our algorithm by generating high-quality results of different target domains, including those with extremely few examples (e.g., <10). We also analyze the performance of our method with respect to some important factors, such as the number of examples and the dissimilarity between the source and target domain.
Key facts. Cited by 122 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 35; 2023: 36; 2024: 23; 2025: 7; 2026: 2.
122 papers.
Sort:
By area:
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2023Ablating Concepts in Text-to-Image Diffusion Modelscited by 312
- 2021Few-shot Image Generation via Cross-domain Correspondencecited by 206
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
- 2021StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generatorscited by 164
- 2023A Recipe for Watermarking Diffusion Modelscited by 136
- 2023Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Modelscited by 131
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Modelcited by 110
- 2022Few Shot Generative Model Adaption via Relaxed Spatial Structural Alignmentcited by 54
- 2023Task-specific Fine-tuning via Variational Information Bottleneck for Weakly-supervised Pathology Whole Slide Image Classificationcited by 54
38 more
- 2021JoJoGAN: One Shot Face Stylizationcited by 49
- 2022A Closer Look at Few-shot Image Generationcited by 49
- 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
- 2022Modeling Image Composition for Complex Scene Generationcited by 43
- 2021One-Shot Generative Domain Adaptationcited by 41
- 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
- 2021Sketch Your Own GANcited by 37
- 2022Diffusion Guided Domain Adaptation of Image Generatorscited by 35
- 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGANcited by 34
- 2022Few-shot Image Generation via Adaptation-Aware Kernel Modulationcited by 33
- 2022DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Modelcited by 32
- 2022One-Shot Adaptation of GAN in Just One CLIPcited by 31
- 2022Fair Generative Models via Transfer Learningcited by 27
- 2022MyStyle: A Personalized Generative Priorcited by 26
- 2021Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspectivecited by 25
- 2022Rewriting Geometric Rules of a GANcited by 25
- 2022Towards Diverse and Faithful One-shot Adaption of Generative Adversarial Networkscited by 23
- 2024Data Attribution for Text-to-Image Models by Unlearning Synthesized Imagescited by 22
- 2022Few-shot Image Generation with Diffusion Modelscited by 21
- 2022A Comprehensive Survey on Data-Efficient GANs in Image Generationcited by 20
- 2022Generalized One-shot Domain Adaptation of Generative Adversarial Networkscited by 19
- 2022HyperDomainNet: Universal Domain Adaptation for Generative Adversarial Networkscited by 19
- 2023Exploring Incompatible Knowledge Transfer in Few-shot Image Generationcited by 19
- 2023A Survey on Generative Modeling with Limited Data, Few Shots, and Zero Shotcited by 19
- 2023Domain Re-Modulation for Few-Shot Generative Domain Adaptationcited by 18
- 2021Few-shot Image Generation with Mixup-based Distance Learningcited by 16
- 2022FreGAN: Exploiting Frequency Components for Training GANs under Limited Datacited by 16
- 2022Attribute Group Editing for Reliable Few-shot Image Generationcited by 15
- 2022DynaGAN: Dynamic Few-shot Adaptation of GANs to Multiple Domainscited by 15
- 2023DomainStudio: Fine-Tuning Diffusion Models for Domain-Driven Image Generation using Limited Datacited by 15
- 2023Scenimefy: Learning to Craft Anime Scene via Semi-Supervised Image-to-Image Translationcited by 15
- 2022When, Why, and Which Pretrained GANs Are Useful?cited by 14
- 2023Domain Expansion of Image Generatorscited by 13
- 2025Fine-Tuning Visual Autoregressive Models for Subject-Driven Generationcited by 13
- 2022Few-shot Image Generation via Masked Discriminationcited by 12
- 2023WeditGAN: Few-Shot Image Generation via Latent Space Relocationcited by 12
- 2023LFS-GAN: Lifelong Few-Shot Image Generationcited by 11
- 2023Phasic Content Fusing Diffusion Model with Directional Distribution Consistency for Few-Shot Model Adaptioncited by 11
50 most cited of 122 All 122 (JSON)
- 2026Safe Evolution with Circuit Anchors24 May 2026
- 2026Few-Shot Generative Model Adaption via Identity Injection and Preservation24 Mar 2026
- 2025A Turn Toward Better Alignment: Few-Shot Generative Adaptation with Equivariant Feature Rotation24 Dec 2025
- 2025CoLoR-GAN: Continual Few-Shot Learning with Low-Rank Adaptation in Generative Adversarial Networks13 Oct 2025
- 2025In-Context Learning can Perform Continual Learning Like Humans26 Sep 2025
- 2025Voost: A Unified and Scalable Diffusion Transformer for Bidirectional Virtual Try-On and Try-Off6 Aug 2025
- 2025Continual Learning-Based Unified Model for Unpaired Image Restoration Tasks25 Jul 2025
- 2025AIR: Zero-shot Generative Model Adaptation with Iterative Refinement12 Jun 2025
- 2025Fine-Tuning Visual Autoregressive Models for Subject-Driven Generation3 Apr 2025
- 2024GCA-3D: Towards Generalized and Consistent Domain Adaptation of 3D Generators20 Dec 2024
- 2024FonTS: Text Rendering with Typography and Style Controls28 Nov 2024
- 2024Towards Lifelong Few-Shot Customization of Text-to-Image Diffusion8 Nov 2024
38 more
- 2024DomainGallery: Few-shot Domain-driven Image Generation by Attribute-centric Finetuning7 Nov 2024
- 2024Hollowed Net for On-Device Personalization of Text-to-Image Diffusion Models2 Nov 2024
- 2024On The Relationship between Visual Anomaly-free and Anomalous Representations9 Oct 2024
- 2024Rejection Sampling IMLE: Designing Priors for Better Few-Shot Image Synthesis26 Sep 2024
- 2024TextBoost: Boosting Text Encoder for Personalized Text-to-Image Generation12 Sep 2024
- 2024Transformer-based few-shot learning for modeling Electricity Consumption Profiles with minimal data across thousands of domains15 Aug 2024
- 2024ZePo: Zero-Shot Portrait Stylization with Faster Sampling10 Aug 2024
- 2024Model Inversion Attacks Through Target-Specific Conditional Diffusion Models16 Jul 2024
- 2024Few-Shot Image Generation by Conditional Relaxing Diffusion Inversion9 Jul 2024
- 2024Data Attribution for Text-to-Image Models by Unlearning Synthesized Images13 Jun 2024
- 2024Transfer Learning for Diffusion Models27 May 2024
- 2024Conditional Diffusion on Web-Scale Image Pairs leads to Diverse Image Variations23 May 2024
- 2024Model Inversion Robustness: Can Transfer Learning Help?9 May 2024
- 2024A Survey on Large Language Models from Concept to Implementation27 Mar 2024
- 2024LeGO: Leveraging a Surface Deformation Network for Animatable Stylized Face Generation with One Example22 Mar 2024
- 2024Stylized Face Sketch Extraction via Generative Prior with Limited Data17 Mar 2024
- 2024DiffuseKronA: A Parameter Efficient Fine-tuning Method for Personalized Diffusion Models27 Feb 2024
- 2024Textual Localization: Decomposing Multi-concept Images for Subject-Driven Text-to-Image Generation15 Feb 2024
- 2024UniHDA: A Unified and Versatile Framework for Multi-Modal Hybrid Domain Adaptation23 Jan 2024
- 2024Few-shot Image Generation via Information Transfer from the Built Geodesic Surface3 Jan 2024
- 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Model10 Dec 2023
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motion7 Dec 2023
- 2023A Low-Overhead Incorporation-Extrapolation based Few-Shot CSI Feedback Framework for Massive MIMO Systems7 Dec 2023
- 2023Portrait Diffusion: Training-free Face Stylization with Chain-of-Painting3 Dec 2023
- 2023Peer is Your Pillar: A Data-unbalanced Conditional GANs for Few-shot Image Generation14 Nov 2023
- 2023Few-shot Hybrid Domain Adaptation of Image Generators30 Oct 2023
- 2023Adapt then Unlearn: Exploring Parameter Space Semantics for Unlearning in Generative Adversarial Networks25 Sep 2023
- 2023Phasic Content Fusing Diffusion Model with Directional Distribution Consistency for Few-Shot Model Adaption7 Sep 2023
- 2023Scenimefy: Learning to Craft Anime Scene via Semi-Supervised Image-to-Image Translation24 Aug 2023
- 2023Efficient Transfer Learning in Diffusion Models via Adversarial Noise23 Aug 2023
- 2023LFS-GAN: Lifelong Few-Shot Image Generation23 Aug 2023
- 2023Improving Diversity in Zero-Shot GAN Adaptation with Semantic Variations21 Aug 2023
- 2023Smoothness Similarity Regularization for Few-Shot GAN Adaptation18 Aug 2023
- 2023Image Synthesis under Limited Data: A Survey and Taxonomy31 Jul 2023
- 2023Trajectory-aware Principal Manifold Framework for Data Augmentation and Image Generation30 Jul 2023
- 2023A Survey on Generative Modeling with Limited Data, Few Shots, and Zero Shot26 Jul 2023
- 2023AdAM: Few-Shot Image Generation via Adaptation-Aware Kernel Modulation4 Jul 2023
- 2023DomainStudio: Fine-Tuning Diffusion Models for Domain-Driven Image Generation using Limited Data25 Jun 2023
50 newest of 122 All 122 (JSON)
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2023Ablating Concepts in Text-to-Image Diffusion Modelscited by 312
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
- 2023A Recipe for Watermarking Diffusion Modelscited by 136
- 2023Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Modelscited by 131
- 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Modelcited by 110
- 2022Diffusion Guided Domain Adaptation of Image Generatorscited by 35
- 2022DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Modelcited by 32
- 2022Few-shot Image Generation with Diffusion Modelscited by 21
- 2023DomainStudio: Fine-Tuning Diffusion Models for Domain-Driven Image Generation using Limited Datacited by 15
- 2023Phasic Content Fusing Diffusion Model with Directional Distribution Consistency for Few-Shot Model Adaptioncited by 11
12 most cited of 24 All 24 (JSON)
- 2025Voost: A Unified and Scalable Diffusion Transformer for Bidirectional Virtual Try-On and Try-Off6 Aug 2025
- 2024Towards Lifelong Few-Shot Customization of Text-to-Image Diffusion8 Nov 2024
- 2024Hollowed Net for On-Device Personalization of Text-to-Image Diffusion Models2 Nov 2024
- 2024TextBoost: Boosting Text Encoder for Personalized Text-to-Image Generation12 Sep 2024
- 2024ZePo: Zero-Shot Portrait Stylization with Faster Sampling10 Aug 2024
- 2024Model Inversion Attacks Through Target-Specific Conditional Diffusion Models16 Jul 2024
- 2024Transfer Learning for Diffusion Models27 May 2024
- 2024Conditional Diffusion on Web-Scale Image Pairs leads to Diverse Image Variations23 May 2024
- 2024DiffuseKronA: A Parameter Efficient Fine-tuning Method for Personalized Diffusion Models27 Feb 2024
- 2024Textual Localization: Decomposing Multi-concept Images for Subject-Driven Text-to-Image Generation15 Feb 2024
- 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Model10 Dec 2023
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motion7 Dec 2023
12 newest of 24 All 24 (JSON)
- 2021Few-shot Image Generation via Cross-domain Correspondencecited by 206
- 2021StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generatorscited by 164
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2022Few Shot Generative Model Adaption via Relaxed Spatial Structural Alignmentcited by 54
- 2023Task-specific Fine-tuning via Variational Information Bottleneck for Weakly-supervised Pathology Whole Slide Image Classificationcited by 54
- 2021JoJoGAN: One Shot Face Stylizationcited by 49
- 2022A Closer Look at Few-shot Image Generationcited by 49
- 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
- 2022Modeling Image Composition for Complex Scene Generationcited by 43
- 2021One-Shot Generative Domain Adaptationcited by 41
- 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
- 2021Sketch Your Own GANcited by 37
12 most cited of 96 All 96 (JSON)
- 2026Safe Evolution with Circuit Anchors24 May 2026
- 2026Few-Shot Generative Model Adaption via Identity Injection and Preservation24 Mar 2026
- 2025A Turn Toward Better Alignment: Few-Shot Generative Adaptation with Equivariant Feature Rotation24 Dec 2025
- 2025CoLoR-GAN: Continual Few-Shot Learning with Low-Rank Adaptation in Generative Adversarial Networks13 Oct 2025
- 2025In-Context Learning can Perform Continual Learning Like Humans26 Sep 2025
- 2025Continual Learning-Based Unified Model for Unpaired Image Restoration Tasks25 Jul 2025
- 2025AIR: Zero-shot Generative Model Adaptation with Iterative Refinement12 Jun 2025
- 2025Fine-Tuning Visual Autoregressive Models for Subject-Driven Generation3 Apr 2025
- 2024GCA-3D: Towards Generalized and Consistent Domain Adaptation of 3D Generators20 Dec 2024
- 2024FonTS: Text Rendering with Typography and Style Controls28 Nov 2024
- 2024DomainGallery: Few-shot Domain-driven Image Generation by Attribute-centric Finetuning7 Nov 2024
- 2024On The Relationship between Visual Anomaly-free and Anomalous Representations9 Oct 2024
12 newest of 96 All 96 (JSON)