Creative Image Generation with Diffusion Models
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Creative image generation has emerged as a compelling area of research, driven by the need to produce novel and high-quality images that expand the boundaries of imagination. In this work, we propose a novel framework for creative generation using diffusion models, where creativity is associated with the inverse probability of an image's existence in the CLIP embedding space. Unlike prior approaches that rely on a manual blending of concepts or exclusion of subcategories, our method calculates the probability distribution of generated images and drives it towards low-probability regions to produce rare, imaginative, and visually captivating outputs. We also introduce pullback mechanisms, achieving high creativity without sacrificing visual fidelity. Extensive experiments on text-to-image diffusion models demonstrate the effectiveness and efficiency of our creative generation framework, showcasing its ability to produce unique, novel, and thought-provoking images. This work provides a new perspective on creativity in generative models, offering a principled method to foster innovation in visual content synthesis.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 22 of its 40 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
22 of 40 references.
Closest ancestors · 4
Same direction, newest first
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
Other references · 18
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2016Improved Techniques for Training GANscited by 2,970
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
6 more
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2015A note on the evaluation of generative modelscited by 292
- 2017CAN: Creative Adversarial Networks, Generating "Art" by Learning About Styles and Deviating from Style Normscited by 96
- 2024Novel Object Synthesis via Adaptive Text-Image Harmonycited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Enhancing Creative Generation on Stable Diffusion-based Models
- 2025VLM-Guided Adaptive Negative Prompting for Creative Generation
- 2025Blending Concepts with Text-to-Image Diffusion Models
- 2025Distribution-Conditional Generation: From Class Distribution to Creative Generation
- 2023Diffusion Models Generate Images Like Painters: an Analytical Theory of Outline First, Details Later
- 2022A Survey on Generative Diffusion Model
- 2023Diffusion idea exploration for art generation
- 2025The Cow of Rembrandt - Analyzing Artistic Prompt Interpretation in Text-to-Image Models