Redefining <Creative> in Dictionary: Towards an Enhanced Semantic Understanding of Creative Generation
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
``Creative'' remains an inherently abstract concept for both humans and diffusion models. While text-to-image (T2I) diffusion models can easily generate out-of-distribution concepts like ``a blue banana'', they struggle with generating combinatorial objects such as ``a creative mixture that resembles a lettuce and a mantis'', due to difficulties in understanding the semantic depth of ``creative''. Current methods rely heavily on synthesizing reference prompts or images to achieve a creative effect, typically requiring retraining for each unique creative output-a process that is computationally intensive and limits practical applications. To address this, we introduce CreTok, which brings meta-creativity to diffusion models by redefining ``creative'' as a new token, texttt<CreTok>, thus enhancing models' semantic understanding for combinatorial creativity. CreTok achieves such redefinition by iteratively sampling diverse text pairs from our proposed CangJie dataset to form adaptive prompts and restrictive prompts, and then optimizing the similarity between their respective text embeddings. Extensive experiments demonstrate that <CreTok> enables the universal and direct generation of combinatorial creativity across diverse concepts without additional training, achieving state-of-the-art performance with improved text-image alignment and higher human preference ratings. Code will be made available at https://github.com/fu-feng/CreTok.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 47 of its 64 references that are in the map. First posted on arXiv 31 Oct 2024.
Builds on
47 of 64 references.
Closest ancestors · 15
Same direction, newest first
- 2024EMMA: Your Text-to-Image Diffusion Model Can Secretly Accept Multi-Modal Prompts13 Jun
- 2024Financial Models in Generative Art: Black-Scholes-Inspired Concept Blending in Text-to-Image Diffusion22 May
- 2024λ-ECLIPSE: Multi-Concept Personalized Text-to-Image Diffusion Models by Leveraging CLIP Latent Space7 Feb
- 2023DiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphing12 Dec
- 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalization11 Dec
- 2023Kandinsky: an Improved Text-to-Image Synthesis with Image Prior and Latent Diffusion5 Oct
- 2023ConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior Constraints3 Aug
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuning20 Mar
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers2 Nov
3 more
Other references · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Generative Adversarial Networkscited by 5,627
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
20 more
- 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 225
- 2023Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Datacited by 174
- 2023Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Modelscited by 133
- 2017CAN: Creative Adversarial Networks, Generating "Art" by Learning About Styles and Deviating from Style Normscited by 96
- 2024Multi-LoRA Composition for Image Generationcited by 80
- 2023On the Generalization Properties of Diffusion Modelscited by 68
- 2024LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insightscited by 65
- 2023Concept Decomposition for Visual Exploration and Inspirationcited by 61
- 2023Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generationcited by 56
- 2023Smooth Diffusion: Crafting Smooth Latent Spaces in Diffusion Modelscited by 49
- 2023ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptationcited by 40
- 2024Exploring Diffusion Time-steps for Unsupervised Representation Learningcited by 36
- 2021CreativeGAN: Editing Generative Adversarial Networks for Creative Design Synthesiscited by 24
- 2024Connecting Consistency Distillation to Score Distillation for Text-to-3D Generationcited by 18
- 2023TP2O: Creative Text Pair-to-Object Generation using Balance Swap-Samplingcited by 16
- 2024PartCraft: Crafting Creative Objects by Partscited by 13
- 2024Novel Object Synthesis via Adaptive Text-Image Harmonycited by 12
- 2024Few-shot Learner Parameterization by Diffusion Time-stepscited by 11
- 2023One More Step: A Versatile Plug-and-Play Module for Rectifying Diffusion Schedule Flaws and Enhancing Low-Frequency Controlscited by 6
- 2024Spectrum-Aware Parameter Efficient Fine-Tuning for Diffusion Modelscited by 5
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Distribution-Conditional Generation: From Class Distribution to Creative Generation
- 2025Enhancing Creative Generation on Stable Diffusion-based Models
- 2026Creative Image Generation with Diffusion Models
- 2022A Survey on Generative Diffusion Model
- 2025Blending Concepts with Text-to-Image Diffusion Models
- 2026Seeking the Unfamiliar but Memorable: Conceptual Creativity as Meta-Learning
- 2025Probing and Inducing Combinational Creativity in Vision-Language Models
- 2025Imagine for Me: Creative Conceptual Blending of Real Images and Text via Blended Attention