mlsanityData to 14 Oct 2026

Redefining <Creative> in Dictionary: Towards an Enhanced Semantic Understanding of Creative Generation

arXiv 2410.24160 ↗First posted 31 Oct 2024cs.CV cs.CLcited by 2

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

``Creative'' remains an inherently abstract concept for both humans and diffusion models. While text-to-image (T2I) diffusion models can easily generate out-of-distribution concepts like ``a blue banana'', they struggle with generating combinatorial objects such as ``a creative mixture that resembles a lettuce and a mantis'', due to difficulties in understanding the semantic depth of ``creative''. Current methods rely heavily on synthesizing reference prompts or images to achieve a creative effect, typically requiring retraining for each unique creative output-a process that is computationally intensive and limits practical applications. To address this, we introduce CreTok, which brings meta-creativity to diffusion models by redefining ``creative'' as a new token, texttt<CreTok>, thus enhancing models' semantic understanding for combinatorial creativity. CreTok achieves such redefinition by iteratively sampling diverse text pairs from our proposed CangJie dataset to form adaptive prompts and restrictive prompts, and then optimizing the similarity between their respective text embeddings. Extensive experiments demonstrate that <CreTok> enables the universal and direct generation of combinatorial creativity across diverse concepts without additional training, achieving state-of-the-art performance with improved text-image alignment and higher human preference ratings. Code will be made available at https://github.com/fu-feng/CreTok.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 47 of its 64 references that are in the map. First posted on arXiv 31 Oct 2024.

Builds on

47 of 64 references.

Closest ancestors · 15

Same direction, newest first

  1. 2024EMMA: Your Text-to-Image Diffusion Model Can Secretly Accept Multi-Modal Prompts13 Jun
  2. 2024Financial Models in Generative Art: Black-Scholes-Inspired Concept Blending in Text-to-Image Diffusion22 May
  3. 2024λ-ECLIPSE: Multi-Concept Personalized Text-to-Image Diffusion Models by Leveraging CLIP Latent Space7 Feb
  4. 2023DiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphing12 Dec
  5. 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalization11 Dec
  6. 2023Kandinsky: an Improved Text-to-Image Synthesis with Image Prior and Latent Diffusion5 Oct
  7. 2023ConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior Constraints3 Aug
  8. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuning20 Mar
  9. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  11. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  12. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers2 Nov
3 more
  1. 2022MagicMix: Semantic Mixing with Diffusion Models28 Oct
  2. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr

Other references · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2022Generative Adversarial Networkscited by 5,627
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  8. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  9. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
  10. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  11. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  12. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
20 more
  1. 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 225
  2. 2023Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Datacited by 174
  3. 2023Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Modelscited by 133
  4. 2017CAN: Creative Adversarial Networks, Generating "Art" by Learning About Styles and Deviating from Style Normscited by 96
  5. 2024Multi-LoRA Composition for Image Generationcited by 80
  6. 2023On the Generalization Properties of Diffusion Modelscited by 68
  7. 2024LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insightscited by 65
  8. 2023Concept Decomposition for Visual Exploration and Inspirationcited by 61
  9. 2023Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generationcited by 56
  10. 2023Smooth Diffusion: Crafting Smooth Latent Spaces in Diffusion Modelscited by 49
  11. 2023ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptationcited by 40
  12. 2024Exploring Diffusion Time-steps for Unsupervised Representation Learningcited by 36
  13. 2021CreativeGAN: Editing Generative Adversarial Networks for Creative Design Synthesiscited by 24
  14. 2024Connecting Consistency Distillation to Score Distillation for Text-to-3D Generationcited by 18
  15. 2023TP2O: Creative Text Pair-to-Object Generation using Balance Swap-Samplingcited by 16
  16. 2024PartCraft: Crafting Creative Objects by Partscited by 13
  17. 2024Novel Object Synthesis via Adaptive Text-Image Harmonycited by 12
  18. 2024Few-shot Learner Parameterization by Diffusion Time-stepscited by 11
  19. 2023One More Step: A Versatile Plug-and-Play Module for Rectifying Diffusion Schedule Flaws and Enhancing Low-Frequency Controlscited by 6
  20. 2024Spectrum-Aware Parameter Efficient Fine-Tuning for Diffusion Modelscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Distribution-Conditional Generation: From Class Distribution to Creative Generation
  2. 2025Enhancing Creative Generation on Stable Diffusion-based Models
  3. 2026Creative Image Generation with Diffusion Models
  4. 2022A Survey on Generative Diffusion Model
  5. 2025Blending Concepts with Text-to-Image Diffusion Models
  6. 2026Seeking the Unfamiliar but Memorable: Conceptual Creativity as Meta-Learning
  7. 2025Probing and Inducing Combinational Creativity in Vision-Language Models
  8. 2025Imagine for Me: Creative Conceptual Blending of Real Images and Text via Blended Attention