A Creative Agent is Worth a 64-Token Template
Not on the map. Why?
Abstract (arXiv)
Text-to-image (T2I) models have substantially improved image fidelity and prompt adherence, yet their creativity remains constrained by reliance on discrete natural language prompts. When presented with fuzzy prompts such as ``a creative vinyl record-inspired skyscraper'', these models often fail to infer the underlying creative intent, leaving creative ideation and prompt design largely to human users. Recent reasoning- or agent-driven approaches iteratively augment prompts but incur high computational and monetary costs, as their instance-specific generation makes ``creativity'' costly and non-reusable, requiring repeated queries or reasoning for subsequent generations. To address this, we introduce CAT, a framework for Creative Agent Tokenization that encapsulates agents' intrinsic understanding of ``creativity'' through a textitCreative Tokenizer. Given the embeddings of fuzzy prompts, the tokenizer generates a reusable token template that can be directly concatenated with them to inject creative semantics into T2I models without repeated reasoning or prompt augmentation. To enable this, the tokenizer is trained via creative semantic disentanglement, leveraging relations among partially overlapping concept pairs to capture the agent's latent creative representations. Extensive experiments on textbftextitArchitecture Design, textbftextitFurniture Design, and textbftextitNature Mixture tasks demonstrate that CAT provides a scalable and effective paradigm for enhancing creativity in T2I generation, achieving a 3.7× speedup and a 4.8× reduction in computational cost, while producing images with superior human preference and text-image alignment compared to state-of-the-art T2I models and creative generation methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 44 references that are in the map. First posted on arXiv 18 Mar 2026.
Builds on
36 of 44 references.
References · 36
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2024GPT-4o System Cardcited by 4,467
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
24 more
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2022Blended Latent Diffusioncited by 430
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
- 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 242
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
- 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 216
- 2022Optimizing Prompts for Text-to-Image Generationcited by 204
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 132
- 2023Art and the science of generative AI: A deeper divecited by 93
- 2022The Creativity of Text-to-Image Generationcited by 73
- 2023RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Modelcited by 47
- 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generationcited by 31
- 2023ConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior Constraintscited by 25
- 2021Creativity and Machine Learning: A Surveycited by 21
- 2023TP2O: Creative Text Pair-to-Object Generation using Balance Swap-Samplingcited by 16
- 2025Enhancing Creative Generation on Stable Diffusion-based Modelscited by 13
- 2025CREA: A Collaborative Multi-Agent Framework for Creative Image Editing and Generationcited by 13
- 2025SYNTHIA: Novel Concept Design with Affordance Compositioncited by 4
- 2025Distribution-Conditional Generation: From Class Distribution to Creative Generationcited by 4
- 2025VLM-Guided Adaptive Negative Prompting for Creative Generationcited by 3
- 2025AGSwap: Overcoming Category Boundaries in Object Fusion via Adaptive Group Swappingcited by 2
- 2025RMLer: Synthesizing Novel Objects across Diverse Categories via Reinforcement Mixing Learningcited by 1
Built on by
Not cited yet.