Self-Creative Text-to-Object Generation using Semantic-Aware Spatial Weighting
Not on the map. Why?
Abstract (arXiv)
Instilling creativity in text-to-image (T2I) generation presents a significant challenge, as it requires synthesized images to exhibit not only visual novelty and surprise, but also artistic value. Current T2I models, however, are largely optimized for literal text-image alignment with their data distribution, and their noise prediction networks constrain the generation to high-probability regions, consequently generating outputs that lack authentic creativity. To address this, we propose a Self-Creative Diffusion (SCDiff) model for meaningful T2I generations featuring two core modules: a learnable spatial weighting (LSW) module and a visual-semantic mixing loss (VSML). The LSW module designs a parametric Kaiser-Bessel window to reinforce central image features, fostering novel and surprising generation. The VSML module introduces a dual loss function: a similarity loss constrains that the new images align with its textual description, while a diversity loss maximizes its distinction from the original image, enhancing both semantic value and visual novelty. Extensive experiments demonstrate that our model substantially improves creativity, semantic alignment, and visual coherence, offering a simple yet powerful framework for generating creative objects.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 32 of its 49 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
32 of 49 references.
References · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2020Denoising Diffusion Probabilistic Modelscited by 20,952
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
- 2023Visual Instruction Tuningcited by 7,827
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,339
- 2024GPT-4o System Cardcited by 4,536
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,323
- 2021Zero-Shot Text-to-Image Generationcited by 4,284
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,130
- 2023Adversarial Diffusion Distillationcited by 751
20 more
- 2018Assessing Generative Models via Precision and Recallcited by 405
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 261
- 2024An analytic theory of creativity in convolutional diffusion modelscited by 103
- 2017CAN: Creative Adversarial Networks, Generating "Art" by Learning About Styles and Deviating from Style Normscited by 96
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 87
- 2023Concept Decomposition for Visual Exploration and Inspirationcited by 61
- 2022A Taxonomy of Prompt Modifiers for Text-To-Image Generationcited by 55
- 2020Spectral Distribution Aware Image Generationcited by 29
- 2023ConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior Constraintscited by 25
- 2024Improving Geo-diversity of Generated Images with Contextualized Vendi Score Guidancecited by 24
- 2023TP2O: Creative Text Pair-to-Object Generation using Balance Swap-Samplingcited by 16
- 2024PartCraft: Crafting Creative Objects by Partscited by 13
- 2024ProCreate, Don't Reproduce! Propulsive Energy Diffusion for Creative Generationcited by 13
- 2025Enhancing Creative Generation on Stable Diffusion-based Modelscited by 13
- 2015Quantifying Creativity in Art Networkscited by 12
- 2024Novel Object Synthesis via Adaptive Text-Image Harmonycited by 12
- 2024An Empirical Study and Analysis of Text-to-Image Generation Using Large Language Model-Powered Textual Representationcited by 11
- 2025Role Bias in Diffusion Models: Diagnosing and Mitigating through Intermediate Decompositioncited by 4
- 2024Redefining <Creative> in Dictionary: Towards an Enhanced Semantic Understanding of Creative Generationcited by 2
- 2025AGSwap: Overcoming Category Boundaries in Object Fusion via Adaptive Group Swappingcited by 2
Built on by
Not cited yet.