EPIG: Emotion-Based Prompting for Personalised Image Generation
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Text-to-image diffusion models have achieved impressive results in synthesizing high-quality images from natural language prompts. However, commonly used prompting strategies remain relatively generic, limiting the model's ability to accurately express emotional intent and nuanced affective attributes. This work proposes EPIG, a method that enhances emotional expressiveness at the prompt level prior to image generation. Grounded in psychologically informed emotion representations (valence-arousal) and leveraging structured, role-aware prompt enrichment, EPIG enriches emotion-related components of prompts without modifying or retraining the image generation backbone. The resulting emotion-aware prompts guide the generative process toward more emotionally coherent visual outputs, with particular effectiveness in controlling arousal. EPIG is lightweight, training-free, and well suited for resource-constrained and personalized image generation scenarios. Experimental results on a benchmark of 10 diverse prompts show that EPIG reduces mean arousal error compared to strong baselines, including naive insertion and LLM-based prompt expansion, with reductions of 14% and 12%, respectively. These improvements are statistically significant. EPIG also preserves valence alignment and semantic consistency, as measured by CLIPScore and supported by ablation studies. The effect is more pronounced on prompts containing explicit subjects such as humans, children, or animals, where the reduction reaches 17%, highlighting the subject-sensitive behavior of the proposed method.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 26 of its 35 references that are in the map. First posted on arXiv 11 Jun 2026.
Builds on
26 of 35 references.
Closest ancestors · 1
Same direction, newest first
Other references · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2023Adversarial Diffusion Distillationcited by 759
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 243
- 2022Optimizing Prompts for Text-to-Image Generationcited by 207
- 2013Crowdsourcing a Word-Emotion Association Lexiconcited by 196
- 2024Towards Understanding Cross and Self-Attention in Stable Diffusion for Text-Guided Image Editingcited by 135
13 more
- 2023A-STAR: Test-time Attention Segregation and Retention for Text-to-image Synthesiscited by 78
- 2023Dynamic Prompt Learning: Addressing Cross-Attention Leakage for Text-Based Image Editingcited by 76
- 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67
- 2023RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressionscited by 43
- 2023TokenCompose: Text-to-Image Diffusion with Token-level Supervisioncited by 40
- 2023Prompting Hard or Hardly Prompting: Prompt Inversion for Text-to-Image Diffusion Modelscited by 40
- 2023Stable Diffusion is Unstablecited by 27
- 2025EmotiCrafter: Text-to-Emotional-Image Generation based on Valence-Arousal Modelcited by 26
- 2023Tailored Visions: Enhancing Text-to-Image Generation with Personalized Prompt Rewritingcited by 23
- 2023BeautifulPrompt: Towards Automatic Prompt Engineering for Text-to-Image Synthesiscited by 18
- 2025VSC: Visual Search Compositional Text-to-Image Diffusion Modelcited by 7
- 2025Iterative Prompt Refinement for Safer Text-to-Image Generationcited by 6
- 2025EmoCtrl: Controllable Emotional Image Content Generationcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Emotion-Aware Image Generation from Korean Diary Text via LLM-based Prompt Translation and LoRA Fine-Tuning
- 2026Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoring
- 2025MUSE: Manipulating Unified Framework for Synthesizing Emotions in Images via Test-Time Optimization
- 2026EmoGenie: Benchmarking and Evaluating Expressed and Evoked Emotion in T2I Generation with MLLMs
- 2024Generating Fearful Images: Investigating Potential Emotional Biases in Image-Generation Models
- 2026Personalized Emotional Intelligence in Generative AI through Symbolic Affective Reasoning
- 2025Emotion-Director: Bridging Affective Shortcut in Emotion-Oriented Image Generation
- 2024Make Me Happier: Evoking Emotions Through Image Diffusion Models