Emotion-Aware Image Generation from Korean Diary Text via LLM-based Prompt Translation and LoRA Fine-Tuning
Not on the map. Why?
Abstract (arXiv)
T2I models cannot effectively capture sentiment from various types of text, including diaries, as they primarily focus on visual object-related patterns rather than contextual emotional understanding. This paper proposes an emotion-aware text-to-image pipeline that generates children's hand drawing style images from short Korean diary entries. The proposed pipeline employs Qwen3-8B for recognising implicit sentiment from short diaries, and Stable Diffusion 3.5 Medium fine-tuned with LoRA on children's drawing images with emotion-based trigger words for image generation. Additionally, this paper presents experiments examining the effect of emotion trigger words on generated images and discusses the limitations of CLIP Score as an evaluation metric for emotion-aware image generation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 9 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
5 of 9 references.
References · 5
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 300
- 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 268
- 2024EmoGen: Emotional Image Content Generation with Text-to-Image Diffusion Modelscited by 37
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MUSE: Manipulating Unified Framework for Synthesizing Emotions in Images via Test-Time Optimization
- 2026EPIG: Emotion-Based Prompting for Personalised Image Generation
- 2025Poetry in Pixels: Prompt Tuning for Poem Image Generation via Diffusion Models
- 2025Moodifier: MLLM-Enhanced Emotion-Driven Image Editing
- 2025CoEmoGen: Towards Semantically-Coherent and Scalable Emotional Image Content Generation
- 2026EmoStyle: Affective Conditioning of Style-Specialist Experts for Emotional Image Generation
- 2025KPoEM: A Human-Annotated Dataset for Emotion Classification and RAG-Based Poetry Generation in Korean Modern Poetry
- 2024Make Me Happier: Evoking Emotions Through Image Diffusion Models