mlsanityData to 7 Oct 2026

Personalized Image Generation from an Author Writing Style

arXiv 2507.03313 ↗First posted 4 Jul 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Translating nuanced, textually-defined authorial writing styles into compelling visual representations presents a novel challenge in generative AI. This paper introduces a pipeline that leverages Author Writing Sheets (AWS) - structured summaries of an author's literary characteristics - as input to a Large Language Model (LLM, Claude 3.7 Sonnet). The LLM interprets the AWS to generate three distinct, descriptive text-to-image prompts, which are then rendered by a diffusion model (Stable Diffusion 3.5 Medium). We evaluated our approach using 49 author styles from Reddit data, with human evaluators assessing the stylistic match and visual distinctiveness of the generated images. Results indicate a good perceived alignment between the generated visuals and the textual authorial profiles (mean style match: 4.08/5), with images rated as moderately distinctive. Qualitative analysis further highlighted the pipeline's ability to capture mood and atmosphere, while also identifying challenges in representing highly abstract narrative elements. This work contributes a novel end-to-end methodology for visual authorial style personalization and provides an initial empirical validation, opening avenues for applications in creative assistance and cross-modal understanding.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 23 references that are in the map. First posted on arXiv 4 Jul 2025.

Builds on

16 of 23 references.

References · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  9. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  10. 2023MusicLM: Generating Music From Textcited by 442
  11. 2024Personalization of Large Language Models: A Surveycited by 100
  12. 2022Personalized Prompt Learning for Explainable Recommendationcited by 79
4 more
  1. 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
  2. 2019Towards Controllable and Personalized Review Generationcited by 24
  3. 2024Task Supportive and Personalized Human-Large Language Model Interaction: A User Studycited by 17
  4. 2025Whose story is it? Personalizing story generation by inferring author stylescited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Personalized Scientific Figure Caption Generation: An Empirical Study on Author-Specific Writing Style Transfer
  2. 2022Language Does More Than Describe: On The Lack Of Figurative Speech in Text-To-Image Models
  3. 2024ORACLE: Leveraging Mutual Information for Consistent Character Generation with LoRAs in Diffusion Models
  4. 2025StyleBlend: Enhancing Style-Specific Content Creation in Text-to-Image Diffusion Models
  5. 2024StyleForge: Enhancing Text-to-Image Synthesis for Any Artistic Styles with Dual Binding
  6. 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Models
  7. 2025Personalized Text Generation with Contrastive Activation Steering
  8. 2023WordStylist: Styled Verbatim Handwritten Text Generation with Latent Diffusion Models