mlsanityData to 7 Oct 2026

ICG: Improving Cover Image Generation via MLLM-based Prompting and Personalized Preference Alignment

arXiv 2605.27374 ↗First posted 8 Apr 2026cs.CLcited by 2

On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning

also in 2 more
Abstract (arXiv)

Recent advances in multimodal large language models (MLLMs) and diffusion models (DMs) have opened new possibilities for AI-generated content. Yet, personalized cover image generation remains underexplored, despite its critical role in boosting user engagement on digital platforms. We propose ICG, a novel framework that integrates MLLM-based prompting with personalized preference alignment to generate high-quality, contextually relevant covers. ICG extracts semantic features from item titles and reference images via meta tokens, refines them with user embeddings, and injects the resulting personalized context into the diffusion model. To address the lack of labeled supervision, we adopt a multi-reward learning strategy that combines public aesthetic and relevance rewards with a personalized preference model trained from user behavior. Unlike prior pipelines relying on handcrafted prompts and disjointed modules, ICG employs an adapter to bridge MLLMs and diffusion models for end-to-end training. Experiments demonstrate that ICG significantly improves image quality, semantic fidelity, and personalization, leading to stronger user appeal and offline recommendation accuracy in downstream tasks. As a plug-and-play adapter bridging MLLMs and diffusion models, ICG is compatible with common checkpoints and requires no ground-truth labels during optimization.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 18 of its 37 references that are in the map. First posted on arXiv 8 Apr 2026.

Builds on

18 of 37 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024ILLUME: Illuminating Your LLMs to See, Draw, and Self-Enhance9 Dec
  2. 2024MoMA: Multimodal LLM Adapter for Fast Personalized Image Generation8 Apr
  3. 2023LLMGA: Multimodal Large Language Model based Generation Assistant27 Nov
  4. 2023Generating Images with Multimodal Language Models26 May

Other references · 14

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  6. 2016Improved Techniques for Training GANscited by 2,938
  7. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  8. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
  9. 2025Transfer between Modalities with MetaQueriescited by 231
  10. 2023Making LLaMA SEE and Draw with SEED Tokenizercited by 184
  11. 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 162
  12. 2024A New Creative Generation Pipeline for Click-Through Rate with Stable Diffusion Modelcited by 26
2 more
  1. 2024A User-Friendly Framework for Generating Model-Preferred Prompts in Text-to-Image Synthesiscited by 7
  2. 2022Conditional Vector Graphics Generation for Music Cover Imagescited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Instant Preference Alignment for Text-to-Image Diffusion Models
  2. 2025PrefGen: Multimodal Preference Learning for Preference-Conditioned Image Generation
  3. 2026Premier: Personalized Preference Modulation with Learnable User Embedding in Text-to-Image Generation
  4. 2026Personalize at Test Time: Learning User Preferences for Image Generation
  5. 2025Personalized Image Generation for Recommendations Beyond Catalogs
  6. 2025Personalized Preference Fine-tuning of Diffusion Models
  7. 2024PMG : Personalized Multimodal Generation with Large Language Models
  8. 2024Personalized Image Generation with Large Multimodal Models