mlsanityData to 14 Oct 2026

MM-R1: Unleashing the Power of Unified Multimodal Large Language Models for Personalized Image Generation

arXiv 2508.11433 ↗First posted 15 Aug 2025cs.CVcited by 9

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Multimodal Large Language Models (MLLMs) with unified architectures excel across a wide range of vision-language tasks, yet aligning them with personalized image generation remains a significant challenge. Existing methods for MLLMs are frequently subject-specific, demanding a data-intensive fine-tuning process for every new subject, which limits their scalability. In this paper, we introduce MM-R1, a framework that integrates a cross-modal Chain-of-Thought (X-CoT) reasoning strategy to unlock the inherent potential of unified MLLMs for personalized image generation. Specifically, we structure personalization as an integrated visual reasoning and generation process: (1) grounding subject concepts by interpreting and understanding user-provided images and contextual cues, and (2) generating personalized images conditioned on both the extracted subject representations and user prompts. To further enhance the reasoning capability, we adopt Grouped Reward Proximal Policy Optimization (GRPO) to explicitly align the generation. Experiments demonstrate that MM-R1 unleashes the personalization capability of unified MLLMs to generate images with high subject fidelity and strong text alignment in a zero-shot manner.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 42 references that are in the map. First posted on arXiv 15 Aug 2025.

Builds on

30 of 42 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning22 May
  2. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
  3. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
  4. 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan

Other references · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  7. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  8. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  10. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  12. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
14 more
  1. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  2. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  3. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  4. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  5. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  6. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  7. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
  8. 2024Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretrainingcited by 150
  9. 2025Visual Planning: Let's Think Only with Imagescited by 85
  10. 2025YoChameleon: Personalized Vision and Language Generationcited by 20
  11. 2024X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Modelscited by 15
  12. 2025Motion-R1: Enhancing Motion Generation with Decomposed Chain-of-Thought and RL Bindingcited by 9
  13. 2025Proxy-Tuning: Tailoring Multimodal Autoregressive Models for Subject-Driven Image Generationcited by 6
  14. 2025Personalized Text-to-Image Generation with Auto-Regressive Modelscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 8.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026FiRe: Fine-grained Multimodal Reasoning for Enhanced Image Generation
  2. 2025MMPB: It's Time for Multi-Modal Personalization
  3. 2026Unified Personalized Understanding, Generating and Editing
  4. 2026Contextualized Visual Personalization in Vision-Language Models
  5. 2025Personalization Toolkit: Training Free Personalization of Large Vision Language Models
  6. 2023Kosmos-G: Generating Images in Context with Multimodal Large Language Models
  7. 2024MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning
  8. 2024Personalized Large Vision-Language Models