MM-R1: Unleashing the Power of Unified Multimodal Large Language Models for Personalized Image Generation
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) with unified architectures excel across a wide range of vision-language tasks, yet aligning them with personalized image generation remains a significant challenge. Existing methods for MLLMs are frequently subject-specific, demanding a data-intensive fine-tuning process for every new subject, which limits their scalability. In this paper, we introduce MM-R1, a framework that integrates a cross-modal Chain-of-Thought (X-CoT) reasoning strategy to unlock the inherent potential of unified MLLMs for personalized image generation. Specifically, we structure personalization as an integrated visual reasoning and generation process: (1) grounding subject concepts by interpreting and understanding user-provided images and contextual cues, and (2) generating personalized images conditioned on both the extracted subject representations and user prompts. To further enhance the reasoning capability, we adopt Grouped Reward Proximal Policy Optimization (GRPO) to explicitly align the generation. Experiments demonstrate that MM-R1 unleashes the personalization capability of unified MLLMs to generate images with high subject fidelity and strong text alignment in a zero-shot manner.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 42 references that are in the map. First posted on arXiv 15 Aug 2025.
Builds on
30 of 42 references.
Closest ancestors · 4
Same direction, newest first
- 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning22 May
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
- 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
Other references · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
14 more
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
- 2024Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretrainingcited by 150
- 2025Visual Planning: Let's Think Only with Imagescited by 85
- 2025YoChameleon: Personalized Vision and Language Generationcited by 20
- 2024X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Modelscited by 15
- 2025Motion-R1: Enhancing Motion Generation with Decomposed Chain-of-Thought and RL Bindingcited by 9
- 2025Proxy-Tuning: Tailoring Multimodal Autoregressive Models for Subject-Driven Image Generationcited by 6
- 2025Personalized Text-to-Image Generation with Auto-Regressive Modelscited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 8.
9 papers.
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decodingcited by 12
- 2025Beyond Textual CoT: Interleaved Text-Image Chains with Deep Confidence Reasoning for Image Editingcited by 6
- 2026Addressing Overthinking in Large Vision-Language Models via Gated Perception-Reasoning Optimizationcited by 6
- 2026PhotoBench: Beyond Visual Matching Towards Personalized Intent-Driven Photo Retrievalcited by 2
- 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learningcited by 2
- 2026Mobile-O: Unified Multimodal Understanding and Generation on Mobile Devicecited by 1
- 2026Weaving Visual Narratives: Agentic Image Bundle Composition Beyond Atomic Visual Matchingcited by 1
- 2026Uni-Synergy: Bridging Understanding and Generation for Personalized Reasoning via Co-operative Reinforcement Learningcited by 0
- 2026PortraitGen: Exemplar-Driven GRPO with Dual-Reward Guidance for Photorealistic Portrait Generationcited by 0
- 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning13 Sep 2026
- 2026Weaving Visual Narratives: Agentic Image Bundle Composition Beyond Atomic Visual Matching27 Aug 2026
- 2026PortraitGen: Exemplar-Driven GRPO with Dual-Reward Guidance for Photorealistic Portrait Generation25 Jun 2026
- 2026Uni-Synergy: Bridging Understanding and Generation for Personalized Reasoning via Co-operative Reinforcement Learning11 May 2026
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decoding9 Mar 2026
- 2026PhotoBench: Beyond Visual Matching Towards Personalized Intent-Driven Photo Retrieval2 Mar 2026
- 2026Mobile-O: Unified Multimodal Understanding and Generation on Mobile Device23 Feb 2026
- 2026Addressing Overthinking in Large Vision-Language Models via Gated Perception-Reasoning Optimization7 Jan 2026
- 2025Beyond Textual CoT: Interleaved Text-Image Chains with Deep Confidence Reasoning for Image Editing9 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026FiRe: Fine-grained Multimodal Reasoning for Enhanced Image Generation
- 2025MMPB: It's Time for Multi-Modal Personalization
- 2026Unified Personalized Understanding, Generating and Editing
- 2026Contextualized Visual Personalization in Vision-Language Models
- 2025Personalization Toolkit: Training Free Personalization of Large Vision Language Models
- 2023Kosmos-G: Generating Images in Context with Multimodal Large Language Models
- 2024MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning
- 2024Personalized Large Vision-Language Models