mlsanityData to 7 Oct 2026

Uni-Synergy: Bridging Understanding and Generation for Personalized Reasoning via Co-operative Reinforcement Learning

arXiv 2605.10445 ↗First posted 11 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Unified Multimodal Models (UMMs) excel in general tasks but struggle to bridge the gap between personalized understanding and generation. Prior works largely rely on implicit token-level alignment via supervised fine-tuning, which fails to fully capture the potential synergy between comprehension and creation. In this work, we propose Sync-R1, an end-to-end reinforcement learning framework that jointly optimizes personalized understanding and generation within a single, explicit reasoning loop. Through this unified feedback process, Sync-R1 enables personalized comprehension to guide content creation, while the resulting generation quality reciprocally refines understanding within an integrated reward landscape. To efficiently orchestrate this dual-task synergy, we introduce Sync-GRPO, a reinforcement learning method utilizing an ensemble reward system. Furthermore, we propose Dynamic Group Scaling (DGS), which adaptively filters low-potential trajectories to reduce gradient variance and accelerate convergence. To better reflect real-world complexity, we introduce UnifyBench++, featuring denser textual descriptions and richer user contexts. Experimental results demonstrate that Sync-R1 achieves state-of-the-art performance, showcasing superior cross-task reasoning and robust personalization without requiring complex cold-start procedures. The code and the UnifyBench++ dataset will be released at: https://github.com/arctanxarc/UniCTokens.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 51 of its 62 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

51 of 62 references.

References · 51

  1. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  2. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  3. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  4. 2021Program Synthesis with Large Language Modelscited by 3,509
  5. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  6. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  7. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  8. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  9. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,276
  10. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
  11. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  12. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
38 more
  1. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
  2. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
  3. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
  4. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
  5. 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 450
  6. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
  7. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  8. 2018Deep Face Recognition: A Surveycited by 275
  9. 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 258
  10. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
  11. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 234
  12. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 172
  13. 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Modelcited by 163
  14. 2024Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokenscited by 147
  15. 2025GPG: A Simple and Strong Reinforcement Learning Baseline for Model Reasoningcited by 147
  16. 2023Planting a SEED of Vision in Large Language Modelcited by 140
  17. 2024MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data Enginecited by 111
  18. 2023Diversify Your Vision Datasets with Automatic Diffusion-Based Augmentationcited by 100
  19. 2025What's Behind PPO's Collapse in Long-CoT? Value Optimization Holds the Secretcited by 95
  20. 2025Sample More to Think Less: Group Filtered Policy Optimization for Concise Reasoningcited by 75
  21. 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoningcited by 59
  22. 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 55
  23. 2025UniGen: Enhanced Training & Test-Time Strategies for Unified Multimodal Understanding and Generationcited by 32
  24. 2025Selftok: Discrete Visual Tokens of Autoregression, by Diffusion, and for Reasoningcited by 31
  25. 2025Delving into RL for Image Generation with CoT: A Study on DPO vs. GRPOcited by 31
  26. 2025MindOmni: Unleashing Reasoning Generation in Vision Language Models with RGPOcited by 30
  27. 2025ReasonGen-R1: CoT for Autoregressive Image generation models through SFT and RLcited by 30
  28. 2024RAP: Retrieval-Augmented Personalization for Multimodal Large Language Modelscited by 24
  29. 2026M2A: Multimodal Memory Agent with Dual-Layer Hybrid Memory for Long-Term Personalized Interactionscited by 20
  30. 2025video-SALMONN-o1: Reasoning-enhanced Audio-visual Large Language Modelcited by 19
  31. 2025Co-Reinforcement Learning for Unified Multimodal Understanding and Generationcited by 15
  32. 2025MANZANO: A Simple and Scalable Unified Multimodal Model with a Hybrid Vision Tokenizercited by 15
  33. 2023InstructSeq: Unifying Vision Tasks with Instruction-conditioned Multi-modal Sequence Generationcited by 14
  34. 2025The Synergy Dilemma of Long-CoT SFT and RL: Investigating Post-Training Techniques for Reasoning VLMscited by 12
  35. 2025MM-R1: Unleashing the Power of Unified Multimodal Large Language Models for Personalized Image Generationcited by 9
  36. 2025Self-Reflective Reinforcement Learning for Diffusion-based Image Reasoning Generationcited by 6
  37. 2026Understanding vs. Generation: Navigating Optimization Dilemma in Multimodal Modelscited by 5
  38. 2025Concept-as-Tree: A Controllable Synthetic Data Framework Makes Stronger Personalized VLMscited by 4

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Endogenous Reprompting: Self-Evolving Cognitive Alignment for Unified Multimodal Models
  2. 2026Co-RL: Unsupervised Reasoning Emerges from Diverse Cohort in Multi-agent RL
  3. 2025OThink-MR1: Stimulating multimodal generalized reasoning capabilities via dynamic reinforcement learning
  4. 2024Diving into Self-Evolving Training for Multimodal Reasoning
  5. 2026Unified Personalized Reward Model for Vision Generation
  6. 2025GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoning
  7. 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
  8. 2026Seeing with You: Perception-Reasoning Coevolution for Multimodal Reasoning