Qwen-Image-2.0-RL Technical Report
On the map: Diffusion models → Image generation, text-to-image and editing
also in 1 more
Abstract (arXiv)
We present Qwen-Image-2.0-RL, a post-training pipeline that applies reinforcement learning from human feedback (RLHF) and on-policy distillation (OPD) to improve both the visual quality and instruction-following capability of the Qwen-Image-2.0 diffusion model. To provide reliable reward signals, we construct task-specific composite reward models by fine-tuning vision-language models with a pointwise scoring paradigm and chain-of-thought reasoning. For text-to-image generation, the reward models cover alignment, aesthetics, and portrait fidelity dimensions. For image editing tasks, the reward system addresses instruction-following accuracy and face identity preservation. Building on this reward system, we develop a scalable GRPO-based RL training framework, incorporating a hybrid classifier-free guidance (CFG) strategy to preserve pre-trained knowledge, prompt curation via intra-group reward range filtering, and per-category reward weight calibration. To merge the task-specialized RL policies for T2I and editing, we propose on-policy distillation as the final training stage, which consolidates multiple teachers into a single student model through trajectory-level velocity matching. Extensive evaluation shows that Qwen-Image-2.0-RL achieves 57.84 overall score on Qwen-Image-Bench (+2.61 over the base model), Elo ratings of 1193 in text-to-image arena (+78) and 1349 in image edit arena (+93), demonstrating consistent gains in aesthetic quality, prompt adherence, and editing accuracy.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 37 of its 39 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
37 of 39 references.
Closest ancestors · 1
Same direction, newest first
Other references · 36
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
24 more
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2025Qwen-Image Technical Reportcited by 973
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
- 2025Unified Reward Model for Multimodal Understanding and Generationcited by 194
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 175
- 2025Seedream 3.0 Technical Reportcited by 146
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2023Error Bounds for Flow Matching Methodscited by 88
- 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuningcited by 86
- 2025RewardDance: Reward Scaling in Visual Generationcited by 63
- 2025Advantage Weighted Matching: Aligning RL with Pretraining in Diffusion Modelscited by 59
- 2025GRPO-Guard: Mitigating Implicit Over-Optimization in Flow Matching via Regulated Clippingcited by 48
- 2026DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Modelscited by 35
- 2026Flow-OPD: On-Policy Distillation for Flow Matching Modelscited by 29
- 2026Qwen-Image-2.0 Technical Reportcited by 28
- 2026Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluationcited by 16
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Can We Perform Online RL for Image Editing without Editing Rewards?
- 2026Trust Your Critic: Robust Reward Modeling and Reinforcement Learning for Faithful Image Editing and Generation
- 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modeling
- 2026Leveraging Verifier-Based Reinforcement Learning in Image Editing
- 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Reward
- 2026Understanding Reward Hacking in Text-to-Image Reinforcement Learning
- 2026Evaluation-Verification Reward for Consistent Multi-Reference Image Editing
- 2026Finite Difference Flow Optimization for RL Post-Training of Text-to-Image Models