Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generation
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Text-to-Image (T2I) models and Unified Multimodal Models (UMMs) have achieved remarkable progress in visual generation. However, their reliance on a single-pass generation paradigm limits their ability to handle complex prompts requiring iterative refinement. To enable multi-round Reflective Visual Generation (RVG), we formalize the Reason-Reflect-Rectify (R^3) loop as a core framework and introduce R^3-Bench, a benchmark of over 600 expert-annotated instances that quantifies iterative reasoning and rectification capabilities. Evaluation on R^3-Bench reveals a critical gap: while state-of-the-art models can identify generation errors, they fail to generate actionable rectification instructions. To bridge this gap, we propose R^3-Refiner, a dual-stage framework leveraging Group Relative Policy Optimization (GRPO) and a Hierarchical Reward Mechanism (HRM) to better align rectification with reflective reasoning. Experiments show that R^3-Refiner achieves significant improvements on R^3-Bench (+12.0% in Reflective Verdict Score, +9.0% in Rectification Score), and can be seamlessly integrated with various MLLMs to enhance the generation quality of different T2I models on GenEval++ and T2I-CompBench. Code is available at https://github.com/xiaomoguhz/R3-Bench.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 68 of its 87 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
68 of 87 references.
Closest ancestors · 12
Same direction, newest first
- 2025ThinkGen: Generalized Thinking for Visual Generation29 Dec
- 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Models27 Nov
- 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning30 Oct
- 2025Generative Universal Verifier as Multimodal Meta-Reasoner15 Oct
- 2025Beyond Textual CoT: Interleaved Text-Image Chains with Deep Confidence Reasoning for Image Editing9 Oct
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generation24 Aug
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision7 Aug
- 2025Sherlock: Self-Correcting Reasoning in Vision-Language Models28 May
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
- 2025Kimi-VL Technical Report10 Apr
- 2025MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models4 Apr
Other references · 56
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2025SAM 3: Segment Anything with Conceptscited by 835
38 more
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 405
- 2025Seed1.5-VL Technical Reportcited by 367
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuningcited by 167
- 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Modelscited by 154
- 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 108
- 2025Thinkless: LLM Learns When to Thinkcited by 107
- 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
- 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 83
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 81
- 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
- 2025Kwai Keye-VL 1.5 Technical Reportcited by 68
- 2025SEAL: Steerable Reasoning Calibration of Large Language Models for Freecited by 65
- 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 64
- 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 58
- 2025ILLUME+: Illuminating Unified MLLM with Dual Visual Tokenization and Diffusion Refinementcited by 53
- 2025BLIP3o-NEXT: Next Frontier of Native Image Generationcited by 50
- 2025OpenUni: A Simple Baseline for Unified Multimodal Understanding and Generationcited by 45
- 2025InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generationcited by 43
- 2025Reflect-DiT: Inference-Time Scaling for Text-to-Image Diffusion Transformers via In-Context Reflectioncited by 42
- 2025Interleaving Reasoning for Better Text-to-Image Generationcited by 40
- 2025Think When You Need: Self-Adaptive Chain-of-Thought Learningcited by 37
- 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Modelcited by 34
- 2025RealUnify: Do Unified Models Truly Benefit from Unification? A Comprehensive Benchmarkcited by 33
- 2025Mitigating Overthinking in Large Reasoning Models via Manifold Steeringcited by 32
- 2025Thinking Fast and Right: Balancing Accuracy and Reasoning Length with Adaptive Rewardscited by 20
- 2025On Reasoning Strength Planning in Large Reasoning Modelscited by 13
- 2025Fractional Reasoning via Latent Steering Vectors Improves Inference Time Computecited by 11
50 most cited of 56 All 56 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ReasonGen-R1: CoT for Autoregressive Image generation models through SFT and RL
- 2025Thinking-while-Generating: Interleaving Textual Reasoning throughout Visual Generation
- 2025CRAFT: Continuous Reasoning and Agentic Feedback Tuning for Multimodal Text-to-Image Generation
- 2026Large Language Models are Universal Reasoners for Visual Generation
- 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation
- 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning
- 2026GenPuzzle: Benchmarking Visual Reasoning in Image Generation Models
- 2026When Does Visual Generation Help Visual Understanding in Unified Multimodal Models?