Enhancing Spatial Understanding in Image Generation via Reward Modeling
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Recent progress in text-to-image generation has greatly advanced visual fidelity and creativity, but it has also imposed higher demands on prompt complexity-particularly in encoding intricate spatial relationships. In such cases, achieving satisfactory results often requires multiple sampling attempts. To address this challenge, we introduce a novel method that strengthens the spatial understanding of current image generation models. We first construct the SpatialReward-Dataset with over 80k preference pairs. Building on this dataset, we build SpatialScore, a reward model designed to evaluate the accuracy of spatial relationships in text-to-image generation, achieving performance that even surpasses leading proprietary models on spatial evaluation. We further demonstrate that this reward model effectively enables online reinforcement learning for the complex spatial generation. Extensive experiments across multiple benchmarks show that our specialized reward model yields significant and consistent gains in spatial understanding for image generation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 46 of its 55 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
46 of 55 references.
Closest ancestors · 7
Same direction, newest first
- 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learning28 Aug
- 2025TempFlow-GRPO: When Timing Matters for GRPO in Flow Models6 Aug
- 2025HPSv3: Towards Wide-Spectrum Human Preference Score5 Aug
- 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDE29 Jul
- 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
- 2025Unified Reward Model for Multimodal Understanding and Generation7 Mar
- 2025Improving Video Generation with Human Feedback23 Jan
Other references · 39
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
27 more
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
- 2025Qwen-Image Technical Reportcited by 973
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
- 2024Diffusion Policy Policy Optimizationcited by 255
- 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 220
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 162
- 2025Seedream 3.0 Technical Reportcited by 146
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2025Epona: Autoregressive Diffusion World Model for Autonomous Drivingcited by 115
- 2023LLaVA-Grounding: Grounded Visual Chat with Large Multimodal Modelscited by 113
- 2024Learning Multi-dimensional Human Preference for Text-to-Image Generationcited by 102
- 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 64
- 2024VideoGLaMM: A Large Multimodal Model for Pixel-Level Visual Grounding in Videoscited by 51
- 2025GRPO-Guard: Mitigating Implicit Over-Optimization in Flow Matching via Regulated Clippingcited by 48
- 2024Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cyclecited by 36
- 2025UniGenBench++: A Unified Semantic Evaluation Benchmark for Text-to-Image Generationcited by 23
- 2025Science-T2I: Addressing Scientific Illusions in Image Synthesiscited by 15
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026SpatialReward: Verifiable Spatial Reward Modeling for Fine-Grained Spatial Consistency in Text-to-Image Generation
- 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning
- 2026STAR: SpatioTemporal Adaptive Reward Allocation for Text-to-Image RL Post-Training
- 2023Unlocking Spatial Comprehension in Text-to-Image Diffusion Models
- 2026SpatialReward: Bridging the Perception Gap in Online RL for Image Editing via Explicit Spatial Reasoning
- 2026Exploring Spatial Intelligence from a Generative Perspective
- 2026RL-RIG: A Generative Spatial Reasoner via Intrinsic Reflection
- 2026Everything in Its Place: Benchmarking Spatial Intelligence of Text-to-Image Models