mlsanityData to 7 Oct 2026

Enhancing Spatial Understanding in Image Generation via Reward Modeling

arXiv 2602.24233 ↗First posted 27 Feb 2026cs.CVcited by 1

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Recent progress in text-to-image generation has greatly advanced visual fidelity and creativity, but it has also imposed higher demands on prompt complexity-particularly in encoding intricate spatial relationships. In such cases, achieving satisfactory results often requires multiple sampling attempts. To address this challenge, we introduce a novel method that strengthens the spatial understanding of current image generation models. We first construct the SpatialReward-Dataset with over 80k preference pairs. Building on this dataset, we build SpatialScore, a reward model designed to evaluate the accuracy of spatial relationships in text-to-image generation, achieving performance that even surpasses leading proprietary models on spatial evaluation. We further demonstrate that this reward model effectively enables online reinforcement learning for the complex spatial generation. Extensive experiments across multiple benchmarks show that our specialized reward model yields significant and consistent gains in spatial understanding for image generation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 46 of its 55 references that are in the map. First posted on arXiv 27 Feb 2026.

Builds on

46 of 55 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learning28 Aug
  2. 2025TempFlow-GRPO: When Timing Matters for GRPO in Flow Models6 Aug
  3. 2025HPSv3: Towards Wide-Spectrum Human Preference Score5 Aug
  4. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDE29 Jul
  5. 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
  6. 2025Unified Reward Model for Multimodal Understanding and Generation7 Mar
  7. 2025Improving Video Generation with Human Feedback23 Jan

Other references · 39

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2022Flow Matching for Generative Modelingcited by 5,426
  9. 2025Qwen2.5-VL Technical Reportcited by 5,418
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  11. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  12. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
27 more
  1. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  2. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
  3. 2025Qwen-Image Technical Reportcited by 973
  4. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  5. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  6. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
  7. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  8. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
  9. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  10. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
  11. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
  12. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
  13. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
  14. 2024Diffusion Policy Policy Optimizationcited by 255
  15. 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 220
  16. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 162
  17. 2025Seedream 3.0 Technical Reportcited by 146
  18. 2025HunyuanImage 3.0 Technical Reportcited by 138
  19. 2025Epona: Autoregressive Diffusion World Model for Autonomous Drivingcited by 115
  20. 2023LLaVA-Grounding: Grounded Visual Chat with Large Multimodal Modelscited by 113
  21. 2024Learning Multi-dimensional Human Preference for Text-to-Image Generationcited by 102
  22. 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 64
  23. 2024VideoGLaMM: A Large Multimodal Model for Pixel-Level Visual Grounding in Videoscited by 51
  24. 2025GRPO-Guard: Mitigating Implicit Over-Optimization in Flow Matching via Regulated Clippingcited by 48
  25. 2024Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cyclecited by 36
  26. 2025UniGenBench++: A Unified Semantic Evaluation Benchmark for Text-to-Image Generationcited by 23
  27. 2025Science-T2I: Addressing Scientific Illusions in Image Synthesiscited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026SpatialReward: Verifiable Spatial Reward Modeling for Fine-Grained Spatial Consistency in Text-to-Image Generation
  2. 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning
  3. 2026STAR: SpatioTemporal Adaptive Reward Allocation for Text-to-Image RL Post-Training
  4. 2023Unlocking Spatial Comprehension in Text-to-Image Diffusion Models
  5. 2026SpatialReward: Bridging the Perception Gap in Online RL for Image Editing via Explicit Spatial Reasoning
  6. 2026Exploring Spatial Intelligence from a Generative Perspective
  7. 2026RL-RIG: A Generative Spatial Reasoner via Intrinsic Reflection
  8. 2026Everything in Its Place: Benchmarking Spatial Intelligence of Text-to-Image Models