mlsanityData to 7 Oct 2026

SpatialReward: Verifiable Spatial Reward Modeling for Fine-Grained Spatial Consistency in Text-to-Image Generation

arXiv 2603.22228 ↗First posted 23 Mar 2026cs.CV cs.AIcited by 4

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Recent advances in text-to-image (T2I) generation via reinforcement learning (RL) have benefited from reward models that assess semantic alignment and visual quality. However, most existing reward models pay limited attention to fine-grained spatial relationships, often producing images that appear plausible overall yet contain inaccuracies in object positioning. In this work, we present SpatialReward, a verifiable reward model explicitly designed to evaluate spatial layouts in generated images. SpatialReward adopts a multi-stage pipeline: a Prompt Decomposer extracts entities, attributes, and spatial metadata from free-form prompts; expert detectors provide accurate visual grounding of object positions and attributes; and a vision-language model applies chain-of-thought reasoning over grounded observations to assess complex spatial relations that are challenging for rule-based methods. To more comprehensively evaluate spatial relationships in generated images, we introduce SpatRelBench, a benchmark covering object attributes, orientation, inter-object relations, and rendered text placement. Experiments on Stable Diffusion and FLUX show that incorporating SpatialReward into RL training consistently improves spatial consistency and overall generation quality, with results aligned more closely to human judgments. These findings indicate that verifiable reward models hold considerable potential for enabling more accurate and controllable optimization in text-to-image generation models.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 63 of its 77 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

63 of 77 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025VR-Thinker: Boosting Video Reward Models through Thinking-with-Image Reasoning12 Oct
  2. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDE29 Jul
  3. 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
  4. 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuning6 May
  5. 2025Unified Reward Model for Multimodal Understanding and Generation7 Mar
  6. 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generation30 Dec
  7. 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov

Other references · 56

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  10. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  11. 2016Improved Techniques for Training GANscited by 2,938
  12. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
38 more
  1. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  2. 2021Grounded Language-Image Pre-trainingcited by 1,147
  3. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  4. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  5. 2023Training Diffusion Models with Reinforcement Learningcited by 939
  6. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  7. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  8. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 679
  9. 2023RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignmentcited by 672
  10. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  11. 2022When and why vision-language models behave like bags-of-words, and what to do about it?cited by 603
  12. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
  13. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
  14. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
  15. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
  16. 2018Learning to Compose Dynamic Tree Structures for Visual Contextscited by 258
  17. 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
  18. 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 242
  19. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
  20. 2022ReCo: Region-Controlled Text-to-Image Generationcited by 177
  21. 2022CREPE: Can Vision-Language Foundation Models Reason Compositionally?cited by 177
  22. 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
  23. 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
  24. 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 105
  25. 2022Benchmarking Spatial Relationships in Text-to-Image Generationcited by 96
  26. 2024Understanding Hallucinations in Diffusion Models through Mode Interpolationcited by 87
  27. 2024Unified Hallucination Detection for Multimodal Large Language Modelscited by 75
  28. 2024Commonsense-T2I Challenge: Can Text-to-Image Generation Models Understand Commonsense?cited by 52
  29. 2023Equivariant Similarity for Vision-Language Foundation Modelscited by 51
  30. 2023Revisiting the Role of Language Priors in Vision-Language Modelscited by 50
  31. 2024Make It Count: Text-to-Image Generation with an Accurate Number of Objectscited by 47
  32. 2024Orient Anything: Learning Robust Object Orientation Estimation from Rendering 3D Modelscited by 45
  33. 2023Text encoders bottleneck compositionality in contrastive vision-language modelscited by 34
  34. 2025MedEyes: Learning Dynamic Visual Focus for Medical Progressive Diagnosiscited by 32
  35. 2024Getting it Right: Improving Spatial Consistency in Text-to-Image Modelscited by 30
  36. 2024Schedule On the Fly: Diffusion Time Prediction for Faster and Better Image Generationcited by 29
  37. 2024Enhancing Semantic Fidelity in Text-to-Image Synthesis: Attention Regulation in Diffusion Modelscited by 27
  38. 2025Pathology-Aware Prototype Evolution via LLM-Driven Semantic Disambiguation for Multicenter Diabetic Retinopathy Diagnosiscited by 22

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Enhancing Spatial Understanding in Image Generation via Reward Modeling
  2. 2026SpatialBench-UC: Uncertainty-Aware Evaluation of Spatial Prompt Following in Text-to-Image Generation
  3. 2026SpatialReward: Bridging the Perception Gap in Online RL for Image Editing via Explicit Spatial Reasoning
  4. 2026Everything in Its Place: Benchmarking Spatial Intelligence of Text-to-Image Models
  5. 2026SpatialGuard: Harness-Guided Verifiable Spatial Reasoning for Text-to-Image Generation
  6. 2024CoMPaSS: Enhancing Spatial Understanding in Text-to-Image Diffusion Models
  7. 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning
  8. 2026Self-Corrected Image Generation with Explainable Latent Rewards