SpatialReward: Verifiable Spatial Reward Modeling for Fine-Grained Spatial Consistency in Text-to-Image Generation
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Recent advances in text-to-image (T2I) generation via reinforcement learning (RL) have benefited from reward models that assess semantic alignment and visual quality. However, most existing reward models pay limited attention to fine-grained spatial relationships, often producing images that appear plausible overall yet contain inaccuracies in object positioning. In this work, we present SpatialReward, a verifiable reward model explicitly designed to evaluate spatial layouts in generated images. SpatialReward adopts a multi-stage pipeline: a Prompt Decomposer extracts entities, attributes, and spatial metadata from free-form prompts; expert detectors provide accurate visual grounding of object positions and attributes; and a vision-language model applies chain-of-thought reasoning over grounded observations to assess complex spatial relations that are challenging for rule-based methods. To more comprehensively evaluate spatial relationships in generated images, we introduce SpatRelBench, a benchmark covering object attributes, orientation, inter-object relations, and rendered text placement. Experiments on Stable Diffusion and FLUX show that incorporating SpatialReward into RL training consistently improves spatial consistency and overall generation quality, with results aligned more closely to human judgments. These findings indicate that verifiable reward models hold considerable potential for enabling more accurate and controllable optimization in text-to-image generation models.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 63 of its 77 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
63 of 77 references.
Closest ancestors · 7
Same direction, newest first
- 2025VR-Thinker: Boosting Video Reward Models through Thinking-with-Image Reasoning12 Oct
- 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDE29 Jul
- 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
- 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuning6 May
- 2025Unified Reward Model for Multimodal Understanding and Generation7 Mar
- 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generation30 Dec
- 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov
Other references · 56
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2016Improved Techniques for Training GANscited by 2,938
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
38 more
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 679
- 2023RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignmentcited by 672
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2022When and why vision-language models behave like bags-of-words, and what to do about it?cited by 603
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
- 2018Learning to Compose Dynamic Tree Structures for Visual Contextscited by 258
- 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
- 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 242
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2022ReCo: Region-Controlled Text-to-Image Generationcited by 177
- 2022CREPE: Can Vision-Language Foundation Models Reason Compositionally?cited by 177
- 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
- 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 105
- 2022Benchmarking Spatial Relationships in Text-to-Image Generationcited by 96
- 2024Understanding Hallucinations in Diffusion Models through Mode Interpolationcited by 87
- 2024Unified Hallucination Detection for Multimodal Large Language Modelscited by 75
- 2024Commonsense-T2I Challenge: Can Text-to-Image Generation Models Understand Commonsense?cited by 52
- 2023Equivariant Similarity for Vision-Language Foundation Modelscited by 51
- 2023Revisiting the Role of Language Priors in Vision-Language Modelscited by 50
- 2024Make It Count: Text-to-Image Generation with an Accurate Number of Objectscited by 47
- 2024Orient Anything: Learning Robust Object Orientation Estimation from Rendering 3D Modelscited by 45
- 2023Text encoders bottleneck compositionality in contrastive vision-language modelscited by 34
- 2025MedEyes: Learning Dynamic Visual Focus for Medical Progressive Diagnosiscited by 32
- 2024Getting it Right: Improving Spatial Consistency in Text-to-Image Modelscited by 30
- 2024Schedule On the Fly: Diffusion Time Prediction for Faster and Better Image Generationcited by 29
- 2024Enhancing Semantic Fidelity in Text-to-Image Synthesis: Attention Regulation in Diffusion Modelscited by 27
- 2025Pathology-Aware Prototype Evolution via LLM-Driven Semantic Disambiguation for Multicenter Diabetic Retinopathy Diagnosiscited by 22
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026DDA-Thinker: Decoupled Dual-Atomic Reinforcement Learning for Reasoning-Driven Image Editingcited by 2
- 2026Verifiable Visual Rewards Transfer from Synthetic Scenes to Natural Promptscited by 1
- 2026DINO-VO: Learning Where to Focus for Enhanced State Estimationcited by 0
- 2026Hierarchical Codec Diffusion for Video-to-Speech Generationcited by 0
- 2026Verifiable Visual Rewards Transfer from Synthetic Scenes to Natural Prompts28 Sep 2026
- 2026DDA-Thinker: Decoupled Dual-Atomic Reinforcement Learning for Reasoning-Driven Image Editing28 Apr 2026
- 2026Hierarchical Codec Diffusion for Video-to-Speech Generation17 Apr 2026
- 2026DINO-VO: Learning Where to Focus for Enhanced State Estimation5 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Enhancing Spatial Understanding in Image Generation via Reward Modeling
- 2026SpatialBench-UC: Uncertainty-Aware Evaluation of Spatial Prompt Following in Text-to-Image Generation
- 2026SpatialReward: Bridging the Perception Gap in Online RL for Image Editing via Explicit Spatial Reasoning
- 2026Everything in Its Place: Benchmarking Spatial Intelligence of Text-to-Image Models
- 2026SpatialGuard: Harness-Guided Verifiable Spatial Reasoning for Text-to-Image Generation
- 2024CoMPaSS: Enhancing Spatial Understanding in Text-to-Image Diffusion Models
- 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning
- 2026Self-Corrected Image Generation with Explainable Latent Rewards