SpatialReward: Bridging the Perception Gap in Online RL for Image Editing via Explicit Spatial Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Online Reinforcement Learning (RL) offers a promising avenue for complex image editing but is currently constrained by the scarcity of reliable and fine-grained reward signals. Existing evaluators frequently struggle with a critical perception gap we term "Attention Collapse," where models neglect cross-image comparisons and fail to capture fine-grained details, resulting in inaccurate perception and miscalibrated scores. To address these limitations, we propose SpatialReward, a reward model that enforces precise verification via explicit spatial reasoning. By anchoring reasoning to predicted edit regions, SpatialReward grounds semantic judgments in pixel-level evidence, significantly enhancing evaluative accuracy. Trained on a curated 260k spatial-aware dataset, our model achieves state-of-the-art performance on MMRB2 and EditReward-Bench, and outperforms proprietary evaluators on our proposed MultiEditReward-Bench. Furthermore, SpatialReward serves as a robust signal in online RL, boosting OmniGen2 by +0.90 on GEdit-Bench--surpassing the leading discriminative model and doubling the gain of GPT-4.1 (+0.45). These results demonstrate that spatial reasoning is essential for unlocking effective alignment in image editing.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 46 references that are in the map. First posted on arXiv 7 Feb 2026.
Builds on
26 of 46 references.
References · 26
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 891
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
14 more
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 498
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
- 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 148
- 2025RewardDance: Reward Scaling in Visual Generationcited by 63
- 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modelingcited by 61
- 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editingcited by 59
- 2025Skywork UniPic 2.0: Building Kontext Model with Online RL for Unified Multimodal Modelcited by 38
- 2025OneReward: Unified Mask-Guided Image Generation via Multi-Task Human Preference Learningcited by 22
- 2025Multimodal RewardBench 2: Evaluating Omni Reward Models for Interleaved Text and Imagecited by 16
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026OpenSpatial: A Principled Data Engine for Empowering Spatial Intelligencecited by 4
- 2026Region-Constrained Group Relative Policy Optimization for Flow-Based Image Editingcited by 2
- 2026SpatialFlow-GRPO: Where Spatial Credit Drives Image Editingcited by 1
- 2026Can We Perform Online RL for Image Editing without Editing Rewards?cited by 1
- 2026DivRL: Disentangled Self-Similarity Rewards for Diverse Subject-Driven Generationcited by 0
- 2026Can We Perform Online RL for Image Editing without Editing Rewards?24 Aug 2026
- 2026SpatialFlow-GRPO: Where Spatial Credit Drives Image Editing25 Jun 2026
- 2026DivRL: Disentangled Self-Similarity Rewards for Diverse Subject-Driven Generation22 Jun 2026
- 2026Region-Constrained Group Relative Policy Optimization for Flow-Based Image Editing10 Apr 2026
- 2026OpenSpatial: A Principled Data Engine for Empowering Spatial Intelligence8 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026SpatialReward: Verifiable Spatial Reward Modeling for Fine-Grained Spatial Consistency in Text-to-Image Generation
- 2026Edit-Compass & EditReward-Compass: A Unified Benchmark for Image Editing and Reward Modeling
- 2026ThinkRL-Edit: Thinking in Reinforcement Learning for Reasoning-Centric Image Editing
- 2026PhysEdit: Physically-Consistent Region-Aware Image Editing via Adaptive Spatio-Temporal Reasoning
- 2026Leveraging Verifier-Based Reinforcement Learning in Image Editing
- 2026Generative Visual Chain-of-Thought for Image Editing
- 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
- 2026Enhancing Spatial Understanding in Image Generation via Reward Modeling