Relation-R1: Progressively Cognitive Chain-of-Thought Guided Reinforcement Learning for Unified Relation Comprehension
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent advances in multi-modal large language models (MLLMs) have significantly improved object-level grounding and region captioning. However, they remain limited in visual relation understanding, struggling even with binary relation detection, let alone textitN-ary relations involving multiple semantic roles. The core reason is the lack of modeling for textitstructural semantic dependencies among multi-entities, leading to unreliable outputs, hallucinations, and over-reliance on language priors (eg, defaulting to ``person drinks a milk'' if a person is merely holding it). To this end, we propose Relation-R1, the textitfirst unified relation comprehension framework that explicitly integrates cognitive chain-of-thought (CoT)-guided supervised fine-tuning (SFT) and group relative policy optimization (GRPO) within a reinforcement learning (RL) paradigm. Specifically, we first establish foundational reasoning capabilities via SFT, enforcing structured outputs with thinking processes. Then, GRPO is utilized to refine these outputs via multi-rewards optimization, prioritizing visual-semantic grounding over language-induced biases, thereby improving generalization capability. Furthermore, we investigate the impact of various CoT strategies within this framework, demonstrating that a specific-to-general progressive approach in CoT guidance further improves generalization, especially in capturing synonymous textitN-ary relations. Extensive experiments on widely-used PSG and SWiG datasets demonstrate that Relation-R1 achieves state-of-the-art performance in both binary and textitN-ary relation understanding.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 54 references that are in the map. First posted on arXiv 20 Apr 2025.
Builds on
12 of 54 references.
Closest ancestors · 6
Same direction, newest first
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
- 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
- 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLM3 Jan
Other references · 6
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024OpenAI o1 System Cardcited by 1,244
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
- 2025Compile Scene Graphs with Reinforcement Learningcited by 11
Built on by
Citing papers per year: 2025: 6; 2026: 3.
9 papers.
- 2025WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learningcited by 21
- 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewardscited by 16
- 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Modelscited by 14
- 2026Rethinking Token-Level Policy Optimization for Multimodal Chain-of-Thoughtcited by 9
- 2025HOID-R1: Reinforcement Learning for Open-World Human-Object Interaction Detection Reasoning with Multimodal Large Language Modelcited by 2
- 2026SinkTrack: Attention Sink based Context Anchoring for Large Language Modelscited by 2
- 2025Anatomy-R1: Enhancing Anatomy Reasoning in Multimodal Large Language Models via Anatomical Similarity Curriculum and Group Diversity Augmentationcited by 1
- 2025Interaction-Centric Knowledge Infusion and Transfer for Open-Vocabulary Scene Graph Generationcited by 0
- 2026SGG-Rrm 3: From Next-Token Prediction to End-to-End Unbiased Scene Graph Generationcited by 0
- 2026SinkTrack: Attention Sink based Context Anchoring for Large Language Models11 Apr 2026
- 2026Rethinking Token-Level Policy Optimization for Multimodal Chain-of-Thought24 Mar 2026
- 2026SGG-Rrm 3: From Next-Token Prediction to End-to-End Unbiased Scene Graph Generation9 Mar 2026
- 2025Anatomy-R1: Enhancing Anatomy Reasoning in Multimodal Large Language Models via Anatomical Similarity Curriculum and Group Diversity Augmentation22 Dec 2025
- 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards10 Nov 2025
- 2025Interaction-Centric Knowledge Infusion and Transfer for Open-Vocabulary Scene Graph Generation8 Nov 2025
- 2025HOID-R1: Reinforcement Learning for Open-World Human-Object Interaction Detection Reasoning with Multimodal Large Language Model15 Aug 2025
- 2025WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learning9 Jun 2025
- 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Models24 May 2025
Similar, not cited
Close in wording, no citation either way
- 2024The All-Seeing Project V2: Towards General Relation Comprehension of the Open World
- 2025ChainMPQ: Interleaved Text-Image Reasoning Chains for Mitigating Relation Hallucinations
- 2024MMRel: Benchmarking Relation Understanding in Multi-Modal Large Language Models
- 2025ART: Adaptive Relation Tuning for Generalized Relation Prediction
- 2025The Answer Lies Within: Self-Derived Rewards Enable Explainable Relation Extraction
- 2026Relational Knowledge Distillation Using Fine-tuned Function Vectors
- 2024RelationVLM: Making Large Vision-Language Models Understand Visual Relations
- 2026Thinking with Images as Continuous Actions: Numerical Visual Chain-of-Thought