mlsanityData to 14 Oct 2026

Relation-R1: Progressively Cognitive Chain-of-Thought Guided Reinforcement Learning for Unified Relation Comprehension

arXiv 2504.14642 ↗First posted 20 Apr 2025cs.CVcited by 9

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Recent advances in multi-modal large language models (MLLMs) have significantly improved object-level grounding and region captioning. However, they remain limited in visual relation understanding, struggling even with binary relation detection, let alone textitN-ary relations involving multiple semantic roles. The core reason is the lack of modeling for textitstructural semantic dependencies among multi-entities, leading to unreliable outputs, hallucinations, and over-reliance on language priors (eg, defaulting to ``person drinks a milk'' if a person is merely holding it). To this end, we propose Relation-R1, the textitfirst unified relation comprehension framework that explicitly integrates cognitive chain-of-thought (CoT)-guided supervised fine-tuning (SFT) and group relative policy optimization (GRPO) within a reinforcement learning (RL) paradigm. Specifically, we first establish foundational reasoning capabilities via SFT, enforcing structured outputs with thinking processes. Then, GRPO is utilized to refine these outputs via multi-rewards optimization, prioritizing visual-semantic grounding over language-induced biases, thereby improving generalization capability. Furthermore, we investigate the impact of various CoT strategies within this framework, demonstrating that a specific-to-general progressive approach in CoT guidance further improves generalization, especially in capturing synonymous textitN-ary relations. Extensive experiments on widely-used PSG and SWiG datasets demonstrate that Relation-R1 achieves state-of-the-art performance in both binary and textitN-ary relation understanding.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 54 references that are in the map. First posted on arXiv 20 Apr 2025.

Builds on

12 of 54 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
  2. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  3. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  4. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
  5. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
  6. 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLM3 Jan

Other references · 6

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024OpenAI o1 System Cardcited by 1,244
  5. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
  6. 2025Compile Scene Graphs with Reinforcement Learningcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 3.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024The All-Seeing Project V2: Towards General Relation Comprehension of the Open World
  2. 2025ChainMPQ: Interleaved Text-Image Reasoning Chains for Mitigating Relation Hallucinations
  3. 2024MMRel: Benchmarking Relation Understanding in Multi-Modal Large Language Models
  4. 2025ART: Adaptive Relation Tuning for Generalized Relation Prediction
  5. 2025The Answer Lies Within: Self-Derived Rewards Enable Explainable Relation Extraction
  6. 2026Relational Knowledge Distillation Using Fine-tuned Function Vectors
  7. 2024RelationVLM: Making Large Vision-Language Models Understand Visual Relations
  8. 2026Thinking with Images as Continuous Actions: Numerical Visual Chain-of-Thought