Affordance-R1: Reinforcement Learning for Generalizable Affordance Reasoning in Multimodal Large Language Model
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Affordance grounding focuses on predicting the specific regions of objects that are associated with the actions to be performed by robots. It plays a vital role in the fields of human-robot interaction, human-object interaction, embodied manipulation, and embodied perception. Existing models often neglect the affordance shared among different objects because they lack the Chain-of-Thought(CoT) reasoning abilities, limiting their out-of-domain (OOD) generalization and explicit reasoning capabilities. To address these challenges, we propose Affordance-R1, the first unified affordance grounding framework that integrates cognitive CoT guided Group Relative Policy Optimization (GRPO) within a reinforcement learning paradigm. Specifically, we designed a sophisticated affordance function, which contains format, perception, and cognition rewards to effectively guide optimization directions. Furthermore, we constructed a high-quality affordance-centric reasoning dataset, ReasonAff, to support training. Trained exclusively via reinforcement learning with GRPO and without explicit reasoning data, Affordance-R1 achieves robust zero-shot generalization and exhibits emergent test-time reasoning capabilities. Comprehensive experiments demonstrate that our model outperforms well-established methods and exhibits open-world generalization. To the best of our knowledge, Affordance-R1 is the first to integrate GRPO-based RL with reasoning into affordance reasoning. The code of our method and our dataset is released on https://github.com/hq-King/Affordance-R1.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 57 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
32 of 57 references.
Closest ancestors · 3
Same direction, newest first
- 2025Motion-R1: Enhancing Motion Generation with Decomposed Chain-of-Thought and RL Binding12 Jun
- 2025InstructPart: Task-Oriented Part Segmentation with Instruction Reasoning23 May
- 2025ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Models22 May
Other references · 29
- 2023GPT-4 Technical Reportcited by 18,396
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
17 more
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 173
- 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Modelcited by 165
- 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoningcited by 62
- 2024Text4Seg: Reimagining Image Segmentation as Text Generationcited by 61
- 20253D-AffordanceLLM: Harnessing Large Language Models for Open-Vocabulary Affordance Detection in 3D Worldscited by 30
- 2024GREAT: Geometry-Intention Collaborative Inference for Open-Vocabulary 3D Object Affordance Groundingcited by 28
- 2025AffordDexGrasp: Open-set Language-guided Dexterous Grasp with Generalizable-Instructive Affordancecited by 27
- 2024EgoChoir: Capturing 3D Human-Object Interaction Regions from Egocentric Viewscited by 26
- 2025UAD: Unsupervised Affordance Distillation for Generalization in Robotic Manipulationcited by 23
- 2024Learning 2D Invariant Affordance Knowledge for 3D Affordance Groundingcited by 22
- 2023Affordance-Driven Next-Best-View Planning for Robotic Graspingcited by 16
- 2024OVAL-Prompt: Open-Vocabulary Affordance Localization for Robot Manipulation through LLM Affordance-Groundingcited by 15
- 2025GLOVER++: Unleashing the Potential of Affordance Learning from Human Behaviors for Robotic Manipulationcited by 14
- 20253DAffordSplat: Efficient Affordance Reasoning with 3D Gaussianscited by 9
- 2025Diffusion Models are Open-World Affordance Learners: Leveraging Generative Priors for 3D Affordance Learningcited by 6
- 2025GRACE: Estimating Geometry-level 3D Human-Scene Contact from 2D Imagescited by 3
- 2024Visual-Geometric Collaborative Guidance for Affordance Learningcited by 2
Built on by
Citing papers per year: 2025: 6; 2026: 17.
23 papers.
Sort:
By area:
- 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 56
- 2025Embodied-R1: Reinforced Embodied Reasoning for General Robotic Manipulationcited by 38
- 2025Kardia-R1: Unleashing LLMs to Reason toward Understanding and Empathy for Emotional Support via Rubric-as-Judge Reinforcement Learningcited by 22
- 2025MIND-V: Hierarchical World Model for Long-Horizon Robotic Manipulation with RL-based Physical Alignmentcited by 9
- 2026OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computingcited by 6
- 2025A4-Agent: An Agentic Framework for Zero-Shot Affordance Reasoningcited by 5
- 2026Affordance Agent Harness: Verification-Gated Skill Orchestrationcited by 4
- 2026UniHM: Unified Dexterous Hand Manipulation with Vision Language Modelcited by 3
- 2026From Web to Pixels: Bringing Agentic Search into Visual Perceptioncited by 3
- 2025HOID-R1: Reinforcement Learning for Open-World Human-Object Interaction Detection Reasoning with Multimodal Large Language Modelcited by 2
- 2026VideoAfford: Grounding 3D Affordance from Human-Object-Interaction Videos via Multimodal Large Language Modelcited by 2
- 2026Enhancing Video Representations with Spatiotemporal-Semantic Residual to Mitigate Hallucinations in Video Large Multimodal Modelscited by 1
11 more
- 2026AffordanceGrasp-R1:Leveraging Reasoning-Based Affordance Segmentation with Reinforcement Learning for Robotic Graspingcited by 1
- 2026Panoramic Affordance Predictioncited by 1
- 2026FSAG: Enhancing Human-to-Dexterous-Hand Finger-Specific Affordance Grounding via Diffusion Modelscited by 0
- 2026TRACER: Texture-Robust Affordance Chain-of-Thought for Deformable-Object Refinementcited by 0
- 2026VoxAfford: Multi-Scale Voxel-Token Fusion for Open-Vocabulary 3D Affordance Detectioncited by 0
- 2026SceneParser: Hierarchical Scene Parsing for Visual Semantics Understandingcited by 0
- 2026AFUN: Towards an Affordance Foundation Model for Functionality Understandingcited by 0
- 2026SpatialAfford: Teaching Compact VLMs Where to Look and Where to Ground for Affordancecited by 0
- 2026UniAfford: Token-Routed Multitask Learning for Generalizable 2D-3D Affordance Perceptioncited by 0
- 2026Are Frontier VLM Agents Ready to Be Robot Generalists? An Empirical Study with the Embodied Agent Arenacited by 0
- 2026Golden Anchor for Video Generationcited by 0
- 2026Golden Anchor for Video Generation9 Oct 2026
- 2026Are Frontier VLM Agents Ready to Be Robot Generalists? An Empirical Study with the Embodied Agent Arena1 Oct 2026
- 2026UniAfford: Token-Routed Multitask Learning for Generalizable 2D-3D Affordance Perception29 Sep 2026
- 2026SpatialAfford: Teaching Compact VLMs Where to Look and Where to Ground for Affordance1 Aug 2026
- 2026OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computing14 Jun 2026
- 2026AFUN: Towards an Affordance Foundation Model for Functionality Understanding1 Jun 2026
- 2026SceneParser: Hierarchical Scene Parsing for Visual Semantics Understanding14 May 2026
- 2026From Web to Pixels: Bringing Agentic Search into Visual Perception12 May 2026
- 2026VoxAfford: Multi-Scale Voxel-Token Fusion for Open-Vocabulary 3D Affordance Detection2 May 2026
- 2026Affordance Agent Harness: Verification-Gated Skill Orchestration1 May 2026
- 2026Panoramic Affordance Prediction16 Mar 2026
- 2026UniHM: Unified Dexterous Hand Manipulation with Vision Language Model28 Feb 2026
11 more
- 2026VideoAfford: Grounding 3D Affordance from Human-Object-Interaction Videos via Multimodal Large Language Model10 Feb 2026
- 2026AffordanceGrasp-R1:Leveraging Reasoning-Based Affordance Segmentation with Reinforcement Learning for Robotic Grasping3 Feb 2026
- 2026Enhancing Video Representations with Spatiotemporal-Semantic Residual to Mitigate Hallucinations in Video Large Multimodal Models30 Jan 2026
- 2026TRACER: Texture-Robust Affordance Chain-of-Thought for Deformable-Object Refinement28 Jan 2026
- 2026FSAG: Enhancing Human-to-Dexterous-Hand Finger-Specific Affordance Grounding via Diffusion Models13 Jan 2026
- 2025A4-Agent: An Agentic Framework for Zero-Shot Affordance Reasoning16 Dec 2025
- 2025MIND-V: Hierarchical World Model for Long-Horizon Robotic Manipulation with RL-based Physical Alignment7 Dec 2025
- 2025OneThinker: All-in-one Reasoning Model for Image and Video2 Dec 2025
- 2025Kardia-R1: Unleashing LLMs to Reason toward Understanding and Empathy for Emotional Support via Rubric-as-Judge Reinforcement Learning1 Dec 2025
- 2025Embodied-R1: Reinforced Embodied Reasoning for General Robotic Manipulation19 Aug 2025
- 2025HOID-R1: Reinforcement Learning for Open-World Human-Object Interaction Detection Reasoning with Multimodal Large Language Model15 Aug 2025
- 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 56
- 2025Embodied-R1: Reinforced Embodied Reasoning for General Robotic Manipulationcited by 38
- 2025Kardia-R1: Unleashing LLMs to Reason toward Understanding and Empathy for Emotional Support via Rubric-as-Judge Reinforcement Learningcited by 22
- 2025A4-Agent: An Agentic Framework for Zero-Shot Affordance Reasoningcited by 5
- 2025HOID-R1: Reinforcement Learning for Open-World Human-Object Interaction Detection Reasoning with Multimodal Large Language Modelcited by 2
- 2026AffordanceGrasp-R1:Leveraging Reasoning-Based Affordance Segmentation with Reinforcement Learning for Robotic Graspingcited by 1
- 2026TRACER: Texture-Robust Affordance Chain-of-Thought for Deformable-Object Refinementcited by 0
- 2026AffordanceGrasp-R1:Leveraging Reasoning-Based Affordance Segmentation with Reinforcement Learning for Robotic Grasping3 Feb 2026
- 2026TRACER: Texture-Robust Affordance Chain-of-Thought for Deformable-Object Refinement28 Jan 2026
- 2025A4-Agent: An Agentic Framework for Zero-Shot Affordance Reasoning16 Dec 2025
- 2025OneThinker: All-in-one Reasoning Model for Image and Video2 Dec 2025
- 2025Kardia-R1: Unleashing LLMs to Reason toward Understanding and Empathy for Emotional Support via Rubric-as-Judge Reinforcement Learning1 Dec 2025
- 2025Embodied-R1: Reinforced Embodied Reasoning for General Robotic Manipulation19 Aug 2025
- 2025HOID-R1: Reinforcement Learning for Open-World Human-Object Interaction Detection Reasoning with Multimodal Large Language Model15 Aug 2025
- 2026OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computingcited by 6
- 2026UniHM: Unified Dexterous Hand Manipulation with Vision Language Modelcited by 3
- 2026VideoAfford: Grounding 3D Affordance from Human-Object-Interaction Videos via Multimodal Large Language Modelcited by 2
- 2026Enhancing Video Representations with Spatiotemporal-Semantic Residual to Mitigate Hallucinations in Video Large Multimodal Modelscited by 1
- 2026Are Frontier VLM Agents Ready to Be Robot Generalists? An Empirical Study with the Embodied Agent Arenacited by 0
- 2026Are Frontier VLM Agents Ready to Be Robot Generalists? An Empirical Study with the Embodied Agent Arena1 Oct 2026
- 2026OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computing14 Jun 2026
- 2026UniHM: Unified Dexterous Hand Manipulation with Vision Language Model28 Feb 2026
- 2026VideoAfford: Grounding 3D Affordance from Human-Object-Interaction Videos via Multimodal Large Language Model10 Feb 2026
- 2026Enhancing Video Representations with Spatiotemporal-Semantic Residual to Mitigate Hallucinations in Video Large Multimodal Models30 Jan 2026
- 2026Affordance Agent Harness: Verification-Gated Skill Orchestrationcited by 4
- 2026Panoramic Affordance Predictioncited by 1
- 2026VoxAfford: Multi-Scale Voxel-Token Fusion for Open-Vocabulary 3D Affordance Detectioncited by 0
- 2026SceneParser: Hierarchical Scene Parsing for Visual Semantics Understandingcited by 0
- 2026AFUN: Towards an Affordance Foundation Model for Functionality Understandingcited by 0
- 2026SpatialAfford: Teaching Compact VLMs Where to Look and Where to Ground for Affordancecited by 0
- 2026UniAfford: Token-Routed Multitask Learning for Generalizable 2D-3D Affordance Perceptioncited by 0
- 2026UniAfford: Token-Routed Multitask Learning for Generalizable 2D-3D Affordance Perception29 Sep 2026
- 2026SpatialAfford: Teaching Compact VLMs Where to Look and Where to Ground for Affordance1 Aug 2026
- 2026AFUN: Towards an Affordance Foundation Model for Functionality Understanding1 Jun 2026
- 2026SceneParser: Hierarchical Scene Parsing for Visual Semantics Understanding14 May 2026
- 2026VoxAfford: Multi-Scale Voxel-Token Fusion for Open-Vocabulary 3D Affordance Detection2 May 2026
- 2026Affordance Agent Harness: Verification-Gated Skill Orchestration1 May 2026
- 2026Panoramic Affordance Prediction16 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Afford-X: Generalizable and Slim Affordance Reasoning for Task-oriented Manipulation
- 2024Affordance-Guided Reinforcement Learning via Visual Prompting
- 2024CoA-VLA: Improving Vision-Language-Action Models via Visual-Textual Chain-of-Affordance
- 2026PALM: Progress-Aware Policy Learning via Affordance Reasoning for Long-Horizon Robotic Manipulation
- 2026ADAPT: Benchmarking Commonsense Planning under Unspecified Affordance Constraints
- 2026AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understanding
- 2024Robo-ABC: Affordance Generalization Beyond Categories via Semantic Correspondence for Robot Manipulation
- 2025TRACE: Textual Reasoning for Affordance Coordinate Extraction