ThinkAfford: Affordance-Centric Reasoning for Fine-Grained 3D Grounding in Cluttered Scenes
Not on the map. Why?
Abstract (arXiv)
Task-driven 3D affordance grounding aims to localize the functional region in a cluttered 3D scene that enables an action specified by a natural-language instruction. Existing methods either predict 3D masks directly or construct them by selecting and fusing intermediate 2D/3D regions. However, they remain vulnerable to two intertwined failure modes: the predicted or selected regions may miss the target interaction area or have unsuitable granularity, while language grounding may confuse visually similar alternatives under relational instructions. To this end, we introduce ThinkAfford, which decouples high-recall affordance proposal generation from instruction-grounded reasoning. Specifically, the Affordance Proposal Generation module first uses learnable affordance prompts and multi-level visual features to predict interaction-conditioned heatmaps, extracting a variable number of fine-grained proposals without parsed object or part names as segmentation prompts. Visual-Prompted Affordance Reasoning then reasons over labeled proposal overlays using the full instruction, returning identifiers in a structured "think-then-answer" response. Moreover, Group Relative Policy Optimization uses proposal-level rewards from lifted 3D overlap to align VPAR selection with final 3D grounding. On the SceneFun3D validation split, ThinkAfford achieves 10.69% AP50 and 25.46% AP25 under the official evaluator, outperforming comparable 3D open-vocabulary and vision-language-model-based 2D-to-3D baselines. Module-level diagnostics further show that APG attains 77.5% recall at 25% intersection-over-union, while GRPO-trained VPAR achieves 72.1% selection accuracy on APG-covered queries, compared with 63.4% under supervised fine-tuning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 21 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
15 of 21 references.
References · 15
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 303
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 289
- 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 188
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 162
- 2023One-Shot Open Affordance Learning with Foundation Modelscited by 45
- 20253D-AffordanceLLM: Harnessing Large Language Models for Open-Vocabulary Affordance Detection in 3D Worldscited by 30
- 2024Functionality understanding and segmentation in 3D scenescited by 17
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Grounding by Remembering: Cross-Scene and In-Scene Memory for 3D Functional Affordances
- 2024WorldAfford: Affordance Grounding based on Natural Language Instructions
- 2024SeqAfford: Sequential 3D Affordance Reasoning via Multimodal Large Language Model
- 2025SeqAffordSplat: Scene-level Sequential Affordance Reasoning on 3D Gaussian Splatting
- 2026SpatialAfford: Teaching Compact VLMs Where to Look and Where to Ground for Affordance
- 2026Affordance2Action: Task-Conditioned Scene-level Affordance Grounding for Real-Time Manipulation ↗
- 2025AffordBot: 3D Fine-grained Embodied Reasoning via Multimodal Large Language Models
- 2025Grounding 3D Object Affordance with Language Instructions, Visual Observations and Interactions