mlsanityData to 14 Oct 2026

ThinkAfford: Affordance-Centric Reasoning for Fine-Grained 3D Grounding in Cluttered Scenes

arXiv 2608.10981 ↗First posted 11 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Task-driven 3D affordance grounding aims to localize the functional region in a cluttered 3D scene that enables an action specified by a natural-language instruction. Existing methods either predict 3D masks directly or construct them by selecting and fusing intermediate 2D/3D regions. However, they remain vulnerable to two intertwined failure modes: the predicted or selected regions may miss the target interaction area or have unsuitable granularity, while language grounding may confuse visually similar alternatives under relational instructions. To this end, we introduce ThinkAfford, which decouples high-recall affordance proposal generation from instruction-grounded reasoning. Specifically, the Affordance Proposal Generation module first uses learnable affordance prompts and multi-level visual features to predict interaction-conditioned heatmaps, extracting a variable number of fine-grained proposals without parsed object or part names as segmentation prompts. Visual-Prompted Affordance Reasoning then reasons over labeled proposal overlays using the full instruction, returning identifiers in a structured "think-then-answer" response. Moreover, Group Relative Policy Optimization uses proposal-level rewards from lifted 3D overlap to align VPAR selection with final 3D grounding. On the SceneFun3D validation split, ThinkAfford achieves 10.69% AP50 and 25.46% AP25 under the official evaluator, outperforming comparable 3D open-vocabulary and vision-language-model-based 2D-to-3D baselines. Module-level diagnostics further show that APG attains 77.5% recall at 25% intersection-over-union, while GRPO-trained VPAR achieves 72.1% selection accuracy on APG-covered queries, compared with 63.4% under supervised fine-tuning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 21 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

15 of 21 references.

References · 15

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  5. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  6. 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 303
  7. 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 289
  8. 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 188
  9. 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 162
  10. 2023One-Shot Open Affordance Learning with Foundation Modelscited by 45
  11. 20253D-AffordanceLLM: Harnessing Large Language Models for Open-Vocabulary Affordance Detection in 3D Worldscited by 30
  12. 2024Functionality understanding and segmentation in 3D scenescited by 17
3 more
  1. 2025DenseGrounding: Improving Dense Language-Vision Semantics for Ego-Centric 3D Visual Groundingcited by 12
  2. 2025Task-Aware 3D Affordance Segmentation via 2D Guidance and Geometric Refinementcited by 6
  3. 2025Segment Any 3D-Part in a Scene from a Sentencecited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Grounding by Remembering: Cross-Scene and In-Scene Memory for 3D Functional Affordances
  2. 2024WorldAfford: Affordance Grounding based on Natural Language Instructions
  3. 2024SeqAfford: Sequential 3D Affordance Reasoning via Multimodal Large Language Model
  4. 2025SeqAffordSplat: Scene-level Sequential Affordance Reasoning on 3D Gaussian Splatting
  5. 2026SpatialAfford: Teaching Compact VLMs Where to Look and Where to Ground for Affordance
  6. 2026Affordance2Action: Task-Conditioned Scene-level Affordance Grounding for Real-Time Manipulation ↗
  7. 2025AffordBot: 3D Fine-grained Embodied Reasoning via Multimodal Large Language Models
  8. 2025Grounding 3D Object Affordance with Language Instructions, Visual Observations and Interactions