FUSE: Active Functional Affordance Grounding through Adaptive Semantic-Geometric Evidence Acquisition
Not on the map. Why?
Abstract (arXiv)
Embodied agents must often identify and interact with objects based on their function rather than their identity, requiring them to actively acquire observations that reveal discriminative functional evidence. Existing affordance grounding methods operate from fixed viewpoints and lack mechanisms for deciding where to look when functional cues are occluded or incomplete. We introduce Active Functional Affordance Grounding, a new task in which an agent sequentially explores a scene to identify and spatially ground an object satisfying a functional query. To address this problem, we propose FUSE, an adaptive semantic-geometric evidence acquisition framework that combines explicit uncertainty-driven exploration with a learned amortized planner to efficiently select informative viewpoints. We further introduce a Habitat-based benchmark for evaluating active functional grounding. Experiments show that FUSE achieves the highest observed non-oracle grounding performance while reducing computation by 1.33x relative to fully explicit exploration, and remains effective across multiple affordance knowledge sources.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 31 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
21 of 31 references.
References · 21
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 407
- 2017Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metricscited by 264
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 244
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 228
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 218
- 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 216
9 more
- 2020Same Object, Different Grasps: Data and Semantic Knowledge for Task-Oriented Graspingcited by 27
- 2020Robot Object Retrieval with Contextual Natural Language Queriescited by 26
- 2022TOIST: Task Oriented Instance Segmentation Transformer with Noun-Pronoun Distillationcited by 25
- 2019What Object Should I Use? - Task Driven Object Detectioncited by 22
- 2023Affordance-Driven Next-Best-View Planning for Robotic Graspingcited by 16
- 2025VISO-Grasp: Vision-Language Informed Spatial Object-centric 6-DoF Active View Planning and Grasping in Clutter and Invisibilitycited by 11
- 2025ActiveGrasp: Information-Guided Active Grasping with Calibrated Energy-based Modelcited by 4
- 2025EASE: Embodied Active Event Perception via Self-Supervised Energy Minimizationcited by 2
- 2026GCNGrasp-VP: Affordance-Guided View Planning for Efficient Task-Oriented Graspingcited by 1
Built on by
Not cited yet.