Where2Explore: Few-shot Affordance Learning for Unseen Novel Categories of Articulated Objects
Not on the map. Why?
Abstract (arXiv)
Articulated object manipulation is a fundamental yet challenging task in robotics. Due to significant geometric and semantic variations across object categories, previous manipulation models struggle to generalize to novel categories. Few-shot learning is a promising solution for alleviating this issue by allowing robots to perform a few interactions with unseen objects. However, extant approaches often necessitate costly and inefficient test-time interactions with each unseen instance. Recognizing this limitation, we observe that despite their distinct shapes, different categories often share similar local geometries essential for manipulation, such as pullable handles and graspable edges - a factor typically underutilized in previous few-shot learning works. To harness this commonality, we introduce 'Where2Explore', an affordance learning framework that effectively explores novel categories with minimal interactions on a limited number of instances. Our framework explicitly estimates the geometric similarity across different categories, identifying local areas that differ from shapes in the training categories for efficient exploration while concurrently transferring affordance knowledge to similar parts of the objects. Extensive experiments in simulated and real-world environments demonstrate our framework's capacity for efficient few-shot exploration and generalization.
Key facts. Cited by 35 papers in the map (data through 14 Oct 2026). Builds on 37 of its 48 references that are in the map. First posted on arXiv 14 Sep 2023.
Builds on
37 of 48 references.
References · 37
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
- 2019Category-Level Articulated Object Pose Estimationcited by 159
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 119
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
- 2021Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representationscited by 108
25 more
- 20213D AffordanceNet: A Benchmark for Visual Object Affordance Understandingcited by 100
- 2022FlowBot3D: Learning 3D Articulation Flow to Manipulate Articulated Objectscited by 91
- 2020Learning Dexterous Grasping with Object-Centric Visual Affordancescited by 85
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 84
- 2021VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated Objectscited by 80
- 2018Deep Part Induction from Articulated Object Pairscited by 66
- 2023DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objectscited by 66
- 2021UMPNet: Universal Manipulation Policy Network for Articulated Objectscited by 65
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2023Grounding 3D Object Affordance from 2D Interactions in Imagescited by 62
- 2021AdaAfford: Learning to Adapt Manipulation Affordance for 3D Articulated Objects via Few-shot Interactionscited by 57
- 2022End-to-End Affordance Learning for Robotic Manipulationcited by 57
- 2022OPD: Single-view 3D Openable Part Detectioncited by 54
- 2021Act the Part: Learning Interaction Strategies for Articulated Object Part Discoverycited by 45
- 2021Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulationcited by 44
- 2023Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perceptioncited by 41
- 2014A Probabilistic Framework for Learning Kinematic Models of Articulated Objectscited by 40
- 2020Visual Identification of Articulated Object Partscited by 37
- 2022PartAfford: Part-level Affordance Discovery from 3D Objectscited by 36
- 2023Self-Supervised Category-Level Articulated Object Pose Estimation with Part-Level SE(3) Equivariancecited by 26
- 2020Nothing But Geometric Constraints: A Model-Free Method for Articulated Object Pose Estimationcited by 25
- 2023Learning Foresightful Dense Visual Affordance for Deformable Object Manipulationcited by 25
- 2022Category-Independent Articulated Object Tracking with Factor Graphscited by 24
- 2022Learning Agent-Aware Affordances for Closed-Loop Interaction with Articulated Objectscited by 16
- 2023STRAP: Structured Object Affordance Segmentation with Point Supervisioncited by 10
Built on by
Citing papers per year: 2023: 1; 2024: 13; 2025: 15; 2026: 6.
35 papers.
Sort:
By area:
- 2024Robo-ABC: Affordance Generalization Beyond Categories via Semantic Correspondence for Robot Manipulationcited by 71
- 2025VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulationcited by 46
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 35
- 2024UniGarmentManip: A Unified Framework for Category-Level Garment Manipulation via Dense Visual Correspondencecited by 23
- 2025FunGraph: Functionality Aware 3D Scene Graphs for Language-Prompted Scene Interactioncited by 23
- 2024Learning 2D Invariant Affordance Knowledge for 3D Affordance Groundingcited by 22
- 2024Survey on Modeling of Human-made Articulated Objectscited by 14
- 2025GLOVER++: Unleashing the Potential of Affordance Learning from Human Behaviors for Robotic Manipulationcited by 14
- 2024Open-World Reinforcement Learning over Long Short-Term Imaginationcited by 13
- 2025AdaManip: Adaptive Articulated Object Manipulation Environments and Policy Learningcited by 12
- 2026AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understandingcited by 12
- 2024PreAfford: Universal Affordance-Based Pre-Grasping for Diverse Objects and Environmentscited by 11
23 more
- 2025From Screens to Scenes: A Survey of Embodied AI in Healthcarecited by 10
- 2024Seeing the Unseen: Visual Common Sense for Semantic Placementcited by 9
- 2025GarmentPile: Point-Level Visual Affordance Guided Retrieval and Adaptation for Cluttered Garments Manipulationcited by 9
- 2024EqvAfford: SE(3) Equivariance for Point-Level Affordance Learningcited by 6
- 2024ConceptFactory: Facilitate 3D Object Knowledge Annotation with Object Conceptualizationcited by 6
- 2024Arti-PG: A Toolbox for Procedurally Synthesizing Large-Scale and Diverse Articulated Objects with Rich Annotationscited by 6
- 2023Learning Part Motion of Articulated Objects Using Spatially Continuous Neural Implicit Representationscited by 5
- 2025Physically Ground Commonsense Knowledge for Articulated Object Manipulation with Analytic Conceptscited by 5
- 2025BiAssemble: Learning Collaborative Affordance for Bimanual Geometric Assemblycited by 5
- 2025Adaptive Articulated Object Manipulation On The Fly with Foundation Model Reasoning and Part Groundingcited by 3
- 2025Executable Analytic Concepts as the Missing Link Between VLM Insight and Precise Manipulationcited by 3
- 2024Visual-Geometric Collaborative Guidance for Affordance Learningcited by 2
- 2024Opening Articulated Structures in the Real Worldcited by 1
- 2025Object Affordance Recognition and Grounding via Multi-scale Cross-modal Representation Learningcited by 1
- 2026QDTraj: Exploration of Diverse Trajectory Primitives for Articulated Objects Robotic Manipulationcited by 1
- 2025Watch Less, Feel More: Sim-to-Real RL for Generalizable Articulated Object Manipulation via Motion Adaptation and Impedance Controlcited by 0
- 2025From Scan to Action: Leveraging Realistic Scans for Embodied Scene Understandingcited by 0
- 2025ASkDAgger: Active Skill-level Data Aggregation for Interactive Imitation Learningcited by 0
- 2025Informative Text-Image Alignment for Visual Affordance Learning with Foundation Modelscited by 0
- 2026UMI-Underwater: Learning Underwater Manipulation without Underwater Teleoperationcited by 0
- 2026AffordMatcher: Affordance Learning in 3D Scenes from Visual Signifierscited by 0
- 2026AnnotateAnything: Automatic Annotation of 3D Assets for Robot Manipulationcited by 0
- 2026MagicSim: A Unified Infrastructure for Executable Embodied Interactioncited by 0
- 2026MagicSim: A Unified Infrastructure for Executable Embodied Interaction16 Jun 2026
- 2026AnnotateAnything: Automatic Annotation of 3D Assets for Robot Manipulation16 Jun 2026
- 2026AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understanding4 Jun 2026
- 2026QDTraj: Exploration of Diverse Trajectory Primitives for Articulated Objects Robotic Manipulation24 Apr 2026
- 2026AffordMatcher: Affordance Learning in 3D Scenes from Visual Signifiers30 Mar 2026
- 2026UMI-Underwater: Learning Underwater Manipulation without Underwater Teleoperation27 Mar 2026
- 2025Executable Analytic Concepts as the Missing Link Between VLM Insight and Precise Manipulation9 Oct 2025
- 2025Informative Text-Image Alignment for Visual Affordance Learning with Foundation Models21 Sep 2025
- 2025ASkDAgger: Active Skill-level Data Aggregation for Interactive Imitation Learning7 Aug 2025
- 2025Object Affordance Recognition and Grounding via Multi-scale Cross-modal Representation Learning2 Aug 2025
- 2025Adaptive Articulated Object Manipulation On The Fly with Foundation Model Reasoning and Part Grounding24 Jul 2025
- 2025From Scan to Action: Leveraging Realistic Scans for Embodied Scene Understanding23 Jul 2025
23 more
- 2025BiAssemble: Learning Collaborative Affordance for Bimanual Geometric Assembly6 Jun 2025
- 2025GLOVER++: Unleashing the Potential of Affordance Learning from Human Behaviors for Robotic Manipulation17 May 2025
- 2025Physically Ground Commonsense Knowledge for Articulated Object Manipulation with Analytic Concepts30 Mar 2025
- 2025GarmentPile: Point-Level Visual Affordance Guided Retrieval and Adaptation for Cluttered Garments Manipulation12 Mar 2025
- 2025FunGraph: Functionality Aware 3D Scene Graphs for Language-Prompted Scene Interaction10 Mar 2025
- 2025VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulation10 Mar 2025
- 2025Watch Less, Feel More: Sim-to-Real RL for Generalizable Articulated Object Manipulation via Motion Adaptation and Impedance Control20 Feb 2025
- 2025AdaManip: Adaptive Articulated Object Manipulation Environments and Policy Learning16 Feb 2025
- 2025From Screens to Scenes: A Survey of Embodied AI in Healthcare13 Jan 2025
- 2024Arti-PG: A Toolbox for Procedurally Synthesizing Large-Scale and Diverse Articulated Objects with Rich Annotations19 Dec 2024
- 2024ConceptFactory: Facilitate 3D Object Knowledge Annotation with Object Conceptualization1 Nov 2024
- 2024Visual-Geometric Collaborative Guidance for Affordance Learning15 Oct 2024
- 2024Open-World Reinforcement Learning over Long Short-Term Imagination4 Oct 2024
- 2024Learning 2D Invariant Affordance Knowledge for 3D Affordance Grounding23 Aug 2024
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulation21 Aug 2024
- 2024EqvAfford: SE(3) Equivariance for Point-Level Affordance Learning4 Aug 2024
- 2024UniGarmentManip: A Unified Framework for Category-Level Garment Manipulation via Dense Visual Correspondence11 May 2024
- 2024PreAfford: Universal Affordance-Based Pre-Grasping for Diverse Objects and Environments4 Apr 2024
- 2024Survey on Modeling of Human-made Articulated Objects22 Mar 2024
- 2024Opening Articulated Structures in the Real World27 Feb 2024
- 2024Seeing the Unseen: Visual Common Sense for Semantic Placement15 Jan 2024
- 2024Robo-ABC: Affordance Generalization Beyond Categories via Semantic Correspondence for Robot Manipulation15 Jan 2024
- 2023Learning Part Motion of Articulated Objects Using Spatially Continuous Neural Implicit Representations21 Nov 2023
- 2024Robo-ABC: Affordance Generalization Beyond Categories via Semantic Correspondence for Robot Manipulationcited by 71
- 2025VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulationcited by 46
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 35
- 2024UniGarmentManip: A Unified Framework for Category-Level Garment Manipulation via Dense Visual Correspondencecited by 23
- 2025FunGraph: Functionality Aware 3D Scene Graphs for Language-Prompted Scene Interactioncited by 23
- 2024Learning 2D Invariant Affordance Knowledge for 3D Affordance Groundingcited by 22
- 2024Survey on Modeling of Human-made Articulated Objectscited by 14
- 2025GLOVER++: Unleashing the Potential of Affordance Learning from Human Behaviors for Robotic Manipulationcited by 14
- 2025AdaManip: Adaptive Articulated Object Manipulation Environments and Policy Learningcited by 12
- 2024PreAfford: Universal Affordance-Based Pre-Grasping for Diverse Objects and Environmentscited by 11
- 2025From Screens to Scenes: A Survey of Embodied AI in Healthcarecited by 10
- 2024Seeing the Unseen: Visual Common Sense for Semantic Placementcited by 9
12 most cited of 32 All 32 (JSON)
- 2026MagicSim: A Unified Infrastructure for Executable Embodied Interaction16 Jun 2026
- 2026AnnotateAnything: Automatic Annotation of 3D Assets for Robot Manipulation16 Jun 2026
- 2026QDTraj: Exploration of Diverse Trajectory Primitives for Articulated Objects Robotic Manipulation24 Apr 2026
- 2026AffordMatcher: Affordance Learning in 3D Scenes from Visual Signifiers30 Mar 2026
- 2026UMI-Underwater: Learning Underwater Manipulation without Underwater Teleoperation27 Mar 2026
- 2025Executable Analytic Concepts as the Missing Link Between VLM Insight and Precise Manipulation9 Oct 2025
- 2025Informative Text-Image Alignment for Visual Affordance Learning with Foundation Models21 Sep 2025
- 2025Object Affordance Recognition and Grounding via Multi-scale Cross-modal Representation Learning2 Aug 2025
- 2025Adaptive Articulated Object Manipulation On The Fly with Foundation Model Reasoning and Part Grounding24 Jul 2025
- 2025From Scan to Action: Leveraging Realistic Scans for Embodied Scene Understanding23 Jul 2025
- 2025BiAssemble: Learning Collaborative Affordance for Bimanual Geometric Assembly6 Jun 2025
- 2025GLOVER++: Unleashing the Potential of Affordance Learning from Human Behaviors for Robotic Manipulation17 May 2025
12 newest of 32 All 32 (JSON)