mlsanityData to 14 Oct 2026

Where2Explore: Few-shot Affordance Learning for Unseen Novel Categories of Articulated Objects

arXiv 2309.07473 ↗First posted 14 Sep 2023cs.RO cs.AIcited by 35

Not on the map. Why?

Abstract (arXiv)

Articulated object manipulation is a fundamental yet challenging task in robotics. Due to significant geometric and semantic variations across object categories, previous manipulation models struggle to generalize to novel categories. Few-shot learning is a promising solution for alleviating this issue by allowing robots to perform a few interactions with unseen objects. However, extant approaches often necessitate costly and inefficient test-time interactions with each unseen instance. Recognizing this limitation, we observe that despite their distinct shapes, different categories often share similar local geometries essential for manipulation, such as pullable handles and graspable edges - a factor typically underutilized in previous few-shot learning works. To harness this commonality, we introduce 'Where2Explore', an affordance learning framework that effectively explores novel categories with minimal interactions on a limited number of instances. Our framework explicitly estimates the geometric similarity across different categories, identifying local areas that differ from shapes in the training categories for efficient exploration while concurrently transferring affordance knowledge to similar parts of the objects. Extensive experiments in simulated and real-world environments demonstrate our framework's capacity for efficient few-shot exploration and generalization.

Key facts. Cited by 35 papers in the map (data through 14 Oct 2026). Builds on 37 of its 48 references that are in the map. First posted on arXiv 14 Sep 2023.

Builds on

37 of 48 references.

References · 37

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  3. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
  4. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
  5. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
  6. 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
  7. 2019Category-Level Articulated Object Pose Estimationcited by 159
  8. 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
  9. 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
  10. 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 119
  11. 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
  12. 2021Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representationscited by 108
25 more
  1. 20213D AffordanceNet: A Benchmark for Visual Object Affordance Understandingcited by 100
  2. 2022FlowBot3D: Learning 3D Articulation Flow to Manipulate Articulated Objectscited by 91
  3. 2020Learning Dexterous Grasping with Object-Centric Visual Affordancescited by 85
  4. 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 84
  5. 2021VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated Objectscited by 80
  6. 2018Deep Part Induction from Articulated Object Pairscited by 66
  7. 2023DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objectscited by 66
  8. 2021UMPNet: Universal Manipulation Policy Network for Articulated Objectscited by 65
  9. 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
  10. 2023Grounding 3D Object Affordance from 2D Interactions in Imagescited by 62
  11. 2021AdaAfford: Learning to Adapt Manipulation Affordance for 3D Articulated Objects via Few-shot Interactionscited by 57
  12. 2022End-to-End Affordance Learning for Robotic Manipulationcited by 57
  13. 2022OPD: Single-view 3D Openable Part Detectioncited by 54
  14. 2021Act the Part: Learning Interaction Strategies for Articulated Object Part Discoverycited by 45
  15. 2021Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulationcited by 44
  16. 2023Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perceptioncited by 41
  17. 2014A Probabilistic Framework for Learning Kinematic Models of Articulated Objectscited by 40
  18. 2020Visual Identification of Articulated Object Partscited by 37
  19. 2022PartAfford: Part-level Affordance Discovery from 3D Objectscited by 36
  20. 2023Self-Supervised Category-Level Articulated Object Pose Estimation with Part-Level SE(3) Equivariancecited by 26
  21. 2020Nothing But Geometric Constraints: A Model-Free Method for Articulated Object Pose Estimationcited by 25
  22. 2023Learning Foresightful Dense Visual Affordance for Deformable Object Manipulationcited by 25
  23. 2022Category-Independent Articulated Object Tracking with Factor Graphscited by 24
  24. 2022Learning Agent-Aware Affordances for Closed-Loop Interaction with Articulated Objectscited by 16
  25. 2023STRAP: Structured Object Affordance Segmentation with Point Supervisioncited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 13; 2025: 15; 2026: 6.

35 papers.

Sort:

By area:

  1. 2024Robo-ABC: Affordance Generalization Beyond Categories via Semantic Correspondence for Robot Manipulationcited by 71
  2. 2025VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulationcited by 46
  3. 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 35
  4. 2024UniGarmentManip: A Unified Framework for Category-Level Garment Manipulation via Dense Visual Correspondencecited by 23
  5. 2025FunGraph: Functionality Aware 3D Scene Graphs for Language-Prompted Scene Interactioncited by 23
  6. 2024Learning 2D Invariant Affordance Knowledge for 3D Affordance Groundingcited by 22
  7. 2024Survey on Modeling of Human-made Articulated Objectscited by 14
  8. 2025GLOVER++: Unleashing the Potential of Affordance Learning from Human Behaviors for Robotic Manipulationcited by 14
  9. 2024Open-World Reinforcement Learning over Long Short-Term Imaginationcited by 13
  10. 2025AdaManip: Adaptive Articulated Object Manipulation Environments and Policy Learningcited by 12
  11. 2026AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understandingcited by 12
  12. 2024PreAfford: Universal Affordance-Based Pre-Grasping for Diverse Objects and Environmentscited by 11
23 more
  1. 2025From Screens to Scenes: A Survey of Embodied AI in Healthcarecited by 10
  2. 2024Seeing the Unseen: Visual Common Sense for Semantic Placementcited by 9
  3. 2025GarmentPile: Point-Level Visual Affordance Guided Retrieval and Adaptation for Cluttered Garments Manipulationcited by 9
  4. 2024EqvAfford: SE(3) Equivariance for Point-Level Affordance Learningcited by 6
  5. 2024ConceptFactory: Facilitate 3D Object Knowledge Annotation with Object Conceptualizationcited by 6
  6. 2024Arti-PG: A Toolbox for Procedurally Synthesizing Large-Scale and Diverse Articulated Objects with Rich Annotationscited by 6
  7. 2023Learning Part Motion of Articulated Objects Using Spatially Continuous Neural Implicit Representationscited by 5
  8. 2025Physically Ground Commonsense Knowledge for Articulated Object Manipulation with Analytic Conceptscited by 5
  9. 2025BiAssemble: Learning Collaborative Affordance for Bimanual Geometric Assemblycited by 5
  10. 2025Adaptive Articulated Object Manipulation On The Fly with Foundation Model Reasoning and Part Groundingcited by 3
  11. 2025Executable Analytic Concepts as the Missing Link Between VLM Insight and Precise Manipulationcited by 3
  12. 2024Visual-Geometric Collaborative Guidance for Affordance Learningcited by 2
  13. 2024Opening Articulated Structures in the Real Worldcited by 1
  14. 2025Object Affordance Recognition and Grounding via Multi-scale Cross-modal Representation Learningcited by 1
  15. 2026QDTraj: Exploration of Diverse Trajectory Primitives for Articulated Objects Robotic Manipulationcited by 1
  16. 2025Watch Less, Feel More: Sim-to-Real RL for Generalizable Articulated Object Manipulation via Motion Adaptation and Impedance Controlcited by 0
  17. 2025From Scan to Action: Leveraging Realistic Scans for Embodied Scene Understandingcited by 0
  18. 2025ASkDAgger: Active Skill-level Data Aggregation for Interactive Imitation Learningcited by 0
  19. 2025Informative Text-Image Alignment for Visual Affordance Learning with Foundation Modelscited by 0
  20. 2026UMI-Underwater: Learning Underwater Manipulation without Underwater Teleoperationcited by 0
  21. 2026AffordMatcher: Affordance Learning in 3D Scenes from Visual Signifierscited by 0
  22. 2026AnnotateAnything: Automatic Annotation of 3D Assets for Robot Manipulationcited by 0
  23. 2026MagicSim: A Unified Infrastructure for Executable Embodied Interactioncited by 0