One-Shot Affordance Detection
Not on the map. Why?
Abstract (arXiv)
Affordance detection refers to identifying the potential action possibilities of objects in an image, which is an important ability for robot perception and manipulation. To empower robots with this ability in unseen scenarios, we consider the challenging one-shot affordance detection problem in this paper, i.e., given a support image that depicts the action purpose, all objects in a scene with the common affordance should be detected. To this end, we devise a One-Shot Affordance Detection (OS-AD) network that firstly estimates the purpose and then transfers it to help detect the common affordance from all candidate images. Through collaboration learning, OS-AD can capture the common characteristics between objects having the same underlying affordance and learn a good adaptation capability for perceiving unseen affordances. Besides, we build a Purpose-driven Affordance Dataset (PAD) by collecting and labeling 4k images from 31 affordance and 72 object categories. Experimental results demonstrate the superiority of our model over previous representative ones in terms of both objective metrics and visual quality. The benchmark suite is at ProjectPage.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 21 of its 35 references that are in the map. First posted on arXiv 28 Jun 2021.
Builds on
21 of 35 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
- 2017One-Shot Learning for Semantic Segmentationcited by 337
- 2019Cascaded Partial Decoder for Fast and Accurate Salient Object Detectioncited by 216
- 2019Expectation-Maximization Attention Networks for Semantic Segmentationcited by 147
9 more
- 2020Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Thingscited by 110
- 2020Highly Efficient Salient Object Detection with 100K Parameterscited by 79
- 2017Learning to Act Properly: Predicting and Explaining Affordances from Imagescited by 74
- 2020Re-thinking Co-Salient Object Detectioncited by 54
- 2019On Exploring Undetermined Relationships for Visual Relationship Detectioncited by 26
- 2018Visual Affordance and Function Understanding: A Surveycited by 20
- 2020Progressive One-shot Human Parsingcited by 12
- 2018One-Shot Segmentation in Cluttercited by 7
- 2019One-Shot Texture Retrieval with Global Context Metriccited by 3
Built on by
Citing papers per year: 2021: 2; 2022: 3; 2023: 6; 2024: 9; 2025: 11; 2026: 1.
32 papers.
Sort:
By area:
- 2023Grounding 3D Object Affordance from 2D Interactions in Imagescited by 62
- 2023One-Shot Open Affordance Learning with Foundation Modelscited by 45
- 2023Open-Vocabulary Affordance Detection in 3D Point Cloudscited by 41
- 2021One-Shot Object Affordance Detection in the Wildcited by 40
- 2022One-Shot Transfer of Affordance Regions? AffCorrs!cited by 31
- 2024GREAT: Geometry-Intention Collaborative Inference for Open-Vocabulary 3D Object Affordance Groundingcited by 26
- 2021Learning Visual Affordance Grounding from Demonstration Videoscited by 25
- 2022Grounded Affordance from Exocentric Viewcited by 21
- 2024Learning 2D Invariant Affordance Knowledge for 3D Affordance Groundingcited by 21
- 2022Phrase-Based Affordance Detection via Cyclic Bilateral Interactioncited by 19
- 2025Grounding 3D Object Affordance with Language Instructions, Visual Observations and Interactionscited by 19
- 2024GEAL: Generalizable 3D Affordance Learning with Cross-Modal Consistencycited by 17
20 more
- 2024Intent3D: 3D Object Detection in RGB-D Scans Based on Human Intentioncited by 16
- 2023RIO: A Benchmark for Reasoning Intention-Oriented Objects in Open Environmentscited by 15
- 2024WorldAfford: Affordance Grounding based on Natural Language Instructionscited by 14
- 2025GLOVER++: Unleashing the Potential of Affordance Learning from Human Behaviors for Robotic Manipulationcited by 14
- 2024Grounding 3D Scene Affordance From Egocentric Interactionscited by 11
- 2025Visual Intention Grounding for Egocentric Assistantscited by 11
- 2025Weakly-Supervised Affordance Grounding Guided by Part-Level Semantic Priorscited by 9
- 2023NOIR: Neural Signal Operated Intelligent Robots for Everyday Activitiescited by 8
- 2024Beyond Literal Descriptions: Understanding and Locating Open-World Objects Aligned with Human Intentionscited by 8
- 2025Bridging Perspectives: A Survey on Cross-view Collaborative Intelligence with Egocentric-Exocentric Visioncited by 8
- 2025Afford-X: Generalizable and Slim Affordance Reasoning for Task-oriented Manipulationcited by 3
- 2024Visual-Geometric Collaborative Guidance for Affordance Learningcited by 2
- 2025Beyond Object Categories: Multi-Attribute Reference Understanding for Visual Groundingcited by 2
- 2025Unlocking 3D Affordance Segmentation with 2D Semantic Knowledgecited by 2
- 2023Implicit Affordance Acquisition via Causal Action-Effect Modeling in the Video Domaincited by 1
- 2025Visual Affordance Prediction: Survey and Reproducibilitycited by 1
- 2024Leverage Task Context for Object Affordance Rankingcited by 0
- 2025Populate-A-Scene: Affordance-Aware Human Video Generationcited by 0
- 2025YOLOA: Real-Time Affordance Detection via LLM Adaptercited by 0
- 2026SpatialAfford: Teaching Compact VLMs Where to Look and Where to Ground for Affordancecited by 0
- 2026SpatialAfford: Teaching Compact VLMs Where to Look and Where to Ground for Affordance1 Aug 2026
- 2025YOLOA: Real-Time Affordance Detection via LLM Adapter3 Dec 2025
- 2025Unlocking 3D Affordance Segmentation with 2D Semantic Knowledge9 Oct 2025
- 2025Populate-A-Scene: Affordance-Aware Human Video Generation1 Jul 2025
- 2025Bridging Perspectives: A Survey on Cross-view Collaborative Intelligence with Egocentric-Exocentric Vision6 Jun 2025
- 2025Weakly-Supervised Affordance Grounding Guided by Part-Level Semantic Priors30 May 2025
- 2025GLOVER++: Unleashing the Potential of Affordance Learning from Human Behaviors for Robotic Manipulation17 May 2025
- 2025Visual Affordance Prediction: Survey and Reproducibility8 May 2025
- 2025Visual Intention Grounding for Egocentric Assistants18 Apr 2025
- 2025Grounding 3D Object Affordance with Language Instructions, Visual Observations and Interactions7 Apr 2025
- 2025Beyond Object Categories: Multi-Attribute Reference Understanding for Visual Grounding25 Mar 2025
- 2025Afford-X: Generalizable and Slim Affordance Reasoning for Task-oriented Manipulation5 Mar 2025
20 more
- 2024GEAL: Generalizable 3D Affordance Learning with Cross-Modal Consistency12 Dec 2024
- 2024GREAT: Geometry-Intention Collaborative Inference for Open-Vocabulary 3D Object Affordance Grounding29 Nov 2024
- 2024Leverage Task Context for Object Affordance Ranking25 Nov 2024
- 2024Visual-Geometric Collaborative Guidance for Affordance Learning15 Oct 2024
- 2024Grounding 3D Scene Affordance From Egocentric Interactions29 Sep 2024
- 2024Learning 2D Invariant Affordance Knowledge for 3D Affordance Grounding23 Aug 2024
- 2024Intent3D: 3D Object Detection in RGB-D Scans Based on Human Intention28 May 2024
- 2024WorldAfford: Affordance Grounding based on Natural Language Instructions21 May 2024
- 2024Beyond Literal Descriptions: Understanding and Locating Open-World Objects Aligned with Human Intentions17 Feb 2024
- 2023Implicit Affordance Acquisition via Causal Action-Effect Modeling in the Video Domain18 Dec 2023
- 2023One-Shot Open Affordance Learning with Foundation Models29 Nov 2023
- 2023NOIR: Neural Signal Operated Intelligent Robots for Everyday Activities2 Nov 2023
- 2023RIO: A Benchmark for Reasoning Intention-Oriented Objects in Open Environments26 Oct 2023
- 2023Grounding 3D Object Affordance from 2D Interactions in Images18 Mar 2023
- 2023Open-Vocabulary Affordance Detection in 3D Point Clouds4 Mar 2023
- 2022One-Shot Transfer of Affordance Regions? AffCorrs!15 Sep 2022
- 2022Grounded Affordance from Exocentric View28 Aug 2022
- 2022Phrase-Based Affordance Detection via Cyclic Bilateral Interaction24 Feb 2022
- 2021Learning Visual Affordance Grounding from Demonstration Videos12 Aug 2021
- 2021One-Shot Object Affordance Detection in the Wild8 Aug 2021
- 2023Grounding 3D Object Affordance from 2D Interactions in Imagescited by 62
- 2023One-Shot Open Affordance Learning with Foundation Modelscited by 45
- 2023Open-Vocabulary Affordance Detection in 3D Point Cloudscited by 41
- 2021One-Shot Object Affordance Detection in the Wildcited by 40
- 2022One-Shot Transfer of Affordance Regions? AffCorrs!cited by 31
- 2024GREAT: Geometry-Intention Collaborative Inference for Open-Vocabulary 3D Object Affordance Groundingcited by 26
- 2021Learning Visual Affordance Grounding from Demonstration Videoscited by 25
- 2022Grounded Affordance from Exocentric Viewcited by 21
- 2024Learning 2D Invariant Affordance Knowledge for 3D Affordance Groundingcited by 21
- 2022Phrase-Based Affordance Detection via Cyclic Bilateral Interactioncited by 19
- 2025Grounding 3D Object Affordance with Language Instructions, Visual Observations and Interactionscited by 19
- 2024GEAL: Generalizable 3D Affordance Learning with Cross-Modal Consistencycited by 17
12 most cited of 31 All 31 (JSON)
- 2026SpatialAfford: Teaching Compact VLMs Where to Look and Where to Ground for Affordance1 Aug 2026
- 2025YOLOA: Real-Time Affordance Detection via LLM Adapter3 Dec 2025
- 2025Unlocking 3D Affordance Segmentation with 2D Semantic Knowledge9 Oct 2025
- 2025Populate-A-Scene: Affordance-Aware Human Video Generation1 Jul 2025
- 2025Bridging Perspectives: A Survey on Cross-view Collaborative Intelligence with Egocentric-Exocentric Vision6 Jun 2025
- 2025Weakly-Supervised Affordance Grounding Guided by Part-Level Semantic Priors30 May 2025
- 2025GLOVER++: Unleashing the Potential of Affordance Learning from Human Behaviors for Robotic Manipulation17 May 2025
- 2025Visual Affordance Prediction: Survey and Reproducibility8 May 2025
- 2025Visual Intention Grounding for Egocentric Assistants18 Apr 2025
- 2025Grounding 3D Object Affordance with Language Instructions, Visual Observations and Interactions7 Apr 2025
- 2025Beyond Object Categories: Multi-Attribute Reference Understanding for Visual Grounding25 Mar 2025
- 2024GEAL: Generalizable 3D Affordance Learning with Cross-Modal Consistency12 Dec 2024
12 newest of 31 All 31 (JSON)