Are standard Object Segmentation models sufficient for Learning Affordance Segmentation?
Not on the map. Why?
Abstract (arXiv)
Affordances are the possibilities of actions the environment offers to the individual. Ordinary objects (hammer, knife) usually have many affordances (grasping, pounding, cutting), and detecting these allow artificial agents to understand what are their possibilities in the environment, with obvious application in Robotics. Proposed benchmarks and state-of-the-art prediction models for supervised affordance segmentation are usually modifications of popular object segmentation models such as Mask R-CNN. We observe that theoretically, these popular object segmentation methods should be sufficient for detecting affordances masks. So we ask the question: is it necessary to tailor new architectures to the problem of learning affordances? We show that applying the out-of-the-box Mask R-CNN to the problem of affordances segmentation outperforms the current state-of-the-art. We conclude that the problem of supervised affordance segmentation is included in the problem of object segmentation and argue that better benchmarks for affordance learning should include action capacities.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 23 of its 35 references that are in the map. First posted on arXiv 5 Jul 2021.
Builds on
23 of 35 references.
References · 23
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017Mask R-CNNcited by 7,259
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2015Fast R-CNNcited by 2,930
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2019YOLACT: Real-time Instance Segmentationcited by 441
- 2017Are GANs Created Equal? A Large-Scale Studycited by 267
11 more
- 2019Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approachescited by 181
- 2020iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenescited by 151
- 2017AffordanceNet: An End-to-End Deep Learning Approach for Object Affordance Detectioncited by 126
- 2017Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matchingcited by 124
- 2021Do Transformer Modifications Transfer Across Implementations and Applications?cited by 87
- 2017Learning to Act Properly: Predicting and Explaining Affordances from Imagescited by 74
- 2016Face Detection with the Faster R-CNNcited by 34
- 2020Affordances in Robotic Tasks -- A Surveycited by 28
- 2019Affordance Learning for End-to-End Visuomotor Robot Controlcited by 18
- 2017Stronger Baselines for Trustable Results in Neural Machine Translationcited by 12
- 2018Physical Primitive Decompositioncited by 10
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 2; 2026: 1.
6 papers.
- 2023Multi-label affordance mapping from egocentric visioncited by 18
- 2023Bayesian Deep Learning for Affordance Segmentation in imagescited by 13
- 2025Weakly-Supervised Affordance Grounding Guided by Part-Level Semantic Priorscited by 9
- 2024Segmenting Object Affordances: Reproducibility and Sensitivity to Scalecited by 3
- 2025Visual Affordance Prediction: Survey and Reproducibilitycited by 1
- 2026Uncertainty Estimation in Instance Segmentation of Affordances via Bayesian Visual Transformerscited by 0
- 2026Uncertainty Estimation in Instance Segmentation of Affordances via Bayesian Visual Transformers5 May 2026
- 2025Weakly-Supervised Affordance Grounding Guided by Part-Level Semantic Priors30 May 2025
- 2025Visual Affordance Prediction: Survey and Reproducibility8 May 2025
- 2024Segmenting Object Affordances: Reproducibility and Sensitivity to Scale3 Sep 2024
- 2023Multi-label affordance mapping from egocentric vision5 Sep 2023
- 2023Bayesian Deep Learning for Affordance Segmentation in images2 Mar 2023