mlsanityData to 7 Oct 2026

Are standard Object Segmentation models sufficient for Learning Affordance Segmentation?

arXiv 2107.02095 ↗First posted 5 Jul 2021cs.LG cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Affordances are the possibilities of actions the environment offers to the individual. Ordinary objects (hammer, knife) usually have many affordances (grasping, pounding, cutting), and detecting these allow artificial agents to understand what are their possibilities in the environment, with obvious application in Robotics. Proposed benchmarks and state-of-the-art prediction models for supervised affordance segmentation are usually modifications of popular object segmentation models such as Mask R-CNN. We observe that theoretically, these popular object segmentation methods should be sufficient for detecting affordances masks. So we ask the question: is it necessary to tailor new architectures to the problem of learning affordances? We show that applying the out-of-the-box Mask R-CNN to the problem of affordances segmentation outperforms the current state-of-the-art. We conclude that the problem of supervised affordance segmentation is included in the problem of object segmentation and argue that better benchmarks for affordance learning should include action capacities.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 23 of its 35 references that are in the map. First posted on arXiv 5 Jul 2021.

Builds on

23 of 35 references.

References · 23

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2017Mask R-CNNcited by 7,259
  3. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  4. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  5. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
  6. 2015Fast R-CNNcited by 2,930
  7. 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
  8. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
  9. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
  10. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  11. 2019YOLACT: Real-time Instance Segmentationcited by 441
  12. 2017Are GANs Created Equal? A Large-Scale Studycited by 267
11 more
  1. 2019Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approachescited by 181
  2. 2020iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenescited by 151
  3. 2017AffordanceNet: An End-to-End Deep Learning Approach for Object Affordance Detectioncited by 126
  4. 2017Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matchingcited by 124
  5. 2021Do Transformer Modifications Transfer Across Implementations and Applications?cited by 87
  6. 2017Learning to Act Properly: Predicting and Explaining Affordances from Imagescited by 74
  7. 2016Face Detection with the Faster R-CNNcited by 34
  8. 2020Affordances in Robotic Tasks -- A Surveycited by 28
  9. 2019Affordance Learning for End-to-End Visuomotor Robot Controlcited by 18
  10. 2017Stronger Baselines for Trustable Results in Neural Machine Translationcited by 12
  11. 2018Physical Primitive Decompositioncited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 1; 2025: 2; 2026: 1.

6 papers.