Reproducible Multimodal Affordance Prediction
Not on the map. Why?
Abstract (arXiv)
Affordance prediction is the identification of potential actions an agent can perform on a target object from multimodal inputs. Affordance prediction methods are difficult to evaluate and compare due to heterogeneous problem formulations, inconsistent dataset annotations, incomplete reporting of experimental protocols, and limited information about deployment conditions. These limitations challenge fair benchmarking and performance comparison. To promote transparency, we propose the Affordance Sheet, a documentation detailing task formulation with its input modalities, model architectures and training information, datasets, and experimental protocols. Affordance Sheets enable reproducible benchmarking and reliable evaluation of affordance models for real-world scenarios, including generalisation to novel conditions and human safety.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 58 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
27 of 58 references.
References · 27
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018Datasheets for Datasetscited by 1,386
- 2018Model Cards for Model Reportingcited by 1,080
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2020Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)cited by 322
- 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 137
- 2017AffordanceNet: An End-to-End Deep Learning Approach for Object Affordance Detectioncited by 128
- 2020EGO-TOPO: Environment Affordances from Egocentric Videocited by 111
- 2023Affordance Diffusion: Synthesizing Hand-Object Interactionscited by 110
- 20213D AffordanceNet: A Benchmark for Visual Object Affordance Understandingcited by 100
- 2018Jacquard: A Large Scale Dataset for Robotic Grasp Detectioncited by 87
15 more
- 2022Learning Affordance Grounding from Exocentric Imagescited by 82
- 2023Grounding 3D Object Affordance from 2D Interactions in Imagescited by 62
- 2019EasyLabel: A Semi-Automatic Pixel-wise Object Annotation Tool for Creating Robotic RGB-D Datasetscited by 58
- 2023HANDAL: A Dataset of Real-World Manipulable Object Categories with Pose Annotations, Affordances, and Reconstructionscited by 48
- 2022A4T: Hierarchical Affordance Detection for Transparent Objects Depth Reconstruction and Manipulationcited by 23
- 2024Learning 2D Invariant Affordance Knowledge for 3D Affordance Groundingcited by 22
- 2020Multi-FinGAN: Generative Coarse-To-Fine Sampling of Multi-Finger Graspscited by 20
- 2023Multi-label affordance mapping from egocentric visioncited by 18
- 2021Towards safe human-to-robot handovers of unknown containerscited by 11
- 2023STRAP: Structured Object Affordance Segmentation with Point Supervisioncited by 10
- 2022A large scale multi-view RGBD visual affordance learning datasetcited by 6
- 2026Human Universal Graspingcited by 5
- 2024Segmenting Object Affordances: Reproducibility and Sensitivity to Scalecited by 3
- 2023Affordance segmentation of hand-occluded containers from exocentric imagescited by 2
- 2024Stereo Hand-Object Reconstruction for Human-to-Robot Handovercited by 2
Built on by
Not cited yet.