# A General Framework for the Representation of Function and Affordance: A Cognitive, Causal, and Grounded Approach, and a Step Toward AGI

arXiv: https://arxiv.org/abs/2206.05273 · HTML: https://mlsanity.com/paper/2206.05273/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 6 of its 112 references that are in the map.
- First posted on arXiv 2 Jun 2022.

## Builds on (most cited first, 6 of 6)

- [Integrated Task and Motion Planning](https://mlsanity.com/paper/2010.01083/) (2020)
- [Holistic 3D Scene Parsing and Reconstruction from a Single RGB Image](https://mlsanity.com/paper/1808.02201/) (2018)
- [Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense](https://mlsanity.com/paper/2004.09044/) (2020)
- [Why AI is Harder Than We Think](https://mlsanity.com/paper/2104.12871/) (2021)
- [Theory-based Causal Transfer: Integrating Instance-level Induction and Abstract-level Structure Learning](https://mlsanity.com/paper/1911.11185/) (2019)
- [Is That a Chair? Imagining Affordances Using Simulations of an Articulated Human Body](https://mlsanity.com/paper/1909.07572/) (2019)

## Built on by (most cited first, 3 of 3)

- [Knowledge Representation for Conceptual, Motivational, and Affective Processes in Natural Language Communication](https://mlsanity.com/paper/2210.08994/) (2022)
- [Why is That a Good or Not a Good Frying Pan? -- Knowledge Representation for Functions of Objects and Tools for Design Understanding, Improvement, and Generation](https://mlsanity.com/paper/2303.06152/) (2023)
- [Affordance Perception by a Knowledge-Guided Vision-Language Model with Efficient Error Correction](https://mlsanity.com/paper/2407.13368/) (2024)

## Abstract (arXiv)

In AI research, so far, the attention paid to the characterization and representation of function and affordance has been sporadic and sparse, even though this aspect features prominently in an intelligent system's functioning. In the sporadic and sparse, though commendable efforts so far devoted to the characterization and understanding of function and affordance, there has also been no general framework that could unify all the different use domains and situations related to the representation and application of functional concepts. This paper develops just such a general framework, with an approach that emphasizes the fact that the representations involved must be explicitly cognitive and conceptual, and they must also contain causal characterizations of the events and processes involved, as well as employ conceptual constructs that are grounded in the referents to which they refer, in order to achieve maximal generality. The basic general framework is described, along with a set of basic guiding principles with regards to the representation of functionality. To properly and adequately characterize and represent functionality, a descriptive representation language is needed. This language is defined and developed, and many examples of its use are described. The general framework is developed based on an extension of the general language meaning representational framework called conceptual dependency. To support the general characterization and representation of functionality, the basic conceptual dependency framework is enhanced with representational devices called structure anchor and conceptual dependency elaboration, together with the definition of a set of ground level concepts. These novel representational constructs are defined, developed, and described. A general framework dealing with functionality would represent a major step toward achieving Artificial General Intelligence.