Agents and Devices: A Relative Definition of Agency
Not on the map. Why?
Abstract (arXiv)
According to Dennett, the same system may be described using a `physical' (mechanical) explanatory stance, or using an `intentional' (belief- and goal-based) explanatory stance. Humans tend to find the physical stance more helpful for certain systems, such as planets orbiting a star, and the intentional stance for others, such as living animals. We define a formal counterpart of physical and intentional stances within computational theory: a description of a system as either a device, or an agent, with the key difference being that `devices' are directly described in terms of an input-output mapping, while `agents' are described in terms of the function they optimise. Bayes' rule can then be applied to calculate the subjective probability of a system being a device or an agent, based only on its behaviour. We illustrate this using the trajectories of an object in a toy grid-world domain.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). First posted on arXiv 31 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 4; 2023: 1; 2024: 4; 2025: 3; 2026: 2.
16 papers.
Sort:
By area:
- 2023Harms from Increasingly Agentic Algorithmic Systemscited by 135
- 2022Goal Misgeneralization: Why Correct Specifications Aren't Enough For Correct Goalscited by 126
- 2021Goal Misgeneralization in Deep Reinforcement Learningcited by 123
- 2022Discovering Agentscited by 28
- 2025Evaluating the Goal-Directedness of Large Language Modelscited by 16
- 2024Evaluating AI Evaluation: Perils and Prospectscited by 11
- 2022Aligned with Whom? Direct and social goals for AI systemscited by 7
- 2022Interpreting systems as solving POMDPs: a step towards a formal understanding of agencycited by 7
- 2024Towards Measuring Goal-Directedness in AI Systemscited by 7
- 2024Measuring Goal-Directednesscited by 7
- 2021Interpreting Dynamical Systems as Bayesian Reasonerscited by 5
- 2024Dynamic Normativity: Necessary and Sufficient Conditions for Value Alignmentcited by 3
4 more
- 2025Goal-Directedness is in the Eye of the Beholdercited by 3
- 2025Technical Report: Evaluating Goal Drift in Language Model Agentscited by 2
- 2026Causal Foundations of Collective Agencycited by 0
- 2026Can AI systems have free will?cited by 0
- 2026Can AI systems have free will?14 Sep 2026
- 2026Causal Foundations of Collective Agency30 Apr 2026
- 2025Goal-Directedness is in the Eye of the Beholder18 Aug 2025
- 2025Technical Report: Evaluating Goal Drift in Language Model Agents5 May 2025
- 2025Evaluating the Goal-Directedness of Large Language Models16 Apr 2025
- 2024Measuring Goal-Directedness6 Dec 2024
- 2024Towards Measuring Goal-Directedness in AI Systems7 Oct 2024
- 2024Evaluating AI Evaluation: Perils and Prospects12 Jul 2024
- 2024Dynamic Normativity: Necessary and Sufficient Conditions for Value Alignment16 Jun 2024
- 2023Harms from Increasingly Agentic Algorithmic Systems20 Feb 2023
- 2022Goal Misgeneralization: Why Correct Specifications Aren't Enough For Correct Goals4 Oct 2022
- 2022Interpreting systems as solving POMDPs: a step towards a formal understanding of agency4 Sep 2022
4 more
- 2022Discovering Agents17 Aug 2022
- 2022Aligned with Whom? Direct and social goals for AI systems9 May 2022
- 2021Interpreting Dynamical Systems as Bayesian Reasoners27 Dec 2021
- 2021Goal Misgeneralization in Deep Reinforcement Learning28 May 2021
- 2023Harms from Increasingly Agentic Algorithmic Systemscited by 135
- 2025Technical Report: Evaluating Goal Drift in Language Model Agentscited by 2
- 2025Technical Report: Evaluating Goal Drift in Language Model Agents5 May 2025
- 2023Harms from Increasingly Agentic Algorithmic Systems20 Feb 2023
- 2022Goal Misgeneralization: Why Correct Specifications Aren't Enough For Correct Goalscited by 126
- 2021Goal Misgeneralization in Deep Reinforcement Learningcited by 123
- 2022Discovering Agentscited by 28
- 2025Evaluating the Goal-Directedness of Large Language Modelscited by 16
- 2024Evaluating AI Evaluation: Perils and Prospectscited by 11
- 2022Aligned with Whom? Direct and social goals for AI systemscited by 7
- 2022Interpreting systems as solving POMDPs: a step towards a formal understanding of agencycited by 7
- 2024Towards Measuring Goal-Directedness in AI Systemscited by 7
- 2024Measuring Goal-Directednesscited by 7
- 2021Interpreting Dynamical Systems as Bayesian Reasonerscited by 5
- 2025Goal-Directedness is in the Eye of the Beholdercited by 3
- 2026Causal Foundations of Collective Agencycited by 0
12 most cited of 13 All 13 (JSON)
- 2026Can AI systems have free will?14 Sep 2026
- 2026Causal Foundations of Collective Agency30 Apr 2026
- 2025Goal-Directedness is in the Eye of the Beholder18 Aug 2025
- 2025Evaluating the Goal-Directedness of Large Language Models16 Apr 2025
- 2024Measuring Goal-Directedness6 Dec 2024
- 2024Towards Measuring Goal-Directedness in AI Systems7 Oct 2024
- 2024Evaluating AI Evaluation: Perils and Prospects12 Jul 2024
- 2022Goal Misgeneralization: Why Correct Specifications Aren't Enough For Correct Goals4 Oct 2022
- 2022Interpreting systems as solving POMDPs: a step towards a formal understanding of agency4 Sep 2022
- 2022Discovering Agents17 Aug 2022
- 2022Aligned with Whom? Direct and social goals for AI systems9 May 2022
- 2021Interpreting Dynamical Systems as Bayesian Reasoners27 Dec 2021
12 newest of 13 All 13 (JSON)