Intentionality is a Design Decision: Measuring Functional Intentionality for Accountable AI Systems
Not on the map. Why?
Abstract (arXiv)
As AI systems increasingly exhibit autonomous, goal-directed, and long-horizon behavior, users lack a standardized way to detect the degree to which a system functions like an intentional actor for governance and accountability purposes. This position paper defines intentionality not as consciousness, but as a behavioral profile characterized by purpose, foresight, volition, temporal commitment, and coherence - criteria long used in legal and philosophical contexts to infer intent. These properties are design-contingent: architectural choices such as memory persistence, planning depth, and tool autonomy shape the degree to which systems exhibit organized goal pursuit. If intentionality is design-contingent, it is in principle controllable. Yet control requires measurement. We introduce the Functional Intentionality Test (FIT), a multidimensional framework that quantifies intentional-like behavior across five observable dimensions, and propose FIT-Eval, a structured evaluation protocol for eliciting and scoring them. While reduced human agency can increase efficiency, rising intentional capacity heightens accountability risks. By translating intentionality into interpretable levels, FIT enables proportionate oversight and deliberate autonomy calibration in increasingly agentic systems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 3 of its 34 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
3 of 34 references.
References · 3
- 2024The Reasons that Agents Act: Intention and Instrumental Goalscited by 23
- 2024Is artificial consciousness achievable? Lessons from the human braincited by 11
- 2024Goal Inference from Open-Ended Dialogcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Active Inference: A method for Phenotyping Agency in AI systems?
- 2025Model-Free RL Agents Demonstrate System 1-Like Intentionality
- 2026Anticipatory Human Oversight of Agentic AI: A Philosophical Account
- 2026When Should an AI Act? A Human-Centered Model of Scene, Context, and Behavior for Agentic AI Design
- 2026Autonomy and Agency in Agentic AI: Architectural Tactics for Regulated Contexts
- 2026No One to Blame: A Framework of Constitutive AI Unaccountability
- 2026Beyond Task Success: An Evidence-Synthesis Framework for Evaluating, Governing, and Orchestrating Agentic AI
- 2026Mitigating loss of control in advanced AI systems through instrumental goal trajectories