Post-AGI Economies: Autonomy and the First Fundamental Theorem of Welfare Economics
Not on the map. Why?
Abstract (arXiv)
The First Fundamental Theorem of Welfare Economics assumes that welfare-bearing agents are autonomous and implicitly relies on a binary distinction between autonomy and instrumentality. Welfare subjects are those who have autonomy and therefore the capacity to choose and enter into utility comparisons, while everything else does not. In post-AGI economies this presupposition becomes nontrivial because artificial systems may exhibit varying degrees of autonomy, functioning as tools, delegates, strategic market actors, manipulators of choice environments, or possible welfare subjects. We argue that the theorem ought to be subject to an autonomy qualification where the impact of these changes in autonomy assumptions is incorporated. Using a minimal general-equilibrium model with autonomy-conditioned welfare, welfare-status assignment, delegation accounting, and verification institutions, we set out conditions for which autonomy-complete competitive equilibrium is autonomy-Pareto efficient. The classical theorem is recovered as the low-autonomy limit.
Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 27 of its 74 references that are in the map. First posted on arXiv 23 Apr 2026.
Builds on
27 of 74 references.
References · 27
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,502
- 2017Deep reinforcement learning from human preferencescited by 3,871
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,541
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,135
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,945
- 2016Concrete Problems in AI Safetycited by 1,614
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 751
- 2020Artificial Intelligence, Values and Alignmentcited by 443
- 2016Cooperative Inverse Reinforcement Learningcited by 299
- 2022Measuring Progress on Scalable Oversight for Large Language Modelscited by 220
- 2023Harms from Increasingly Agentic Algorithmic Systemscited by 135
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 124
15 more
- 2023Consciousness in Artificial Intelligence: Insights from the Science of Consciousnesscited by 101
- 2023Levels of AGI for Operationalizing Progress on the Path to AGIcited by 95
- 2023Could a Large Language Model be Conscious?cited by 72
- 2018Incomplete Contracting and AI Alignmentcited by 60
- 2025Levels of Autonomy for AI Agentscited by 46
- 2023The impact of generative artificial intelligence on socioeconomic inequalities and policy makingcited by 20
- 2025An Economy of AI Agentscited by 18
- 2026Intelligent AI Delegationcited by 17
- 2024Scenarios for the Transition to AGIcited by 13
- 2025A Pragmatic View of AI Personhoodcited by 12
- 2024Economic Policy Challenges for the Age of AIcited by 6
- 2026Some Simple Economics of AGIcited by 5
- 2025AI Wellbeingcited by 4
- 2026Time, Identity and Consciousness in Language Model Agentscited by 3
- 2026Delegation and Verification Under AIcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.