Incomplete Contracting and AI Alignment
Not on the map. Why?
Abstract (arXiv)
We suggest that the analysis of incomplete contracting developed by law and economics researchers can provide a useful framework for understanding the AI alignment problem and help to generate a systematic approach to finding solutions. We first provide an overview of the incomplete contracting literature and explore parallels between this work and the problem of AI alignment. As we emphasize, misalignment between principal and agent is a core focus of economic analysis. We highlight some technical results from the economics literature on incomplete contracts that may provide insights for AI alignment researchers. Our core contribution, however, is to bring to bear an insight that economists have been urged to absorb from legal scholars and other behavioral scientists: the fact that human contracting is supported by substantial amounts of external structure, such as generally available institutions (culture, law) that can supply implied terms to fill the gaps in incomplete contracts. We propose a research agenda for AI alignment work that focuses on the problem of how to build AI that can replicate the human cognitive processes that connect individual incomplete contracts with this supporting external structure.
Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 4; 2023: 9; 2024: 8; 2025: 15; 2026: 18.
60 papers.
Sort:
By area:
- 2023Harms from Increasingly Agentic Algorithmic Systemscited by 134
- 2021Consequences of Misaligned AIcited by 79
- 2024Beyond Preferences in AI Alignmentcited by 46
- 2024AI Alignment with Changing and Influenceable Reward Functionscited by 33
- 2021What are you optimizing for? Aligning Recommender Systems with Human Valuescited by 28
- 2021Hard Choices in Artificial Intelligencecited by 26
- 2021MORAL: Aligning AI with Human Norms through Multi-Objective Reinforced Active Learningcited by 24
- 2022Law Informs Code: A Legal Informatics Approach to Aligning Artificial Intelligence with Humanscited by 23
- 2025An Economy of AI Agentscited by 17
- 2024LLM Theory of Mind and Alignment: Opportunities and Riskscited by 15
- 2023Principal-Agent Reward Shaping in MDPscited by 12
- 2025Inherent and emergent liability issues in LLM-based agentic systems: a principal-agent perspectivecited by 12
38 more
- 2022Metaethical Perspectives on 'Benchmarking' AI Ethicscited by 11
- 2024Risks and Opportunities of Open-Source Generative AIcited by 11
- 2023Deep Contract Design via Discontinuous Networkscited by 10
- 2024On Goodhart's law, with an application to value alignmentcited by 9
- 2025Societal and technological progress as sewing an ever-growing, ever-changing, patchy, and polychrome quiltcited by 9
- 2025AI Agents and the Lawcited by 9
- 2023Designing Fiduciary Artificial Intelligencecited by 8
- 2025Societal Alignment Frameworks Can Improve LLM Alignmentcited by 8
- 2025Resource Rational Contractualism Should Guide AI Alignmentcited by 8
- 2023A Review of the Evidence for Existential Risk from AI via Misaligned Power-Seekingcited by 7
- 2025Full-Stack Alignment: Co-Aligning AI and Institutions with Thick Models of Valuecited by 6
- 2023Survey on AI Ethics: A Socio-technical Perspectivecited by 4
- 2024Improved Emotional Alignment of AI and Humans: Human Ratings of Emotions Expressed by Stable Diffusion v1, DALL-E 2, and DALL-E 3cited by 3
- 2021Counterfactual Planning in AGI Systemscited by 2
- 2025A Protocol for Trustless Verification Under Uncertaintycited by 2
- 2026Reward Shaping for (Inference-Time) Alignment: A Stackelberg Game Perspectivecited by 2
- 2026Towards Selection as Power: Bounding Decision Authority in Autonomous Agentscited by 2
- 2026Post-AGI Economies: Autonomy and the First Fundamental Theorem of Welfare Economicscited by 2
- 2022The Linguistic Blind Spot of Value-Aligned Agency, Natural and Artificialcited by 1
- 2023Positive AI: Key Challenges in Designing Artificial Intelligence for Wellbeingcited by 1
- 2024On the Undecidability of Artificial Intelligence Alignment: Machines that Haltcited by 1
- 2025Pricing Access to Dynamic Information Servicescited by 1
- 2026Multi-Agent Systems Should be Treated as Principal-Agent Problemscited by 1
- 2026Consequentialist Objectives and Catastrophecited by 1
- 2026AI Alignment via Incentives and Correctioncited by 1
- 2026Post-AGI Economies: Superposition and the Second Fundamental Theorem of Welfare Economicscited by 1
- 2026Commitment To Cooperation With Self-Negotiated Contractscited by 1
- 2021Demanding and Designing Aligned Cognitive Architecturescited by 0
- 2022Modelling the Recommender Alignment Problemcited by 0
- 2023Artificial Intelligence and Dual Contractcited by 0
- 2023Dynamic value alignment through preference aggregation of multiple objectivescited by 0
- 2024Systematic Characterization of the Effectiveness of Alignment in Large Language Models for Categorical Decisionscited by 0
- 2025AI Agents and Hard Choicescited by 0
- 2025On Monotonicity in AI Alignmentcited by 0
- 2025Getting In Contract with Large Language Models -- An Agency Theory Perspective On Large Language Model Alignmentcited by 0
- 2025Bridging Cultural Distance Between Models Default and Local Classroom Demands: How Global Teachers Adopt GenAI to Support Everyday Teaching Practicescited by 0
- 2025Corrigibility Transformation: Constructing Goals That Accept Updatescited by 0
- 2025Validity Is What You Needcited by 0
50 most cited of 60 All 60 (JSON)
- 2026When Does Randomized Oversight Align AI Agents That Can Conceal?29 Sep 2026
- 2026Reality Is the Final Verifier: On Two Key Gaps in Agentic Software Engineering10 Sep 2026
- 2026Agent Inheritance Protocol: Speculating on Feralized Agents After Principals Die15 Aug 2026
- 2026Evaluating Rational Contracting in Natural Language11 Aug 2026
- 2026Fragility of Value under Imperfect Alignment30 Jul 2026
- 2026Commitment To Cooperation With Self-Negotiated Contracts23 Jul 2026
- 2026Measuring Behavior Portability in Large Language Models22 Jun 2026
- 2026Post-AGI Economies: Superposition and the Second Fundamental Theorem of Welfare Economics6 Jun 2026
- 2026The Behavioral Credibility Trilemma: When Calibrated Autonomy Becomes Impossible25 May 2026
- 2026AI Alignment via Incentives and Correction2 May 2026
- 2026Post-AGI Economies: Autonomy and the First Fundamental Theorem of Welfare Economics23 Apr 2026
- 2026Relative Principals, Pluralistic Alignment, and the Structural Value Alignment Problem22 Apr 2026
38 more
- 2026Consequentialist Objectives and Catastrophe16 Mar 2026
- 2026Selection as Power: Constrained Reinforcement for Bounded Decision Authority2 Mar 2026
- 2026The Headless Firm: How AI Reshapes Enterprise Boundaries24 Feb 2026
- 2026Towards Selection as Power: Bounding Decision Authority in Autonomous Agents16 Feb 2026
- 2026Reward Shaping for (Inference-Time) Alignment: A Stackelberg Game Perspective31 Jan 2026
- 2026Multi-Agent Systems Should be Treated as Principal-Agent Problems30 Jan 2026
- 2025Full-Stack Alignment: Co-Aligning AI and Institutions with Thick Models of Value3 Dec 2025
- 2025Validity Is What You Need31 Oct 2025
- 2025Corrigibility Transformation: Constructing Goals That Accept Updates17 Oct 2025
- 2025Pricing Access to Dynamic Information Services10 Oct 2025
- 2025Bridging Cultural Distance Between Models Default and Local Classroom Demands: How Global Teachers Adopt GenAI to Support Everyday Teaching Practices13 Sep 2025
- 2025Getting In Contract with Large Language Models -- An Agency Theory Perspective On Large Language Model Alignment9 Sep 2025
- 2025An Economy of AI Agents1 Sep 2025
- 2025AI Agents and the Law12 Aug 2025
- 2025A Protocol for Trustless Verification Under Uncertainty1 Jul 2025
- 2025Resource Rational Contractualism Should Guide AI Alignment20 Jun 2025
- 2025On Monotonicity in AI Alignment10 Jun 2025
- 2025Societal and technological progress as sewing an ever-growing, ever-changing, patchy, and polychrome quilt8 May 2025
- 2025AI Agents and Hard Choices18 Apr 2025
- 2025Inherent and emergent liability issues in LLM-based agentic systems: a principal-agent perspective4 Apr 2025
- 2025Societal Alignment Frameworks Can Improve LLM Alignment27 Feb 2025
- 2024On Goodhart's law, with an application to value alignment12 Oct 2024
- 2024Systematic Characterization of the Effectiveness of Alignment in Large Language Models for Categorical Decisions18 Sep 2024
- 2024Beyond Preferences in AI Alignment30 Aug 2024
- 2024On the Undecidability of Artificial Intelligence Alignment: Machines that Halt16 Aug 2024
- 2024Improved Emotional Alignment of AI and Humans: Human Ratings of Emotions Expressed by Stable Diffusion v1, DALL-E 2, and DALL-E 328 May 2024
- 2024AI Alignment with Changing and Influenceable Reward Functions28 May 2024
- 2024Risks and Opportunities of Open-Source Generative AI14 May 2024
- 2024LLM Theory of Mind and Alignment: Opportunities and Risks13 May 2024
- 2023Principal-Agent Reward Shaping in MDPs30 Dec 2023
- 2023Survey on AI Ethics: A Socio-technical Perspective28 Nov 2023
- 2023A Review of the Evidence for Existential Risk from AI via Misaligned Power-Seeking27 Oct 2023
- 2023Dynamic value alignment through preference aggregation of multiple objectives9 Oct 2023
- 2023Designing Fiduciary Artificial Intelligence27 Jul 2023
- 2023Deep Contract Design via Discontinuous Networks5 Jul 2023
- 2023Positive AI: Key Challenges in Designing Artificial Intelligence for Wellbeing12 Apr 2023
- 2023Artificial Intelligence and Dual Contract22 Mar 2023
- 2023Harms from Increasingly Agentic Algorithmic Systems20 Feb 2023
50 newest of 60 All 60 (JSON)
- 2024Beyond Preferences in AI Alignmentcited by 46
- 2024AI Alignment with Changing and Influenceable Reward Functionscited by 33
- 2021What are you optimizing for? Aligning Recommender Systems with Human Valuescited by 28
- 2021MORAL: Aligning AI with Human Norms through Multi-Objective Reinforced Active Learningcited by 24
- 2024LLM Theory of Mind and Alignment: Opportunities and Riskscited by 15
- 2025Societal Alignment Frameworks Can Improve LLM Alignmentcited by 8
- 2026Reward Shaping for (Inference-Time) Alignment: A Stackelberg Game Perspectivecited by 2
- 2024On the Undecidability of Artificial Intelligence Alignment: Machines that Haltcited by 1
- 2024Systematic Characterization of the Effectiveness of Alignment in Large Language Models for Categorical Decisionscited by 0
- 2025On Monotonicity in AI Alignmentcited by 0
- 2025Getting In Contract with Large Language Models -- An Agency Theory Perspective On Large Language Model Alignmentcited by 0
- 2026Fragility of Value under Imperfect Alignmentcited by 0
- 2026Fragility of Value under Imperfect Alignment30 Jul 2026
- 2026Reward Shaping for (Inference-Time) Alignment: A Stackelberg Game Perspective31 Jan 2026
- 2025Getting In Contract with Large Language Models -- An Agency Theory Perspective On Large Language Model Alignment9 Sep 2025
- 2025On Monotonicity in AI Alignment10 Jun 2025
- 2025Societal Alignment Frameworks Can Improve LLM Alignment27 Feb 2025
- 2024Systematic Characterization of the Effectiveness of Alignment in Large Language Models for Categorical Decisions18 Sep 2024
- 2024Beyond Preferences in AI Alignment30 Aug 2024
- 2024On the Undecidability of Artificial Intelligence Alignment: Machines that Halt16 Aug 2024
- 2024AI Alignment with Changing and Influenceable Reward Functions28 May 2024
- 2024LLM Theory of Mind and Alignment: Opportunities and Risks13 May 2024
- 2021MORAL: Aligning AI with Human Norms through Multi-Objective Reinforced Active Learning30 Dec 2021
- 2021What are you optimizing for? Aligning Recommender Systems with Human Values22 Jul 2021
- 2023Harms from Increasingly Agentic Algorithmic Systemscited by 134
- 2025Inherent and emergent liability issues in LLM-based agentic systems: a principal-agent perspectivecited by 12
- 2025AI Agents and the Lawcited by 9
- 2026Towards Selection as Power: Bounding Decision Authority in Autonomous Agentscited by 2
- 2026Multi-Agent Systems Should be Treated as Principal-Agent Problemscited by 1
- 2025Validity Is What You Needcited by 0
- 2026Selection as Power: Constrained Reinforcement for Bounded Decision Authoritycited by 0
- 2026Reality Is the Final Verifier: On Two Key Gaps in Agentic Software Engineeringcited by 0
- 2026Reality Is the Final Verifier: On Two Key Gaps in Agentic Software Engineering10 Sep 2026
- 2026Selection as Power: Constrained Reinforcement for Bounded Decision Authority2 Mar 2026
- 2026Towards Selection as Power: Bounding Decision Authority in Autonomous Agents16 Feb 2026
- 2026Multi-Agent Systems Should be Treated as Principal-Agent Problems30 Jan 2026
- 2025Validity Is What You Need31 Oct 2025
- 2025AI Agents and the Law12 Aug 2025
- 2025Inherent and emergent liability issues in LLM-based agentic systems: a principal-agent perspective4 Apr 2025
- 2023Harms from Increasingly Agentic Algorithmic Systems20 Feb 2023
- 2021Consequences of Misaligned AIcited by 79
- 2021Hard Choices in Artificial Intelligencecited by 26
- 2022Law Informs Code: A Legal Informatics Approach to Aligning Artificial Intelligence with Humanscited by 23
- 2025An Economy of AI Agentscited by 17
- 2023Principal-Agent Reward Shaping in MDPscited by 12
- 2022Metaethical Perspectives on 'Benchmarking' AI Ethicscited by 11
- 2024Risks and Opportunities of Open-Source Generative AIcited by 11
- 2023Deep Contract Design via Discontinuous Networkscited by 10
- 2024On Goodhart's law, with an application to value alignmentcited by 9
- 2025Societal and technological progress as sewing an ever-growing, ever-changing, patchy, and polychrome quiltcited by 9
- 2023Designing Fiduciary Artificial Intelligencecited by 8
- 2025Resource Rational Contractualism Should Guide AI Alignmentcited by 8
12 most cited of 39 All 39 (JSON)
- 2026When Does Randomized Oversight Align AI Agents That Can Conceal?29 Sep 2026
- 2026Agent Inheritance Protocol: Speculating on Feralized Agents After Principals Die15 Aug 2026
- 2026Evaluating Rational Contracting in Natural Language11 Aug 2026
- 2026Commitment To Cooperation With Self-Negotiated Contracts23 Jul 2026
- 2026Measuring Behavior Portability in Large Language Models22 Jun 2026
- 2026Post-AGI Economies: Superposition and the Second Fundamental Theorem of Welfare Economics6 Jun 2026
- 2026The Behavioral Credibility Trilemma: When Calibrated Autonomy Becomes Impossible25 May 2026
- 2026AI Alignment via Incentives and Correction2 May 2026
- 2026Post-AGI Economies: Autonomy and the First Fundamental Theorem of Welfare Economics23 Apr 2026
- 2026Relative Principals, Pluralistic Alignment, and the Structural Value Alignment Problem22 Apr 2026
- 2026Consequentialist Objectives and Catastrophe16 Mar 2026
- 2026The Headless Firm: How AI Reshapes Enterprise Boundaries24 Feb 2026
12 newest of 39 All 39 (JSON)