Disentangling AI Alignment: A Structured Taxonomy Beyond Safety and Ethics
Not on the map. Why?
Abstract (arXiv)
Recent advances in AI research make it increasingly plausible that artificial agents with consequential real-world impact will soon operate beyond tightly controlled environments. Ensuring that these agents are not only safe but that they adhere to broader normative expectations is thus an urgent interdisciplinary challenge. Multiple fields -- notably AI Safety, AI Alignment, and Machine Ethics -- claim to contribute to this task. However, the conceptual boundaries and interrelations among these domains remain vague, leaving researchers without clear guidance in positioning their work. To address this meta-challenge, we develop a structured conceptual framework for understanding AI alignment. Rather than focusing solely on alignment goals, we introduce a taxonomy distinguishing the alignment aim (safety, ethicality, legality, etc.), scope (outcome vs. execution), and constituency (individual vs. collective). This structural approach reveals multiple legitimate alignment configurations, providing a foundation for practical and philosophical integration across domains, and clarifying what it might mean for an agent to be aligned all-things-considered.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 5 of its 21 references that are in the map. First posted on arXiv 2 May 2025.
Builds on
5 of 21 references.
References · 5
- 2016Concrete Problems in AI Safetycited by 1,642
- 2020Artificial Intelligence, Values and Alignmentcited by 448
- 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
- 2023Balancing Transparency and Risk: The Security and Privacy Risks of Open-Source Machine Learning Modelscited by 5
- 2023Evaluating the Impact of Personalized Value Alignment in Human-Robot Interaction: Insights into Trust and Team Performance Outcomescited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2026Breaking Up with Normatively Monolithic Agency with GRACE: A Reason-Based Neuro-Symbolic Architecture for Safe and Ethical AI Alignmentcited by 5
- 2025Justifications for Democratizing AI Alignment and Their Prospectscited by 2
- 2026Anticipatory Human Oversight of Agentic AI: A Philosophical Accountcited by 0
- 2026Anticipatory Human Oversight of Agentic AI: A Philosophical Account21 Sep 2026
- 2026Breaking Up with Normatively Monolithic Agency with GRACE: A Reason-Based Neuro-Symbolic Architecture for Safe and Ethical AI Alignment15 Jan 2026
- 2025Justifications for Democratizing AI Alignment and Their Prospects24 Jul 2025