A Checks-and-Balances Framework for Context-Aware Ethical AI Alignment
On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment
Abstract (arXiv)
This paper introduces a checks-and-balances framework for ethical alignment of Large Language Models (LLMs), inspired by three-branch governmental systems. It implements three independent yet interacting components: LLMs as the executive branch for knowledge generation, DIKE as the legislative branch establishing ethical guardrails, and ERIS as the judicial branch for contextual interpretation. Beyond structural separation, we address a fundamental challenge: regulating emotion to shape behaviors. Drawing from psychological theories where managing emotional responses prevents harmful behaviors, we develop a self-supervised learning pipeline that maps emotions to linguistic behaviors, enabling precise behavioral modulation through emotional conditioning. By integrating this approach with adversarial testing, our framework demonstrates how DIKE and ERIS direct linguistic behaviors toward ethical outcomes while preserving independence throughout knowledge generation, ethical oversight, and contextual interpretation.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 21 of its 100 references that are in the map. First posted on arXiv 31 Jan 2025.
Builds on
21 of 100 references.
Closest ancestors · 3
Same direction, newest first
- 2023The Capacity for Moral Self-Correction in Large Language Models15 Feb
- 2022Constitutional AI: Harmlessness from AI Feedback15 Dec
- 2020Learning to summarize from human feedback2 Sep
Other references · 18
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 915
- 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 906
- 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 615
- 2015Policy Distillationcited by 414
- 2023Augmented Language Models: a Surveycited by 398
- 2023SLiC-HF: Sequence Likelihood Calibration with Human Feedbackcited by 395
- 2023Role-Play with Large Language Modelscited by 290
- 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 194
6 more
- 2022Defining and Characterizing Reward Hackingcited by 184
- 2023Mitigating the Alignment Tax of RLHFcited by 181
- 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 174
- 2024Generalized Preference Optimization: A Unified Approach to Offline Alignmentcited by 155
- 2020ETHOS: an Online Hate Speech Detection Datasetcited by 66
- 2024GPT-4 Emulates Average-Human Emotional Cognition from a Third-Person Perspectivecited by 16
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Diverse Human Value Alignment for Large Language Models via Ethical Reasoning
- 2024ValueCompass: A Framework for Measuring Contextual Value Alignment Between Human and LLMs
- 2025Normative Conflicts and Shallow AI Alignment
- 2025Beyond Ethical Alignment: Evaluating LLMs as Artificial Moral Assistants
- 2020Aligning AI With Shared Human Values
- 2026The Straight and Narrow: Do LLMs Possess an Internal Moral Path?
- 2025Auditing the Ethical Logic of Generative AI Models
- 2026Emergent Alignment