mlsanityData to 7 Oct 2026

Architectural Wisdom: A Framework for Governing Optimization in AI Systems

arXiv 2606.16319 ↗First posted 15 Jun 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern AI systems exhibit structural failures that capability scaling alone does not reliably fix: they optimize under-specified objectives with no architectural mechanism to question whether the objective should be optimized at all. Engagement maximization can amplify harmful pathways; tool-using agents can commit irreversible actions; preference-trained language models can become sycophantic. We argue that this failure is a wisdom problem, not an intelligence problem. We use "wisdom" in a deliberately architectural sense, not as a claim about virtue, consciousness, or moral omniscience. Intelligence accepts a goal and optimizes within it; wisdom interrogates whether the goal should be optimized at all. The two are separable architectural properties. We propose architectural wisdom as a corrigible objective-governance layer above the optimization substrate. The layer makes three structural commitments explicit and nondegenerate before any action: temporal horizon, relational boundary, and irreversibility. It is realized by four components (Structural Utility Transform, Moral Admissibility Interface, Arbitration and Escalation Controller, Value Revision Channel) that compute a six-coordinate wisdom tuple over horizon, relational coverage, irreversibility, admissibility, value revision, and auditability. We motivate the architecture by eight cases drawn from contemporary AI failures, secular wisdom traditions, and hard ethical situations, and defend the distinction against the intelligence-completeness thesis using goal-questioning over goal-taking, Bostrom's orthogonality, structural separation in our exemplar cases, and persistent failure modes despite capability scaling. The framework is the conceptual contract for a larger architecture whose formal specifications and empirical validation are developed in subsequent work.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 37 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

14 of 37 references.

References · 14

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2017Deep reinforcement learning from human preferencescited by 3,846
  4. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  5. 2016Concrete Problems in AI Safetycited by 1,582
  6. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  7. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  8. 2016Cooperative Inverse Reinforcement Learningcited by 298
  9. 2018Categorizing Variants of Goodhart's Lawcited by 132
  10. 2019Auditing Radicalization Pathways on YouTubecited by 52
  11. 2026Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgmentcited by 5
  12. 2026Trivium: Temporal Regret as a First-Class Objective for Causal-Memory Controllerscited by 4
2 more
  1. 2025A Checks-and-Balances Framework for Context-Aware Ethical AI Alignmentcited by 3
  2. 2026Epistemic Regret Minimization: Label-Free Causal Critique Beyond Outcome Rewardcited by 2

Built on by

Not cited yet.