mlsanityData to 14 Oct 2026

A Framework for Inherently Safer AGI through Language-Mediated Active Inference

arXiv 2508.05766 ↗First posted 7 Aug 2025cs.AI cs.LG cs.SYcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper proposes a novel framework for developing safe Artificial General Intelligence (AGI) by combining Active Inference principles with Large Language Models (LLMs). We argue that traditional approaches to AI safety, focused on post-hoc interpretability and reward engineering, have fundamental limitations. We present an architecture where safety guarantees are integrated into the system's core design through transparent belief representations and hierarchical value alignment. Our framework leverages natural language as a medium for representing and manipulating beliefs, enabling direct human oversight while maintaining computational tractability. The architecture implements a multi-agent system where agents self-organize according to Active Inference principles, with preferences and safety constraints flowing through hierarchical Markov blankets. We outline specific mechanisms for ensuring safety, including: (1) explicit separation of beliefs and preferences in natural language, (2) bounded rationality through resource-aware free energy minimization, and (3) compositional safety through modular agent structures. The paper concludes with a research agenda centered on the Abstraction and Reasoning Corpus (ARC) benchmark, proposing experiments to validate our framework's safety properties. Our approach offers a path toward AGI development that is inherently safer, rather than retrofitted with safety measures.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 43 references that are in the map. First posted on arXiv 7 Aug 2025.

Builds on

9 of 43 references.

References · 9

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2016Concrete Problems in AI Safetycited by 1,642
  4. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  5. 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 258
  6. 2021Alignment of Language Agentscited by 168
  7. 2017AI Safety Gridworldscited by 110
  8. 2017The free energy principle for action and perception: A mathematical reviewcited by 66
  9. 2020Reinforcement Learning through Active Inferencecited by 47

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.