mlsanityData to 14 Oct 2026

A Navigable Manifold of Hypothesized Consciousness-Spectrum States in Language Model Representations

arXiv 2606.09894 ↗First posted 4 Jun 2026cs.LG cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Across contemplative, philosophical, and psychological accounts, human consciousness is often described along a similar spectrum, ranging from reactive and self-focused patterns to more integrative and coherent ones. Understanding whether language models encode such a structured, human-interpretable consciousness spectrum in representation space is important for model guidance, evaluation and alignment. In this work, we study the geometric structure and dynamics of patterns along this spectrum in transformer embedding spaces. We show that embeddings exhibit a globally organized geometry aligned with this spectrum: sentences associated with similar states cluster into locally coherent regions, forming a structured manifold. In particular, higher-level and lower-level regions exhibit convexity-like stability, while intermediate regions form a transition corridor. Dynamically, both utility-guided and geometry-only greedy trajectories consistently traverse from lower- to higher-level regions, passing through intermediate tiers, indicating that navigability is an intrinsic property of the representation space, guided but not dictated by a global directional signal. These results suggest that embedding spaces encode structured and navigable geometry aligned with a hypothesized consciousness-spectrum taxonomy, broadly inspired by recurring structural descriptions of human consciousness across contemplative traditions, philosophy, and modern psychology, providing a representation-level perspective for analyzing and guiding model behavior.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 29 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

12 of 29 references.

References · 12

  1. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  2. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  3. 2024The Geometry of Categorical and Hierarchical Concepts in Large Language Modelscited by 159
  4. 2023Manifold learning: what, how, and whycited by 68
  5. 2026Emotion Concepts and their Function in a Large Language Modelcited by 57
  6. 2025The Origins of Representation Manifolds in Large Language Modelscited by 51
  7. 2025Mechanistic Interpretability of Emotion Inference in Large Language Modelscited by 27
  8. 2025Emotions Where Art Thou: Understanding and Characterizing the Emotional Latent Space of Large Language Modelscited by 18
  9. 2025Decoding Emotion in the Deep: A Systematic Study of How LLMs Represent, Retain, and Express Emotioncited by 12
  10. 2025Emergence of Hierarchical Emotion Organization in Large Language Modelscited by 9
  11. 2023On convex decision regions in deep network representationscited by 7
  12. 2025AI shares emotion with humans across languages and culturescited by 6

Built on by

Not cited yet.