Cognition-of-Thought Elicits Social-Aligned Reasoning in Large Language Models
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Large language models (LLMs) excel at complex reasoning but can still exhibit harmful behaviors. Current alignment strategies typically embed safety into model weights, making these controls implicit, static, and difficult to modify. This paper introduces Cognition-of-Thought (CooT), a novel decoding-time framework that equips LLMs with an explicit cognitive self-monitoring loop. CooT couples a standard text Generator with a cognitive Perceiver that continuously monitors the unfolding sequence. The Perceiver uses a structured, precedence-based hierarchy of principles (e.g., safety over obedience) to detect potential misalignments as they arise. When violations are flagged, CooT intervenes by rolling back the generation to the point of error and regenerating under injected guidance that combines universal social priors with context-specific warnings. CooT thus transforms alignment from a fixed property into an explicit, dynamic, and auditable process active during inference, allowing for flexible policy updates without retraining the model. Extensive experiments across multiple benchmarks and model families confirm that CooT consistently improves safety and social reasoning performance.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 9 of its 56 references that are in the map. First posted on arXiv 27 Sep 2025.
Builds on
9 of 56 references.
References · 9
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervisioncited by 441
- 2024TrustLLM: Trustworthiness in Large Language Modelscited by 285
- 2024KTO: Model Alignment as Prospect Theoretic Optimizationcited by 264
- 2024LLM Critics Help Catch LLM Bugscited by 147
- 2025Human Decision-making is Susceptible to AI-driven Manipulationcited by 19
- 2025Less is More: Improving LLM Alignment via Preference Data Selectioncited by 4
- 2024Towards Exception Safety Code Generation with Intermediate Representation Agents Frameworkcited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2023Understanding Social Reasoning in Language Models with Language Models
- 2025Think Socially via Cognitive Reasoning
- 2026Ulterior Motives: Detecting Misaligned Reasoning in Continuous Thought Models
- 2025Chain-of-Thought as a Lens: Evaluating Structured Reasoning Alignment between Human Preferences and Large Language Models
- 2026CoSToM:Causal-oriented Steering for Intrinsic Theory-of-Mind Alignment in Large Language Models
- 2025Understanding and Steering the Cognitive Behaviors of Reasoning Models at Test-Time
- 2026Reasoning aligns language models to human cognition
- 2026Probing the Misaligned Thinking Process of Language Models