Dynamic Epistemic Friction in Dialogue
On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment
Abstract (arXiv)
Recent developments in aligning Large Language Models (LLMs) with human preferences have significantly enhanced their utility in human-AI collaborative scenarios. However, such approaches often neglect the critical role of "epistemic friction," or the inherent resistance encountered when updating beliefs in response to new, conflicting, or ambiguous information. In this paper, we define dynamic epistemic friction as the resistance to epistemic integration, characterized by the misalignment between an agent's current belief state and new propositions supported by external evidence. We position this within the framework of Dynamic Epistemic Logic (Van Benthem and Pacuit, 2011), where friction emerges as nontrivial belief-revision during the interaction. We then present analyses from a situated collaborative task that demonstrate how this model of epistemic friction can effectively predict belief updates in dialogues, and we subsequently discuss how the model of belief alignment as a measure of epistemic resistance or friction can naturally be made more sophisticated to accommodate the complexities of real-world dialogue scenarios.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 15 of its 49 references that are in the map. First posted on arXiv 12 Jun 2025.
Builds on
15 of 49 references.
Closest ancestors · 1
Same direction, newest first
Other references · 14
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
- 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformationscited by 99
- 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part II: Applications, Cognitive Models, and Challengescited by 69
- 2019Distributional Semantics and Linguistic Theorycited by 53
- 2015Linguistic Harbingers of Betrayal: A Case Study on an Online Strategy Gamecited by 16
- 2018Epistemic Graphs for Representing and Reasoning with Positive and Negative Influences of Argumentscited by 14
- 2024Common Ground Tracking in Multimodal Dialoguecited by 13
- 2024Exploring a Behavioral Model of "Positive Friction" in Human-AI Interactioncited by 9
- 2024More Victories, Less Cooperation: Assessing Cicero's Diplomacy Playcited by 9
- 2025TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialoguescited by 9
- 2022Emergence of hierarchical reference systems in multi-agent communicationcited by 8
- 2025Better Slow than Sorry: Introducing Positive Friction for Reliable Dialogue Systemscited by 7
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025Schema for In-Context Learningcited by 4
- 2026Grounded Continuation: A Linear-Time Runtime Verifier for LLM Conversationscited by 3
- 2025Learning "Partner-Aware" Collaborators in Multi-Party Collaborationcited by 2
- 2026Frictive Policy Optimization for LLMs: Epistemic Intervention, Risk-Sensitive Control, and Reflective Alignmentcited by 2
- 2026Grounded Continuation: A Linear-Time Runtime Verifier for LLM Conversations13 May 2026
- 2026Frictive Policy Optimization for LLMs: Epistemic Intervention, Risk-Sensitive Control, and Reflective Alignment28 Apr 2026
- 2025Learning "Partner-Aware" Collaborators in Multi-Party Collaboration26 Oct 2025
- 2025Schema for In-Context Learning14 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Mind the Gap: Theory-of-Mind-Grounded Friction for Epistemic Alignment
- 2026Dynamic Theory of Mind as a Temporal Memory Problem: Evidence from Large Language Models
- 2026Beyond Words: Evaluating and Bridging Epistemic Divergence in User-Agent Interaction via Theory of Mind
- 2025WHEN TO ACT, WHEN TO WAIT: Modeling the Intent-Action Alignment Problem in Dialogue
- 2025Beyond "Hallucinations": A Framework for Stable Human-AI Reasoning
- 2026Dialogical Reasoning Across AI Architectures: A Multi-Model Framework for Testing AI Alignment Strategies
- 2025Epistemological Fault Lines Between Human and Artificial Intelligence
- 2026Beyond Sally-Anne: Evaluating Theory of Mind in LLMs using Epistemic Schelling Points