Beyond Local Surprise: Grounded Dialogue as Selective Belief Revision under Referential Uncertainty
Not on the map. Why?
Abstract (arXiv)
When a speaker refers to a scene that the listener cannot directly see, the listener must decide whether to preserve its current understanding or revise it as new utterances arrive. Many language systems treat local mismatch as a cue for updating: divergence from the current understanding encourages adjustment. Yet conversational understanding may be more conservative, interpreting mismatching evidence relative to prior understanding rather than immediately revising it. We introduce a controlled, data-driven framework for turn-by-turn preserve/revise decisions in dialogue, where competing revision policies are learned under otherwise identical conditions. We compare four theory-driven revision strategies, each reflecting a different assumption about when listeners should preserve or revise. Two findings stand out. First, a mismatch-driven policy that updates solely based on local divergence reacts strongly to mismatch but destabilizes grounding and degrades retrieval. Second, an uncertainty-sensitive policy extends mismatch-based updating with accumulated evidence, preserving coherent understanding while maintaining strong retrieval performance. Surprisingly, coherent understanding emerges from a counterintuitive pattern: local mismatch promotes preservation, whereas accumulated uncertainty promotes revision, suggesting that listeners maintain prior understanding despite local mismatch and revise only when uncertainty sufficiently accumulates. This pattern is consistent with conceptual pact theory.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 23 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
9 of 23 references.
References · 9
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016Visual Dialogcited by 377
- 2023Grounding Gaps in Language Model Generationscited by 47
- 2021PhotoChat: A Human-Human Dialogue Dataset with Photo Sharing Behavior for Joint Image-Text Modelingcited by 43
- 2024Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questionscited by 32
- 2022Learning to Execute Actions or Ask Clarification Questionscited by 30
- 2024Towards a Similarity-adjusted Surprisal Theorycited by 9
- 2024Stark: Social Long-Term Multi-Modal Conversation with Persona Commonsense Knowledgecited by 8
- 2023Resolving References in Visually-Grounded Dialogue via Text Generationcited by 5
Built on by
Not cited yet.