mlsanityData to 7 Oct 2026

Planning Ahead with RSA: Efficient Signalling in Dynamic Environments by Projecting User Awareness across Future Timesteps

arXiv 2510.23340 ↗First posted 27 Oct 2025cs.AI cs.CL cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Adaptive agent design offers a way to improve human-AI collaboration on time-sensitive tasks in rapidly changing environments. In such cases, to ensure the human maintains an accurate understanding of critical task elements, an assistive agent must not only identify the highest priority information but also estimate how and when this information can be communicated most effectively, given that human attention represents a zero-sum cognitive resource where focus on one message diminishes awareness of other or upcoming information. We introduce a theoretical framework for adaptive signalling which meets these challenges by using principles of rational communication, formalised as Bayesian reference resolution using the Rational Speech Act (RSA) modelling framework, to plan a sequence of messages which optimise timely alignment between user belief and a dynamic environment. The agent adapts message specificity and timing to the particulars of a user and scenario based on projections of how prior-guided interpretation of messages will influence attention to the interface and subsequent belief update, across several timesteps out to a fixed horizon. In a comparison to baseline methods, we show that this effectiveness depends crucially on combining multi-step planning with a realistic model of user awareness. As the first application of RSA for communication in a dynamic environment, and for human-AI interaction in general, we establish theoretical foundations for pragmatic communication in human-agent teams, highlighting how insights from cognitive science can be capitalised to inform the design of assistive agents.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 45 references that are in the map. First posted on arXiv 27 Oct 2025.

Builds on

14 of 45 references.

References · 14

  1. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  2. 2016Reasoning About Pragmatics with Neural Listeners and Speakerscited by 68
  3. 2017Colors in Context: A Pragmatic Neural Model for Grounded Language Understandingcited by 57
  4. 2017Unified Pragmatic Models for Generating and Following Instructionscited by 55
  5. 2018Pragmatically Informative Image Captioning with Character-Level Inferencecited by 42
  6. 2024Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planningcited by 28
  7. 2024Language Models in Dialogue: Conversational Maxims for Human-AI Interactionscited by 21
  8. 2024Grounding Language in Multi-Perspective Referential Communicationcited by 12
  9. 2018An Incremental Iterated Response Model of Pragmaticscited by 11
  10. 2025Vision-Language Models Are Not Pragmatically Competent in Referring Expression Generationcited by 8
  11. 2018The division of labor in communication: Speakers help listeners account for asymmetries in visual perspectivecited by 6
  12. 2021A practical introduction to the Rational Speech Act modeling frameworkcited by 6
2 more
  1. 2024Shifting Focus with HCEye: Exploring the Dynamics of Visual Highlighting and Cognitive Load on User Attention and Saliency Predictioncited by 6
  2. 2025Gricean Norms as a Basis for Effective Collaborationcited by 3

Built on by

Not cited yet.