mlsanityData to 14 Oct 2026

Everything Counts: The Managed Omnirelevance of Speech in Human-Voice Agent Interaction

arXiv 2510.22610 ↗First posted 26 Oct 2025cs.HCcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

To this day, turn-taking models determining voice agents' conduct have been examined primarily from a technical point of view, while the ways in which they emerge as interactional constraints or resources for human conversationalists in situ remain underexplored. Drawing on a detailed analysis of corpora of naturalistic data, we document how humans' conduct was produced in reference to the ever-present risk that, each time they spoke, their talk might trigger a new uncalled-for contribution from the artificial agent. We examine this phenomenon in interactions involving rule-based robots from a 'pre-LLM era' as well as the most recent voice agents. This 'omnirelevance of human speech' (i.e., the possibility that a conversational agent may erroneously respond to any speech it detects) emerged as a constitutive feature of these human-agent encounters. We describe some of the practices through which humans managed these artificial agents' turn-taking conduct. Given recent improvements in voice capture technology, we ask whether this 'omnirelevance of human speech' weighs even more heavily on human practices today than in the past.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 12 of its 176 references that are in the map. First posted on arXiv 26 Oct 2025.

Builds on

12 of 176 references.

References · 12

  1. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
  2. 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
  3. 2024Multilingual Turn-taking Prediction Using Voice Activity Projectioncited by 26
  4. 2022How Much Does Prosody Help Turn-taking? Investigations using Voice Activity Projection Modelscited by 23
  5. 2024Real-time and Continuous Turn-taking Prediction Using Voice Activity Projectioncited by 21
  6. 2024From "AI" to Probabilistic Automation: How Does Anthropomorphization of Technical Systems Descriptions Influence Trust?cited by 18
  7. 2020The Pace of Artificial Intelligence Innovations: Speed, Talent, and Trial-and-Errorcited by 13
  8. 2020Towards Data-efficient Modeling for Wake Word Spottingcited by 13
  9. 2025Applying General Turn-taking Models to Conversational Human-Robot Interactioncited by 13
  10. 2024Large Language Models Know What To Say But Not When To Speakcited by 11
  11. 2018How UX Practitioners Produce Findings in Usability Testingcited by 1
  12. 2025"Playing the robot's advocate": Bystanders' descriptions of a robot's conduct in public settingscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Evaluating Real-Time Voice Agents: From Component Quality to Grounded Outcomes
  2. 2025Overhearing LLM Agents: A Survey, Taxonomy, and Roadmap
  3. 2024Language Models in Dialogue: Conversational Maxims for Human-AI Interactions
  4. 2025Speech Command + Speech Emotion: Exploring Emotional Speech Commands as a Compound and Playful Modality
  5. 2026DuplexWorld: Can voice agents help you get through the day?
  6. 2026Benchmarking LLM Judges for Voice-Agent Evaluation: Reliability, Calibration, and Human Oversight
  7. 2026Conversational Agents and the Understanding of Human Language: Reflections on AI, LLMs, and Cognitive Science
  8. 2026Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perception