mlsanityData to 14 Oct 2026

PACE: A Playback-Aligned Context Engine for LLM-Based Full-Duplex Voice Dialogue

arXiv 2608.07631 ↗First posted 7 Aug 2026cs.SD cs.AI cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

LLM-based full-duplex voice services allow users to speak while the assistant is responding. Because servers can generate output and advance dialogue state faster than clients can play it, subsequent user speech may be interpreted based on content the user never heard. We call this failure Generative Context Mis-anchoring (GCM). To address GCM issues, we present PACE, a provider-independent middleware layer that anchors model-facing context to the client playback boundary, a system-observable proxy for what the user could have heard. After an interruption, PACE repairs this context to exclude assistant content that never reached playback, while preserving low-latency generation across heterogeneous voice runtimes. We implement PACE's audio-only projection path end to end in a browser-based realtime voice assistant using a black-box speech model, without modifying the model service. We also construct GCM-Bench, a new controlled benchmark dataset of 108 playback-relative referent-anchoring cases. On GCM-Bench, PACE raises Referent Anchoring Accuracy from 25.0% to 96.3% over a cancellation-only baseline. On 200 Full-Duplex-Bench v1 interruption samples, it preserves interruption response quality. These results show that grounding model-facing context in actual playback is a practical way to maintain consistency in full-duplex voice dialogue.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 30 references that are in the map. First posted on arXiv 7 Aug 2026.

Builds on

17 of 30 references.

References · 17

  1. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
  2. 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 141
  3. 2025Full-Duplex-Bench: A Benchmark to Evaluate Full-duplex Spoken Dialogue Models on Turn-taking Capabilitiescited by 100
  4. 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interactioncited by 78
  5. 2024Beyond Turn-Based Interfaces: Synchronous LLMs as Full-Duplex Dialogue Agentscited by 72
  6. 2024Language Model Can Listen While Speakingcited by 63
  7. 2025Full-Duplex-Bench-v2: A Multi-Turn Evaluation Framework for Duplex Dialogue Systems with an Automated Examinercited by 41
  8. 2024A Full-duplex Speech Dialogue Scheme Based On Large Language Modelscited by 40
  9. 2026Full-Duplex-Bench-v3: Benchmarking Tool Use for Full-Duplex Voice Agents Under Real-World Disfluencycited by 37
  10. 2026τ-Voice: Benchmarking Full-Duplex Voice Agents on Real-World Domainscited by 36
  11. 2025URO-Bench: Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Modelscited by 30
  12. 2025MTR-DuplexBench: Towards a Comprehensive Evaluation of Multi-Round Conversations for Full-Duplex Speech Language Modelscited by 22
5 more
  1. 2025FlexDuo: A Pluggable System for Enabling Full-Duplex Capabilities in Speech Dialogue Systemscited by 15
  2. 2025MTalk-Bench: Evaluating Speech-to-Speech Models in Multi-Turn Dialogues via Arena-style and Rubrics Protocolscited by 14
  3. 2025From Turn-Taking to Synchronous Dialogue: A Survey of Full-Duplex Spoken Language Modelscited by 10
  4. 2026DuplexCascade: Full-Duplex Speech-to-Speech Dialogue with VAD-Free Cascaded ASR-LLM-TTS Pipeline and Micro-Turn Optimizationcited by 7
  5. 2026Unit-Based Agent for Semi-Cascaded Full-Duplex Dialogue Systemscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Qwen-Audio-3.1-Realtime: Towards Reliable Agentic Voice Interaction
  2. 2026BayLing-Duplex: Native Full-Duplex Speech Dialogue with a Single Autoregressive LLM
  3. 2026A frontend-backend architecture for tool calls in full-duplex speech models
  4. 2026NemotronLabs VoiceChat: An Open Full-duplex Speech-to-Speech Model with Tool Calling Capabilities
  5. 2026VoiceChat-TTS: A Low-Latency Continuous Speech Synthesis Model for Interactive Agents
  6. 2025Chain-of-Thought Reasoning in Streaming Full-Duplex End-to-End Spoken Dialogue Systems
  7. 2026Beyond Fresh Starts: Stateful Inference for Streaming ASR in Conversational Voice Agents
  8. 2025SALMONN-omni: A Standalone Speech LLM without Codec Injection for Full-duplex Conversation