mlsanityData to 14 Oct 2026

RASSG: Repair-Aware Semantic Survival Gating for Streaming Tool Execution

arXiv 2610.14659 ↗First posted 10 Oct 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Streaming speech assistants can launch tools before users finish speaking, overlapping execution with incoming speech to reduce user waiting time. However, subsequent self-corrections can invalidate apparently stable arguments, causing stale execution whose irreversible effects persist even after the final call is corrected. We propose Repair-Aware Semantic Survival Gating (RASSG) to jointly control tool launch and cancellation during streaming speech. RASSG launches a tool when three consecutive speech recognition results arrive with identical nonempty arguments, then combines calibrated argument invalidity risk with execution costs to decide cancellation at the last feasible opportunity before effects become irreversible. Evaluation on ReCAST, FDB-v3, and Audio2Tool uses a controlled execution clock with fixed tool runtimes and cancellation parameters. On ReCAST's prospective-repair subset, RASSG reduces the stale execution rate from LocalAgreement-2's 50.00% to 3.15%, with a mean delay of 3.676s across successful trajectories. The stale reduction also holds against every early-execution baseline on both public speech datasets. Ablations with identical initial launches support active cancellation, showing the value of controlling ongoing calls before their effects become irreversible. Code and data are available at https://github.com/daijinhu/RASSG.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 10 Oct 2026.

Builds on

19 of 26 references.

References · 19

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  4. 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 295
  5. 2020Low-Latency Sequence-to-Sequence Speech Recognition and Translation by Partial Hypothesis Selectioncited by 49
  6. 2026Full-Duplex-Bench-v3: Benchmarking Tool Use for Full-Duplex Voice Agents Under Real-World Disfluencycited by 37
  7. 2026τ-Voice: Benchmarking Full-Duplex Voice Agents on Real-World Domainscited by 36
  8. 2023Turning Whisper into Real-Time Transcription Systemcited by 24
  9. 2025SHANKS: Simultaneous Hearing and Thinking for Spoken Language Modelscited by 19
  10. 2025CONFETTI: Conversational Function-Calling Evaluation Through Turn-Level Interactionscited by 18
  11. 2024Conveyor: Efficient Tool-aware LLM Serving with Tool Partial Executioncited by 17
  12. 2025Stream RAG: Instant and Accurate Spoken Dialogue Systems with Streaming Tool Usagecited by 15
7 more
  1. 2025AskToAct: Enhancing LLMs Tool Use via Self-Correcting Clarificationcited by 13
  2. 2024Efficient Streaming LLM for Speech Recognitioncited by 12
  3. 2026Audio2Tool: Speak, Call, Act -- A Dataset for Benchmarking Speech Tool Usecited by 9
  4. 2026DuplexSLA: A Full-Duplex Spoken Language Model with Synchronized Speech, Language, and Actioncited by 9
  5. 2025PredGen: Accelerated Inference of Large Language Models through Input-Time Speculation for Real-Time Speech Interactioncited by 8
  6. 2025DialogueAgents: A Hybrid Agent-Based Speech Synthesis Framework for Multi-Party Dialoguecited by 6
  7. 2026LTS-VoiceAgent: A Listen-Think-Speak Framework for Efficient Streaming Voice Interaction via Semantic Triggering and Incremental Reasoningcited by 6

Built on by

Not cited yet.