mlsanityData to 19 Oct 2026

Think Before You Transcribe: Context-Steered Reasoning for Hotword-Aware Speech Recognition

arXiv 2610.26986 ↗First posted 19 Oct 2026cs.CLcited by 0

On the map: Speech and audio language models → Speech recognition models and training

Abstract (arXiv)

Contextual automatic speech recognition (ASR) improves rare-entity recognition by supplying candidate hotwords, but retrieved candidates may be incomplete or incorrect. A reliable system must therefore exploit a relevant candidate without allowing unsupported alternatives to override the acoustic evidence. We propose a context-steered reasoning framework that generates a short, audio-grounded caption before transcription. This task-specific representation lets the model assess candidate relevance before making a lexical decision. Supervised fine-tuning establishes the structured caption-to-transcription behavior, while targeted trajectory injection strengthens group relative policy optimization when difficult utterances yield only unsuccessful rollouts. Experiments across diverse context conditions show that the proposed method consistently improves both transcription quality and hotword recognition while remaining robust to irrelevant candidates.

Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speech recognition models and training, one of 11 directions in Speech and audio language models. Builds on 18 of its 29 references that are in the map. First posted on arXiv 19 Oct 2026.

Builds on

18 of 29 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026Speech LLMs are Contextual Reasoning Transcribers1 Apr
  2. 2025ContextASR-Bench: A Massive Contextual Speech Recognition Benchmark8 Jul
  3. 2025OWSM-Biasing: Contextualizing Open Whisper-Style Speech Models for Automatic Speech Recognition with Dynamic Vocabulary11 Jun
  4. 2025DeRAGEC: Denoising Named Entity Candidates with Synthetic Rationale for ASR Error Correction9 Jun
  5. 2024Contextualization of ASR with LLM using phonetic retrieval-based augmentation11 Sep
  6. 2023CopyNE: Better Contextual ASR by Copying Named Entities22 May

Other references · 12

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,722
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,424
  3. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,112
  4. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 462
  5. 2025Baichuan-Omni-1.5 Technical Reportcited by 132
  6. 2025Step-Audio: Unified Understanding and Generation in Intelligent Speech Interactioncited by 107
  7. 2025Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Modelcited by 80
  8. 2025MiDashengLM: Efficient Audio Understanding with General Audio Captionscited by 42
  9. 2023SlideSpeech: A Large-Scale Slide-Enriched Audio-Visual Corpuscited by 26
  10. 2025Mind with Eyes: from Language Reasoning to Multimodal Reasoningcited by 24
  11. 2025Group Relative Policy Optimization for Speech Recognitioncited by 12
  12. 2026Valley3: Scaling Omni Foundation Models for E-commercecited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards Deep Contextual Reasoning from Broad Descriptions for ASR with Speech-LLM via Metadata-Driven Reasoning Chains
  2. 2026LaSR: Context-Aware Speech Recognition via Latent Reasoning
  3. 2026Training-Free Contextual ASR via SpeechLLM-Based Error-Aware Selective Retrieval
  4. 2025Contextual Biasing for LLM-Based ASR with Hotword Retrieval and Reinforcement Learning
  5. 2025Whispering Context: Distilling Syntax and Semantics for Long Speech Transcripts
  6. 2025Mind the Gap: Entity-Preserved Context-Aware ASR Structured Transcriptions
  7. 2025Speech-Aware Long Context Pruning and Integration for Contextualized Automatic Speech Recognition
  8. 2026BaLEEN: Biasing with Latent Encoded Entities for Context-Aware ASR