mlsanityData to 7 Oct 2026

LOGIC: Efficient and Robust Contextual Biasing for Speech LLMs via Logit-Space Integration

arXiv 2601.15397 ↗First posted 21 Jan 2026cs.AI cs.CL cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

Recognizing entity phrases remains a critical challenge for speech large language models. Existing prompting methods lack an explicit decoding-time biasing weight, limiting their controllability. Generative error correction methods can introduce hallucinated over-corrections. To address these limitations, we propose LOGIC (logit-space integration for contextual biasing), a robust framework operating directly in the logit space. By decoupling context injection from input processing, LOGIC enables explicit control over the biasing strength. Extensive experiments with an open-source speech large language model across 11 locales demonstrate that LOGIC achieves an average 9% relative reduction in entity word error rate, with an average false alarm rate increase of 0.3% and a 2.8% relative runtime overhead. When combined with prompting, LOGIC can reduce entity word error rate by 5% relative to the prompt-only method.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 26 references that are in the map. First posted on arXiv 21 Jan 2026.

Builds on

15 of 26 references.

References · 15

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2024GPT-4o System Cardcited by 4,467
  3. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  4. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
  5. 2023Prompting Large Language Models with Speech Recognition Abilitiescited by 139
  6. 2018Deep context: end-to-end contextual speech recognitioncited by 136
  7. 2021Contextualized Streaming End-to-End Speech Recognition with Trie-Based Deep Biasing and Shallow Fusioncited by 100
  8. 2023Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Promptingcited by 71
  9. 2023Can Generative Large Language Models Perform ASR Error Correction?cited by 56
  10. 2020Multitask Training with Text Data for End-to-End Speech Recognitioncited by 19
  11. 2024Chain-of-Thought Prompting for Speech Translationcited by 17
  12. 2023Contextual Biasing with the Knuth-Morris-Pratt Matching Algorithmcited by 9
3 more
  1. 2024Failing Forward: Improving Generative Error Correction for ASR with Synthetic Data and Retrieval Augmentationcited by 9
  2. 2022Who Are We Talking About? Handling Person Names in Speech Translationcited by 8
  3. 2025PHRASED: Phrase Dictionary Biasing for Speech Translationcited by 1

Built on by

Not cited yet.