mlsanityData to 7 Oct 2026

Text-only adaptation in LLM-based ASR through text denoising

arXiv 2601.20900 ↗First posted 28 Jan 2026cs.SD cs.CL cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

Adapting large language model (LLM)-based automatic speech recognition (ASR) systems to new domains using text-only data is a significant yet underexplored challenge. Standard fine-tuning of the LLM on the target domain text often disrupts the critical alignment between the speech and text modality learned by the projector, degrading performance. We introduce a novel text-only adaptation method that frames this process as a text denoising task. Our approach trains the LLM to recover clean transcripts from noisy inputs. This process effectively adapts the model to a target domain while preserving cross-modal alignment. Our solution is lightweight, requiring no architectural changes or additional parameters. Extensive evaluation on two datasets demonstrates up to 22.1% relative improvement, outperforming recent state-of-the-art text-only adaptation methods.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 23 of its 27 references that are in the map. First posted on arXiv 28 Jan 2026.

Builds on

23 of 27 references.

References · 23

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  3. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  4. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  5. 2024Qwen2-Audio Technical Reportcited by 543
  6. 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
  7. 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Modelscited by 210
  8. 2024An Embarrassingly Simple Approach for LLM with Strong ASR Capacitycited by 86
  9. 2023Connecting Speech Encoder and Large Language Model for ASRcited by 79
  10. 2023Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Promptingcited by 71
  11. 2023SLM: Bridge the thin gap between speech and text foundation modelscited by 67
  12. 2024SpeechVerse: A Large-scale Generalizable Audio Language Modelcited by 62
11 more
  1. 2023Can Generative Large Language Models Perform ASR Error Correction?cited by 56
  2. 2024Automatic Speech Recognition using Advanced Deep Learning Approaches: A surveycited by 50
  3. 2023Prompting Large Language Models for Zero-Shot Domain Adaptation in Speech Recognitioncited by 48
  4. 2023SlideSpeech: A Large-Scale Slide-Enriched Audio-Visual Corpuscited by 18
  5. 2024Performance evaluation of SLAM-ASR: The Good, the Bad, the Ugly, and the Way Forwardcited by 17
  6. 2024Unveiling the Potential of LLM-Based ASR on Chinese Open-Source Datasetscited by 13
  7. 2024Multilingual and Fully Non-Autoregressive ASR with Large Language Model Fusion: A Comprehensive Studycited by 12
  8. 2025Low-Resource Domain Adaptation for Speech LLMs via Text-Only Fine-Tuningcited by 7
  9. 2024Effective Text Adaptation for LLM-based ASR through Soft Prompt Fine-Tuningcited by 4
  10. 2025Bridging the Modality Gap: Softly Discretizing Audio Representation for LLM-based Automatic Speech Recognitioncited by 4
  11. 2025Approaching Dialogue State Tracking via Aligning Speech Encoders and LLMscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

  1. 2026Distilling Conversations: Abstract Compression of Conversational Audio Context for LLM-based ASRcited by 2
  2. 2026On the Role of Encoder Depth: Pruning Whisper and LoRA Fine-Tuning in SLAM-ASRcited by 2
  3. 2026How to Leverage Synthetic Speech for LLM-Based ASR Systems?cited by 1
  4. 2026Closing the Speech-Text Gap with Limited Audio for Effective Domain Adaptation in LLM-Based ASRcited by 0
  5. 2026TASU2: Controllable CTC Simulation for Alignment and Low-Resource Adaptation of Speech LLMscited by 0
  6. 2026CORTIS: Text-Only Adaptation of Spoken Language Models for Task-Oriented Voice Agentscited by 0
  7. 2026When Synthetic Speech Is All You Have: Better Call GRPOcited by 0
  8. 2026Voice Memory for Agentic Speech Recognitioncited by 0