mlsanityData to 7 Oct 2026

Calibrate and Refine! A Novel and Agile Framework for ASR-error Robust Intent Detection

arXiv 2205.11008 ↗First posted 23 May 2022cs.CL cs.SD eess.AScited by 1

Not on the map. Why?

Abstract (arXiv)

The past ten years have witnessed the rapid development of text-based intent detection, whose benchmark performances have already been taken to a remarkable level by deep learning techniques. However, automatic speech recognition (ASR) errors are inevitable in real-world applications due to the environment noise, unique speech patterns and etc, leading to sharp performance drop in state-of-the-art text-based intent detection models. Essentially, this phenomenon is caused by the semantic drift brought by ASR errors and most existing works tend to focus on designing new model structures to reduce its impact, which is at the expense of versatility and flexibility. Different from previous one-piece model, in this paper, we propose a novel and agile framework called CR-ID for ASR error robust intent detection with two plug-and-play modules, namely semantic drift calibration module (SDCM) and phonemic refinement module (PRM), which are both model-agnostic and thus could be easily integrated to any existing intent detection models without modifying their structures. Experimental results on SNIPS dataset show that, our proposed CR-ID framework achieves competitive performance and outperform all the baseline methods on ASR outputs, which verifies that CR-ID can effectively alleviate the semantic drift caused by ASR errors.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 41 references that are in the map. First posted on arXiv 23 May 2022.

Builds on

22 of 41 references.

References · 22

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  3. 2018Deep contextualized word representationscited by 2,285
  4. 2016FastText.zip: Compressing text classification modelscited by 331
  5. 2019BERT for Joint Intent Classification and Slot Fillingcited by 195
  6. 2019Speech Model Pre-training for End-to-End Spoken Language Understandingcited by 191
  7. 2016Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Fillingcited by 137
  8. 2018From Audio to Semantics: Approaches to end-to-end spoken language understandingcited by 63
  9. 2018A Bi-model based RNN Semantic Frame Parsing Model for Intent Detection and Slot Fillingcited by 53
  10. 2021A Survey on Spoken Language Understanding: Recent Advances and New Frontierscited by 53
  11. 2021Self-supervised Contrastive Cross-Modality Representation Learning for Spoken Question Answeringcited by 39
  12. 2022End-to-end Spoken Conversational Question Answering: Task, Dataset and Modelcited by 37
10 more
  1. 2020Knowledge Distillation for Improved Accuracy in Spoken Question Answeringcited by 31
  2. 2021Self-supervised Dialogue Learning for Spoken Conversational Question Answeringcited by 27
  3. 2020Contextualized Attention-based Knowledge Transfer for Spoken Conversational Question Answeringcited by 26
  4. 2019Learning ASR-Robust Contextualized Embeddings for Spoken Language Understandingcited by 20
  5. 2020ST-BERT: Cross-modal Language Model Pre-training For End-to-end Spoken Language Understandingcited by 19
  6. 2021Joint Multiple Intent Detection and Slot Filling via Self-distillationcited by 12
  7. 2020PIN: A Novel Parallel Interactive Network for Spoken Language Understandingcited by 11
  8. 2021Pre-training for Spoken Language Understanding with Joint Textual and Phonetic Representation Learningcited by 6
  9. 2019A Self-Attention Joint Model for Spoken Language Understanding in Situational Dialog Applicationscited by 4
  10. 2020Self-Attention Networks for Intent Detectioncited by 2

Built on by

Cited by year

Citing papers per year: 2022: 1.

1 paper.