Intent Recognition and Unsupervised Slot Identification for Low Resourced Spoken Dialog Systems
Not on the map. Why?
Abstract (arXiv)
Intent Recognition and Slot Identification are crucial components in spoken language understanding (SLU) systems. In this paper, we present a novel approach towards both these tasks in the context of low resourced and unwritten languages. We present an acoustic based SLU system that converts speech to its phonetic transcription using a universal phone recognition system. We build a word-free natural language understanding module that does intent recognition and slot identification from these phonetic transcription. Our proposed SLU system performs competitively for resource rich scenarios and significantly outperforms existing approaches as the amount of available data reduces. We observe more than 10% improvement for intent classification in Tamil and more than 5% improvement for intent classification in Sinhala. We also present a novel approach towards unsupervised slot identification using normalized attention scores. This approach can be used for unsupervised slot labelling, data augmentation and to generate data for a new slot in a one-shot way with only one speech recording
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 16 of its 31 references that are in the map. First posted on arXiv 3 Apr 2021.
Builds on
16 of 31 references.
References · 16
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2014Deep Speech: Scaling up end-to-end speech recognitioncited by 354
- 2019Speech Model Pre-training for End-to-End Spoken Language Understandingcited by 193
- 2018Towards end-to-end spoken language understandingcited by 92
- 2020Universal Phone Recognition with a Multilingual Allophone Systemcited by 81
- 2015THCHS-30 : A Free Chinese Speech Corpuscited by 43
- 2020End-to-End Neural Transformer Based Spoken Language Understandingcited by 31
- 2018Spoken Language Understanding on the Edgecited by 27
4 more
- 2018Capsule Networks for Low Resource Spoken Language Understandingcited by 11
- 2020HarperValleyBank: A Domain-Specific Spoken Dialog Corpuscited by 10
- 2020Acoustics Based Intent Recognition Using Discovered Phonetic Units for Low Resource Languagescited by 8
- 2020Mere account mein kitna balance hai? -- On building voice enabled Banking Services for Multilingual Communitiescited by 5
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 2.
4 papers.
- 2022On Building Spoken Language Understanding Systems for Low Resourced Languagescited by 4
- 2023Decoding Emotions: A comprehensive Multilingual Study of Speech Models for Speech Emotion Recognitioncited by 4
- 2021Intent Classification Using Pre-trained Language Agnostic Embeddings For Low Resource Languagescited by 0
- 2023Creating Spoken Dialog Systems in Ultra-Low Resourced Settingscited by 0
- 2023Creating Spoken Dialog Systems in Ultra-Low Resourced Settings11 Dec 2023
- 2023Decoding Emotions: A comprehensive Multilingual Study of Speech Models for Speech Emotion Recognition17 Aug 2023
- 2022On Building Spoken Language Understanding Systems for Low Resourced Languages25 May 2022
- 2021Intent Classification Using Pre-trained Language Agnostic Embeddings For Low Resource Languages18 Oct 2021