Multi-lingual Intent Detection and Slot Filling in a Joint BERT-based Model
Not on the map. Why?
Abstract (arXiv)
Intent Detection and Slot Filling are two pillar tasks in Spoken Natural Language Understanding. Common approaches adopt joint Deep Learning architectures in attention-based recurrent frameworks. In this work, we aim at exploiting the success of "recurrence-less" models for these tasks. We introduce Bert-Joint, i.e., a multi-lingual joint text classification and sequence labeling framework. The experimental evaluation over two well-known English benchmarks demonstrates the strong performances that can be obtained with this model, even when few annotated data is available. Moreover, we annotated a new dataset for the Italian language, and we observed similar performances without the need for changing the model.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 7; 2023: 0; 2024: 2; 2025: 4; 2026: 1.
24 papers.
Sort:
By area:
- 2021A Survey on Spoken Language Understanding: Recent Advances and New Frontierscited by 53
- 2021From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understandingcited by 43
- 2022A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methodscited by 42
- 2022Cross-Lingual Dialogue Dataset Creation via Outline-Based Generationcited by 23
- 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systemscited by 16
- 2021CONDA: a CONtextual Dual-Annotated dataset for in-game toxicity understanding and detectioncited by 14
- 2021X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answeringcited by 10
- 2022Towards Relation Extraction From Speechcited by 10
- 2022Cross-lingual Lifelong Learningcited by 9
- 2024Advancing Single and Multi-task Text Classification through Large Language Model Fine-tuningcited by 7
- 2025On-Device LLMs for Home Assistant: Dual Role in Intent Detection and Response Generationcited by 7
- 2022Confidence Calibration for Intent Detection via Hyperspherical Space and Rebalanced Accuracy-Uncertainty Losscited by 2
12 more
- 2022Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformerscited by 2
- 2024New Semantic Task for the French Spoken Language Understanding MEDIA Benchmarkcited by 2
- 2021Transfer Learning for Multi-lingual Tasks -- a Surveycited by 1
- 2021A Review of Dialogue Systems: From Trained Monkeys to Stochastic Parrotscited by 1
- 2021A survey of joint intent detection and slot-filling models in natural language understandingcited by 0
- 2021Exploring Teacher-Student Learning Approach for Multi-lingual Speech-to-Intent Classificationcited by 0
- 2021Controllable Response Generation for Assistive Use-casescited by 0
- 2022Spoken Language Understanding for Conversational AI: Recent Advances and Future Directioncited by 0
- 2025Reward-Driven Interaction: Enhancing Proactive Dialogue Agents through User Satisfaction Predictioncited by 0
- 2025Leveraging Information Retrieval to Enhance Spoken Language Understanding Prompts in Few-Shot Learningcited by 0
- 2025Future of AI Models: A Computational perspective on Model collapsecited by 0
- 2026ESAinsTOD: A Unified End-to-End Schema-Aware Instruction-Tuning Framework for Task-Oriented Dialog Modelingcited by 0
- 2026ESAinsTOD: A Unified End-to-End Schema-Aware Instruction-Tuning Framework for Task-Oriented Dialog Modeling10 Mar 2026
- 2025Future of AI Models: A Computational perspective on Model collapse29 Oct 2025
- 2025Leveraging Information Retrieval to Enhance Spoken Language Understanding Prompts in Few-Shot Learning3 Jun 2025
- 2025Reward-Driven Interaction: Enhancing Proactive Dialogue Agents through User Satisfaction Prediction24 May 2025
- 2025On-Device LLMs for Home Assistant: Dual Role in Intent Detection and Response Generation18 Feb 2025
- 2024Advancing Single and Multi-task Text Classification through Large Language Model Fine-tuning11 Dec 2024
- 2024New Semantic Task for the French Spoken Language Understanding MEDIA Benchmark28 Mar 2024
- 2022Spoken Language Understanding for Conversational AI: Recent Advances and Future Direction21 Dec 2022
- 2022Towards Relation Extraction From Speech17 Oct 2022
- 2022Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformers23 May 2022
- 2022Cross-lingual Lifelong Learning23 May 2022
- 2022A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methods7 Apr 2022
12 more
- 2022Confidence Calibration for Intent Detection via Hyperspherical Space and Rebalanced Accuracy-Uncertainty Loss17 Mar 2022
- 2022Cross-Lingual Dialogue Dataset Creation via Outline-Based Generation31 Jan 2022
- 2021Controllable Response Generation for Assistive Use-cases4 Dec 2021
- 2021A Review of Dialogue Systems: From Trained Monkeys to Stochastic Parrots2 Nov 2021
- 2021Exploring Teacher-Student Learning Approach for Multi-lingual Speech-to-Intent Classification28 Sep 2021
- 2021Transfer Learning for Multi-lingual Tasks -- a Survey28 Aug 2021
- 2021CONDA: a CONtextual Dual-Annotated dataset for in-game toxicity understanding and detection11 Jun 2021
- 2021From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding15 May 2021
- 2021X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answering20 Apr 2021
- 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systems17 Apr 2021
- 2021A Survey on Spoken Language Understanding: Recent Advances and New Frontiers4 Mar 2021
- 2021A survey of joint intent detection and slot-filling models in natural language understanding20 Jan 2021
- 2021A Survey on Spoken Language Understanding: Recent Advances and New Frontierscited by 53
- 2021From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understandingcited by 43
- 2022A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methodscited by 42
- 2022Cross-Lingual Dialogue Dataset Creation via Outline-Based Generationcited by 23
- 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systemscited by 16
- 2021CONDA: a CONtextual Dual-Annotated dataset for in-game toxicity understanding and detectioncited by 14
- 2021X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answeringcited by 10
- 2022Towards Relation Extraction From Speechcited by 10
- 2022Cross-lingual Lifelong Learningcited by 9
- 2024Advancing Single and Multi-task Text Classification through Large Language Model Fine-tuningcited by 7
- 2025On-Device LLMs for Home Assistant: Dual Role in Intent Detection and Response Generationcited by 7
- 2022Confidence Calibration for Intent Detection via Hyperspherical Space and Rebalanced Accuracy-Uncertainty Losscited by 2
12 most cited of 23 All 23 (JSON)
- 2026ESAinsTOD: A Unified End-to-End Schema-Aware Instruction-Tuning Framework for Task-Oriented Dialog Modeling10 Mar 2026
- 2025Leveraging Information Retrieval to Enhance Spoken Language Understanding Prompts in Few-Shot Learning3 Jun 2025
- 2025Reward-Driven Interaction: Enhancing Proactive Dialogue Agents through User Satisfaction Prediction24 May 2025
- 2025On-Device LLMs for Home Assistant: Dual Role in Intent Detection and Response Generation18 Feb 2025
- 2024Advancing Single and Multi-task Text Classification through Large Language Model Fine-tuning11 Dec 2024
- 2024New Semantic Task for the French Spoken Language Understanding MEDIA Benchmark28 Mar 2024
- 2022Spoken Language Understanding for Conversational AI: Recent Advances and Future Direction21 Dec 2022
- 2022Towards Relation Extraction From Speech17 Oct 2022
- 2022Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformers23 May 2022
- 2022Cross-lingual Lifelong Learning23 May 2022
- 2022A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methods7 Apr 2022
- 2022Confidence Calibration for Intent Detection via Hyperspherical Space and Rebalanced Accuracy-Uncertainty Loss17 Mar 2022
12 newest of 23 All 23 (JSON)