X2Parser: Cross-Lingual and Cross-Domain Framework for Task-Oriented Compositional Semantic Parsing
Not on the map. Why?
Abstract (arXiv)
Task-oriented compositional semantic parsing (TCSP) handles complex nested user queries and serves as an essential component of virtual assistants. Current TCSP models rely on numerous training data to achieve decent performance but fail to generalize to low-resource target languages or domains. In this paper, we present X2Parser, a transferable Cross-lingual and Cross-domain Parser for TCSP. Unlike previous models that learn to generate the hierarchical representations for nested intents and slots, we propose to predict flattened intents and slots representations separately and cast both prediction tasks into sequence labeling problems. After that, we further propose a fertility-based slot predictor that first learns to dynamically detect the number of labels for each token, and then predicts the slot types. Experimental results illustrate that our model can significantly outperform existing strong baselines in cross-lingual and cross-domain settings, and our model can also achieve a good generalization ability on target languages of target domains. Furthermore, our model tackles the problem in an efficient non-autoregressive way that reduces the latency by up to 66% compared to the generative model.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 31 of its 41 references that are in the map. First posted on arXiv 7 Jun 2021.
Builds on
31 of 41 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
- 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
- 2017Non-Autoregressive Neural Machine Translationcited by 463
- 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 216
- 2020MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmarkcited by 158
- 2016Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Fillingcited by 137
- 2018Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialogcited by 125
- 2020CrossNER: Evaluating Cross-Domain Named Entity Recognitioncited by 104
19 more
- 2018Semantic Parsing for Task Oriented Dialog using Hierarchical Representationscited by 101
- 2019Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Taskscited by 96
- 2018Joint Slot Filling and Intent Detection via Capsule Neural Networkscited by 73
- 2020Low-Resource Domain Adaptation for Compositional Task-Oriented Semantic Parsingcited by 72
- 2019NCLS: Neural Cross-Lingual Summarizationcited by 64
- 2020Don't Parse, Generate! A Sequence to Sequence Architecture for Task-Oriented Semantic Parsingcited by 59
- 2020Cross-lingual Retrieval for Iterative Self-Supervised Trainingcited by 54
- 2021AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarizationcited by 51
- 2018Neural Cross-Lingual Named Entity Recognition with Minimal Resourcescited by 44
- 2019Attention-Informed Mixed-Language Training for Zero-shot Cross-lingual Task-oriented Dialogue Systemscited by 42
- 2020Coach: A Coarse-to-Fine Approach for Cross-domain Slot Fillingcited by 38
- 2017Weakly Supervised Cross-Lingual Named Entity Recognition via Effective Annotation and Representation Projectioncited by 36
- 2020Learning Fast Adaptation on Cross-Accented Speech Recognitioncited by 28
- 2020Unsupervised Domain Adaptation of a Pretrained Cross-Lingual Language Modelcited by 24
- 2019Zero-shot Cross-lingual Dialogue Systems with Transferable Latent Variablescited by 21
- 2016Neural Structural Correspondence Learning for Domain Adaptationcited by 19
- 2021Span Pointer Networks for Non-Autoregressive Task-Oriented Semantic Parsingcited by 18
- 2021Non-Autoregressive Semantic Parsing for Compositional Task-Oriented Dialogcited by 17
- 2018XL-NBT: A Cross-lingual Neural Belief Tracking Frameworkcited by 7
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 1.
4 papers.
- 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 98
- 2021Language Models are Few-shot Multilingual Learnerscited by 92
- 2022Retrieve-and-Fill for Scenario-based Task-Oriented Semantic Parsingcited by 7
- 2023Evaluating Inter-Bilingual Semantic Parsing for Indian Languagescited by 1
- 2023Evaluating Inter-Bilingual Semantic Parsing for Indian Languages25 Apr 2023
- 2022State-of-the-art generalisation research in NLP: A taxonomy and review6 Oct 2022
- 2022Retrieve-and-Fill for Scenario-based Task-Oriented Semantic Parsing2 Feb 2022
- 2021Language Models are Few-shot Multilingual Learners16 Sep 2021