Bridge to Target Domain by Prototypical Contrastive Learning and Label Confusion: Re-explore Zero-Shot Learning for Slot Filling
Not on the map. Why?
Abstract (arXiv)
Zero-shot cross-domain slot filling alleviates the data dependence in the case of data scarcity in the target domain, which has aroused extensive research. However, as most of the existing methods do not achieve effective knowledge transfer to the target domain, they just fit the distribution of the seen slot and show poor performance on unseen slot in the target domain. To solve this, we propose a novel approach based on prototypical contrastive learning with a dynamic label confusion strategy for zero-shot slot filling. The prototypical contrastive learning aims to reconstruct the semantic constraints of labels, and we introduce the label confusion strategy to establish the label dependence between the source domains and the target domain on-the-fly. Experimental results show that our model achieves significant improvement on the unseen slots, while also set new state-of-the-arts on slot filling task.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 15 of its 23 references that are in the map. First posted on arXiv 7 Oct 2021.
Builds on
15 of 23 references.
References · 15
- 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
- 2016Neural Architectures for Named Entity Recognitioncited by 548
- 2018Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfacescited by 376
- 2020Contrastive Clusteringcited by 264
- 2016Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Fillingcited by 137
- 2020Contrastive Learning for Label-Efficient Semantic Segmentationcited by 93
- 2019A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Fillingcited by 85
- 2021Prototypical Cross-domain Self-supervised Learning for Few-shot Unsupervised Domain Adaptationcited by 83
- 2020SlotRefine: A Fast Non-Autoregressive Model for Joint Intent Detection and Slot Fillingcited by 42
- 2017Towards Zero-Shot Frame Semantic Parsing for Domain Scalingcited by 40
- 2020Coach: A Coarse-to-Fine Approach for Cross-domain Slot Fillingcited by 38
- 2020Self-Supervised Prototypical Transfer Learning for Few-Shot Classificationcited by 26
Built on by
Citing papers per year: 2022: 2; 2023: 8; 2024: 2; 2025: 0; 2026: 1.
13 papers.
Sort:
By area:
- 2022PSSAT: A Perturbed Semantic Structure Awareness Transferring Method for Perturbation-Robust Slot Fillingcited by 9
- 2023Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Promptingcited by 8
- 2022A Robust Contrastive Alignment Method For Multi-Domain Text Classificationcited by 6
- 2024A Survey of Ontology Expansion for Conversational Understandingcited by 6
- 2023Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent Discoverycited by 5
- 2023Towards Robust and Generalizable Training: An Empirical Study of Noisy Slot Filling for Input Perturbationscited by 5
- 2023DemoNSF: A Multi-task Demonstration-based Generative Framework for Noisy Slot Filling Taskcited by 5
- 2023Adaptive End-to-End Metric Learning for Zero-Shot Cross-Domain Slot Fillingcited by 2
- 2023Introducing "Forecast Utterance" for Conversational Data Sciencecited by 1
- 2023HierarchicalContrast: A Coarse-to-Fine Contrastive Learning Framework for Cross-Domain Zero-Shot Slot Fillingcited by 1
- 2024Noise-BERT: A Unified Perturbation-Robust Framework with Noise Alignment Pre-training for Noisy Slot Filling Taskcited by 1
- 2023Actively Discovering New Slots for Task-oriented Conversationcited by 0
1 more
- 2026Beyond Domains: Reusing Web Skills via Transferable Interaction Patterns16 Jun 2026
- 2024A Survey of Ontology Expansion for Conversational Understanding19 Oct 2024
- 2024Noise-BERT: A Unified Perturbation-Robust Framework with Noise Alignment Pre-training for Noisy Slot Filling Task22 Feb 2024
- 2023Adaptive End-to-End Metric Learning for Zero-Shot Cross-Domain Slot Filling23 Oct 2023
- 2023DemoNSF: A Multi-task Demonstration-based Generative Framework for Noisy Slot Filling Task16 Oct 2023
- 2023HierarchicalContrast: A Coarse-to-Fine Contrastive Learning Framework for Cross-Domain Zero-Shot Slot Filling13 Oct 2023
- 2023Towards Robust and Generalizable Training: An Empirical Study of Noisy Slot Filling for Input Perturbations5 Oct 2023
- 2023Introducing "Forecast Utterance" for Conversational Data Science7 Sep 2023
- 2023Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Prompting6 Jul 2023
- 2023Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent Discovery28 May 2023
- 2023Actively Discovering New Slots for Task-oriented Conversation6 May 2023
- 2022PSSAT: A Perturbed Semantic Structure Awareness Transferring Method for Perturbation-Robust Slot Filling24 Aug 2022
1 more
- 2022PSSAT: A Perturbed Semantic Structure Awareness Transferring Method for Perturbation-Robust Slot Fillingcited by 9
- 2023Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Promptingcited by 8
- 2022A Robust Contrastive Alignment Method For Multi-Domain Text Classificationcited by 6
- 2024A Survey of Ontology Expansion for Conversational Understandingcited by 6
- 2023Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent Discoverycited by 5
- 2023Towards Robust and Generalizable Training: An Empirical Study of Noisy Slot Filling for Input Perturbationscited by 5
- 2023DemoNSF: A Multi-task Demonstration-based Generative Framework for Noisy Slot Filling Taskcited by 5
- 2023Adaptive End-to-End Metric Learning for Zero-Shot Cross-Domain Slot Fillingcited by 2
- 2023Introducing "Forecast Utterance" for Conversational Data Sciencecited by 1
- 2023HierarchicalContrast: A Coarse-to-Fine Contrastive Learning Framework for Cross-Domain Zero-Shot Slot Fillingcited by 1
- 2024Noise-BERT: A Unified Perturbation-Robust Framework with Noise Alignment Pre-training for Noisy Slot Filling Taskcited by 1
- 2023Actively Discovering New Slots for Task-oriented Conversationcited by 0
- 2024A Survey of Ontology Expansion for Conversational Understanding19 Oct 2024
- 2024Noise-BERT: A Unified Perturbation-Robust Framework with Noise Alignment Pre-training for Noisy Slot Filling Task22 Feb 2024
- 2023Adaptive End-to-End Metric Learning for Zero-Shot Cross-Domain Slot Filling23 Oct 2023
- 2023DemoNSF: A Multi-task Demonstration-based Generative Framework for Noisy Slot Filling Task16 Oct 2023
- 2023HierarchicalContrast: A Coarse-to-Fine Contrastive Learning Framework for Cross-Domain Zero-Shot Slot Filling13 Oct 2023
- 2023Towards Robust and Generalizable Training: An Empirical Study of Noisy Slot Filling for Input Perturbations5 Oct 2023
- 2023Introducing "Forecast Utterance" for Conversational Data Science7 Sep 2023
- 2023Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Prompting6 Jul 2023
- 2023Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent Discovery28 May 2023
- 2023Actively Discovering New Slots for Task-oriented Conversation6 May 2023
- 2022PSSAT: A Perturbed Semantic Structure Awareness Transferring Method for Perturbation-Robust Slot Filling24 Aug 2022
- 2022A Robust Contrastive Alignment Method For Multi-Domain Text Classification26 Apr 2022