mlsanityData to 7 Oct 2026

Bridge to Target Domain by Prototypical Contrastive Learning and Label Confusion: Re-explore Zero-Shot Learning for Slot Filling

arXiv 2110.03572 ↗First posted 7 Oct 2021cs.CLcited by 13

Not on the map. Why?

Abstract (arXiv)

Zero-shot cross-domain slot filling alleviates the data dependence in the case of data scarcity in the target domain, which has aroused extensive research. However, as most of the existing methods do not achieve effective knowledge transfer to the target domain, they just fit the distribution of the seen slot and show poor performance on unseen slot in the target domain. To solve this, we propose a novel approach based on prototypical contrastive learning with a dynamic label confusion strategy for zero-shot slot filling. The prototypical contrastive learning aims to reconstruct the semantic constraints of labels, and we introduce the label confusion strategy to establish the label dependence between the source domains and the target domain on-the-fly. Experimental results show that our model achieves significant improvement on the unseen slots, while also set new state-of-the-arts on slot filling task.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 15 of its 23 references that are in the map. First posted on arXiv 7 Oct 2021.

Builds on

15 of 23 references.

References · 15

  1. 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
  2. 2016Neural Architectures for Named Entity Recognitioncited by 548
  3. 2018Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfacescited by 376
  4. 2020Contrastive Clusteringcited by 264
  5. 2016Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Fillingcited by 137
  6. 2020Contrastive Learning for Label-Efficient Semantic Segmentationcited by 93
  7. 2019A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Fillingcited by 85
  8. 2021Prototypical Cross-domain Self-supervised Learning for Few-shot Unsupervised Domain Adaptationcited by 83
  9. 2020SlotRefine: A Fast Non-Autoregressive Model for Joint Intent Detection and Slot Fillingcited by 42
  10. 2017Towards Zero-Shot Frame Semantic Parsing for Domain Scalingcited by 40
  11. 2020Coach: A Coarse-to-Fine Approach for Cross-domain Slot Fillingcited by 38
  12. 2020Self-Supervised Prototypical Transfer Learning for Few-Shot Classificationcited by 26
3 more
  1. 2018Zero-Shot Adaptive Transfer for Conversational Language Understandingcited by 20
  2. 2020Zero-Resource Cross-Domain Named Entity Recognitioncited by 18
  3. 2020Unsupervised Feature Learning by Autoencoder and Prototypical Contrastive Learning for Hyperspectral Classificationcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 8; 2024: 2; 2025: 0; 2026: 1.

13 papers.

Sort:

By area: