Zero-shot stance detection based on cross-domain feature enhancement by contrastive learning
Not on the map. Why?
Abstract (arXiv)
Zero-shot stance detection is challenging because it requires detecting the stance of previously unseen targets in the inference phase. The ability to learn transferable target-invariant features is critical for zero-shot stance detection. In this work, we propose a stance detection approach that can efficiently adapt to unseen targets, the core of which is to capture target-invariant syntactic expression patterns as transferable knowledge. Specifically, we first augment the data by masking the topic words of sentences, and then feed the augmented data to an unsupervised contrastive learning module to capture transferable features. Then, to fit a specific target, we encode the raw texts as target-specific features. Finally, we adopt an attention mechanism, which combines syntactic expression patterns with target-specific features to obtain enhanced features for predicting previously unseen targets. Experiments demonstrate that our model outperforms competitive baselines on four benchmark datasets.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 35 references that are in the map. First posted on arXiv 7 Oct 2022.
Builds on
17 of 35 references.
References · 17
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2020Understanding the Behaviour of Contrastive Losscited by 398
- 2020Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representationscited by 98
- 2016Stance Detection with Bidirectional Conditional Encodingcited by 93
- 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
- 2020Will-They-Won't-They: A Very Large Dataset for Stance Detection on Twittercited by 54
- 2018Cross-Target Stance Classification with Self-Attention Networkscited by 41
5 more
- 2021Improved Text Classification via Contrastive Adversarial Trainingcited by 38
- 2021Adversarial Learning for Zero-Shot Stance Detection on Social Mediacited by 37
- 2019Contrastive Language Adaptation for Cross-Lingual Stance Detectioncited by 18
- 2020Group-wise Contrastive Learning for Neural Dialogue Generationcited by 15
- 2018Explaining Controversy on Social Media via Stance Summarizationcited by 9
Built on by
Citing papers per year: 2024: 1.
1 paper.