Rationale-Guided Knowledge Distillation for Cross-Lingual Stance Detection
Not on the map. Why?
Abstract (arXiv)
Stance detection aims to identify whether a text expresses a favorable or opposing attitude toward a given target, and serves as an important task for various downstream applications. Although existing studies have achieved strong performance in monolingual settings, especially in English, many low-resource languages such as Catalan still lack sufficient annotated data for training effective models. Cross-lingual stance detection alleviates this problem by transferring stance knowledge from resource-rich languages to low-resource languages. However, most existing methods mainly rely on semantic alignment between texts and targets, while ignoring the reasoning process required for reliable stance inference. Although Large Language Models provide strong reasoning ability, their high computational cost and inference latency limit practical deployment. To address these limitations, we propose a rationale-guided knowledge distillation framework for cross-lingual stance detection. Specifically, we use Chain-of-Thought prompting to guide Large Language Models in generating informative rationales, and distill the resulting reasoning knowledge into a compact student model. We further design a dual-path distillation mechanism to align rationale-enhanced and rationale-free representations, together with their prediction distributions. In addition, two contrastive learning strategies are introduced to improve stance discrimination. Experiments on multilingual benchmarks demonstrate that our method consistently outperforms competitive baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 85 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
42 of 85 references.
References · 42
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 915
- 2019Contrastive Representation Distillationcited by 734
30 more
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
- 2019How multilingual is Multilingual BERT?cited by 642
- 2022Teaching Small Language Models to Reasoncited by 279
- 2023Symbolic Chain-of-Thought Distillation: Small Models Can Also "Think" Step-by-Stepcited by 144
- 2020Improving Efficient Neural Ranking Models with Cross-Architecture Knowledge Distillationcited by 143
- 2020Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representationscited by 97
- 2020Stance Detection on Social Media: State of the Art and Trendscited by 93
- 2020Will-They-Won't-They: A Very Large Dataset for Stance Detection on Twittercited by 53
- 2023Stance Detection with Collaborative Role-Infused LLM-Based Agentscited by 53
- 2020X-Stance: A Multilingual Multi-Target Dataset for Stance Detectioncited by 42
- 2018Cross-Target Stance Classification with Self-Attention Networkscited by 40
- 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Designcited by 36
- 2021Cross-Domain Label-Adaptive Stance Detectioncited by 30
- 2021Few-Shot Cross-Lingual Stance Detection with Sentiment-Based Pre-Trainingcited by 28
- 2022Multi-Attention Network for Compressed Video Referring Object Segmentationcited by 27
- 2024Graph Mixture of Experts and Memory-augmented Routers for Multivariate Time Series Anomaly Detectioncited by 19
- 2025Towards Efficient Partially Relevant Video Retrieval with Active Moment Discoveringcited by 17
- 2020Multilingual Stance Detection: The Catalonia Independence Corpuscited by 16
- 2024Dual-path Collaborative Generation Network for Emotional Video Captioningcited by 13
- 2023Improving Image Captioning via Predicting Structured Conceptscited by 12
- 2024Stance Reasoner: Zero-Shot Stance Detection on Social Media with Explicit Reasoningcited by 11
- 2017Cross-lingual Distillation for Text Classificationcited by 9
- 2026CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layerscited by 8
- 2022Towards Analyzing the Bias of News Recommender Systems Using Sentiment and Stance Detectioncited by 7
- 2024Sentiment-oriented Transformer-based Variational Autoencoder Network for Live Video Commentingcited by 7
- 2025From Reasoning LLMs to BERT: A Two-Stage Distillation Framework for Search Relevancecited by 7
- 2025EmoVerse: A MLLMs-Driven Emotion Representation Dataset for Interpretable Visual Emotion Analysiscited by 6
- 2026FACE-net: Factual Calibration and Emotion Augmentation for Retrieval-enhanced Emotional Video Captioningcited by 5
- 2026A Multi-Agent Framework with Structured Reasoning and Reflective Refinement for Multimodal Empathetic Response Generationcited by 4
- 2024Zero-shot Cross-lingual Stance Detection via Adversarial Language Adaptationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Ladder-of-Thought: Using Knowledge as Steps to Elevate Stance Detection
- 2025Towards Transparent Stance Detection: A Zero-Shot Approach Using Implicit and Explicit Interpretability
- 2024Reasoner Outperforms: Generative Stance Detection with Rationalization for Social Media
- 2025Rethinking stance detection: A theoretically-informed research agenda for user-level inference using language models
- 2024Cross-target Stance Detection by Exploiting Target Analytical Perspectives
- 2026StanceMoE: Mixture-of-Experts Architecture for Stance Detection
- 2023Chain-of-Thought Embeddings for Stance Detection on Social Media
- 2025Induce, Align, Predict: Zero-Shot Stance Detection via Cognitive Inductive Reasoning