mlsanityData to 7 Oct 2026

Rationale-Guided Knowledge Distillation for Cross-Lingual Stance Detection

arXiv 2607.18693 ↗First posted 21 Jul 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Stance detection aims to identify whether a text expresses a favorable or opposing attitude toward a given target, and serves as an important task for various downstream applications. Although existing studies have achieved strong performance in monolingual settings, especially in English, many low-resource languages such as Catalan still lack sufficient annotated data for training effective models. Cross-lingual stance detection alleviates this problem by transferring stance knowledge from resource-rich languages to low-resource languages. However, most existing methods mainly rely on semantic alignment between texts and targets, while ignoring the reasoning process required for reliable stance inference. Although Large Language Models provide strong reasoning ability, their high computational cost and inference latency limit practical deployment. To address these limitations, we propose a rationale-guided knowledge distillation framework for cross-lingual stance detection. Specifically, we use Chain-of-Thought prompting to guide Large Language Models in generating informative rationales, and distill the resulting reasoning knowledge into a compact student model. We further design a dual-path distillation mechanism to align rationale-enhanced and rationale-free representations, together with their prediction distributions. In addition, two contrastive learning strategies are introduced to improve stance discrimination. Experiments on multilingual benchmarks demonstrate that our method consistently outperforms competitive baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 85 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

42 of 85 references.

References · 42

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  6. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  7. 2022Emergent Abilities of Large Language Modelscited by 2,483
  8. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  9. 2020Knowledge Distillation: A Surveycited by 1,578
  10. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
  11. 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 915
  12. 2019Contrastive Representation Distillationcited by 734
30 more
  1. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  2. 2019How multilingual is Multilingual BERT?cited by 642
  3. 2022Teaching Small Language Models to Reasoncited by 279
  4. 2023Symbolic Chain-of-Thought Distillation: Small Models Can Also "Think" Step-by-Stepcited by 144
  5. 2020Improving Efficient Neural Ranking Models with Cross-Architecture Knowledge Distillationcited by 143
  6. 2020Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representationscited by 97
  7. 2020Stance Detection on Social Media: State of the Art and Trendscited by 93
  8. 2020Will-They-Won't-They: A Very Large Dataset for Stance Detection on Twittercited by 53
  9. 2023Stance Detection with Collaborative Role-Infused LLM-Based Agentscited by 53
  10. 2020X-Stance: A Multilingual Multi-Target Dataset for Stance Detectioncited by 42
  11. 2018Cross-Target Stance Classification with Self-Attention Networkscited by 40
  12. 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Designcited by 36
  13. 2021Cross-Domain Label-Adaptive Stance Detectioncited by 30
  14. 2021Few-Shot Cross-Lingual Stance Detection with Sentiment-Based Pre-Trainingcited by 28
  15. 2022Multi-Attention Network for Compressed Video Referring Object Segmentationcited by 27
  16. 2024Graph Mixture of Experts and Memory-augmented Routers for Multivariate Time Series Anomaly Detectioncited by 19
  17. 2025Towards Efficient Partially Relevant Video Retrieval with Active Moment Discoveringcited by 17
  18. 2020Multilingual Stance Detection: The Catalonia Independence Corpuscited by 16
  19. 2024Dual-path Collaborative Generation Network for Emotional Video Captioningcited by 13
  20. 2023Improving Image Captioning via Predicting Structured Conceptscited by 12
  21. 2024Stance Reasoner: Zero-Shot Stance Detection on Social Media with Explicit Reasoningcited by 11
  22. 2017Cross-lingual Distillation for Text Classificationcited by 9
  23. 2026CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layerscited by 8
  24. 2022Towards Analyzing the Bias of News Recommender Systems Using Sentiment and Stance Detectioncited by 7
  25. 2024Sentiment-oriented Transformer-based Variational Autoencoder Network for Live Video Commentingcited by 7
  26. 2025From Reasoning LLMs to BERT: A Two-Stage Distillation Framework for Search Relevancecited by 7
  27. 2025EmoVerse: A MLLMs-Driven Emotion Representation Dataset for Interpretable Visual Emotion Analysiscited by 6
  28. 2026FACE-net: Factual Calibration and Emotion Augmentation for Retrieval-enhanced Emotional Video Captioningcited by 5
  29. 2026A Multi-Agent Framework with Structured Reasoning and Reflective Refinement for Multimodal Empathetic Response Generationcited by 4
  30. 2024Zero-shot Cross-lingual Stance Detection via Adversarial Language Adaptationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Ladder-of-Thought: Using Knowledge as Steps to Elevate Stance Detection
  2. 2025Towards Transparent Stance Detection: A Zero-Shot Approach Using Implicit and Explicit Interpretability
  3. 2024Reasoner Outperforms: Generative Stance Detection with Rationalization for Social Media
  4. 2025Rethinking stance detection: A theoretically-informed research agenda for user-level inference using language models
  5. 2024Cross-target Stance Detection by Exploiting Target Analytical Perspectives
  6. 2026StanceMoE: Mixture-of-Experts Architecture for Stance Detection
  7. 2023Chain-of-Thought Embeddings for Stance Detection on Social Media
  8. 2025Induce, Align, Predict: Zero-Shot Stance Detection via Cognitive Inductive Reasoning