mlsanityData to 14 Oct 2026

Reinforcement Tuning for Detecting Stances and Debunking Rumors Jointly with Large Language Models

arXiv 2406.02143 ↗First posted 4 Jun 2024cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

Learning multi-task models for jointly detecting stance and verifying rumors poses challenges due to the need for training data of stance at post level and rumor veracity at claim level, which are difficult to obtain. To address this issue, we leverage large language models (LLMs) as the foundation annotators for the joint stance detection (SD) and rumor verification (RV) tasks, dubbed as JSDRV. We introduce a novel reinforcement tuning framework to enhance the joint predictive capabilities of LLM-based SD and RV components. Specifically, we devise a policy for selecting LLM-annotated data at the two levels, employing a hybrid reward mechanism to choose high-quality labels for effective LLM fine-tuning on both tasks. Results demonstrate that JSDRV improves the capabilities of LLMs in the joint tasks, not only outperforming state-of-the-art methods but also generalizing to non-LLMs accommodated as task models.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 35 of its 74 references that are in the map. First posted on arXiv 4 Jun 2024.

Builds on

35 of 74 references.

References · 35

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2017Graph Attention Networkscited by 8,923
  7. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  8. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  9. 2020BERTweet: A pre-trained language model for English Tweetscited by 346
  10. 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
  11. 2020GCAN: Graph-aware Co-Attention Networks for Explainable Fake News Detection on Social Mediacited by 109
  12. 2020Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representationscited by 98
23 more
  1. 2023Towards LLM-based Fact Verification on News Claims with a Hierarchical Step-by-Step Prompting Methodcited by 97
  2. 2020Stance Detection on Social Media: State of the Art and Trendscited by 95
  3. 2016Stance Detection with Bidirectional Conditional Encodingcited by 93
  4. 2017SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumourscited by 77
  5. 2018RumourEval 2019: Determining Rumour Veracity and Support for Rumourscited by 75
  6. 2015Analysing How People Orient to and Spread Rumours in Social Media by Looking at Conversational Threadscited by 64
  7. 2021Towards Few-Shot Fact-Checking via Perplexitycited by 63
  8. 2023Can we trust the evaluation on ChatGPT?cited by 63
  9. 2018All-in-one: Multi-task Learning for Rumour Verificationcited by 54
  10. 2020Interpretable Rumor Detection in Microblogs by Attending to User Interactionscited by 44
  11. 2022Detect Rumors in Microblog Posts for Low-Resource Domains via Adversarial Contrastive Learningcited by 41
  12. 2022Zero-Shot Rumor Detection with Propagation Structure via Prompt Learningcited by 32
  13. 2021Rumor Detection on Twitter with Claim-Guided Hierarchical Graph Attention Networkscited by 29
  14. 2020Causal Understanding of Fake News Dissemination on Social Mediacited by 27
  15. 2017Turing at SemEval-2017 Task 8: Sequential Approach to Rumour Stance Classification with Branch-LSTMcited by 20
  16. 2019Modeling Conversation Structure and Temporal Dynamics for Jointly Predicting Rumor Stance and Veracitycited by 15
  17. 2024Reinforcement Retrieval Leveraging Fine-grained Feedback for Fact Checking News Claims with Black-Box LLMcited by 15
  18. 2017Discourse-Aware Rumour Stance Classification in Social Media Using Sequential Classifierscited by 14
  19. 2016Stance Classification in Rumours as a Sequential Task Exploiting the Tree Structure of Social Media Conversationscited by 12
  20. 2020A Kernel of Truth: Determining Rumor Veracity on Twitter by Diffusion Pattern Alonecited by 12
  21. 2023Unsupervised Cross-Domain Rumor Detection with Contrastive Learning and Cross-Attentioncited by 11
  22. 2021STEM: Unsupervised STructural EMbedding for Stance Detectioncited by 9
  23. 2021SRLF: A Stance-aware Reinforcement Learning Framework for Content-based Rumor Detection on Social Mediacited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 1.

5 papers.