X-Troll: eXplainable Detection of State-Sponsored Information Operations Agents
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
State-sponsored trolls, malicious actors who deploy sophisticated linguistic manipulation in coordinated information campaigns, posing threats to online discourse integrity. While Large Language Models (LLMs) achieve strong performance on general natural language processing (NLP) tasks, they struggle with subtle propaganda detection and operate as ``black boxes'', providing no interpretable insights into manipulation strategies. This paper introduces X-Troll, a novel framework that bridges this gap by integrating explainable adapter-based LLMs with expert-derived linguistic knowledge to detect state-sponsored trolls and provide human-readable explanations for its decisions. X-Troll incorporates appraisal theory and propaganda analysis through specialized LoRA adapters, using dynamic gating to capture campaign-specific discourse patterns in coordinated information operations. Experiments on real-world data demonstrate that our linguistically-informed approach shows strong performance compared with both general LLM baselines and existing troll detection models in accuracy while providing enhanced transparency through expert-grounded explanations that reveal the specific linguistic strategies used by state-sponsored actors. X-Troll source code is available at: https://github.com/ltian678/xtroll_source/.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 29 of its 59 references that are in the map. First posted on arXiv 22 Aug 2025.
Builds on
29 of 59 references.
References · 29
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2019Explain Yourself! Leveraging Language Models for Commonsense Reasoningcited by 367
- 2016Rationalizing Neural Predictionscited by 281
- 2020GCAN: Graph-aware Co-Attention Networks for Explainable Fake News Detection on Social Mediacited by 108
- 2023The science of fake newscited by 94
- 2020Interpretable Rumor Detection in Microblogs by Attending to User Interactionscited by 44
- 2018Disinformation Warfare: Understanding State-Sponsored Trolls on Twitter and Their Influence on the Webcited by 18
- 2022FR: Folded Rationalization with a Unified Encodercited by 18
17 more
- 2022Interval-censored Transformer Hawkes: Detecting Information Operations using the Reaction of Social Systemscited by 16
- 2019Transfer Learning for Hate Speech Detection in Social Mediacited by 13
- 2023MGR: Multi-generator Based Rationalizationcited by 12
- 2019Still out there: Modeling and Identifying Russian Troll Accounts on Twittercited by 11
- 2021Slipping to the Extreme: A Mixed Method to Explain How Extreme Opinions Infiltrate Online Discussionscited by 10
- 2022Generalizing Hate Speech Detection Using Multi-Task Learning: A Case Study of Political Public Figurescited by 10
- 2018#DebateNight: The Role and Influence of Socialbots on Twitter During the 1st 2016 U.S. Presidential Debatecited by 7
- 2018Who Falls for Online Political Manipulation?cited by 7
- 2023MetaTroll: Few-shot Detection of State-Sponsored Trolls with Transformer Adapterscited by 7
- 2025Behavioral Homophily in Social Media via Inverse Reinforcement Learning: A Reddit Case Studycited by 5
- 2025Before It's Too Late: A State Space Model for the Early Prediction of Misinformation and Disinformation Engagementcited by 5
- 2022Practical Guidelines for Ideology Detection Pipelines and Psychosocial Applicationscited by 4
- 2022Opinion Market Model: Stemming Far-Right Opinion Spread using Positive Interventionscited by 4
- 2018'Senator, We Sell Ads': Analysis of the 2016 Russian Facebook Ads Campaigncited by 3
- 2025MVAN: Multi-View Attention Networks for Fake News Detection on Social Mediacited by 3
- 2019Analysing user identity via time-sensitive semantic edit distance (t-SED): A case study of Russian trolls on Twittercited by 2
- 2020Birdspotter: A Tool for Analyzing and Labeling Twitter Userscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Unmasking Propaganda: A Comparative Analysis of Masked and Causal Language Models
- 2026LinGO: A Linguistic Graph Optimization Framework with LLMs for Interpreting Intents of Online Uncivil Discourse
- 2020Detecting Troll Behavior via Inverse Reinforcement Learning: A Case Study of Russian Trolls in the 2016 US Election
- 2025Generative Exaggeration in LLM Social Agents: Consistency, Bias, and Toxicity
- 2026When Agents Talk: Discourse, Manipulation, and Risk in an Agentic Social Network
- 2023Fighting Fire with Fire: The Dual Role of LLMs in Crafting and Detecting Elusive Disinformation
- 2025Why Do Language Model Agents Whistleblow?
- 2024On the Risk of Evidence Pollution for Malicious Social Text Detection in the Era of LLMs