# Heterogeneity-aware Twitter Bot Detection with Relational Graph Transformers

arXiv: https://arxiv.org/abs/2109.02927 · HTML: https://mlsanity.com/paper/2109.02927/

## Key facts

- Cited by 41 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 7 Sep 2021.

## Built on by (most cited first, 30 of 41)

- [Stylometric Detection of AI-Generated Text in Twitter Timelines](https://mlsanity.com/paper/2303.03697/) (2023)
- [TwiBot-22: Towards Graph-Based Twitter Bot Detection](https://mlsanity.com/paper/2206.04564/) (2022)
- [Relational Attention: Generalizing Transformers for Graph-Structured Tasks](https://mlsanity.com/paper/2210.05062/) (2022)
- [What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detection](https://mlsanity.com/paper/2402.00371/) (2024)
- [A Survey of Graph-based Deep Learning for Anomaly Detection in Distributed Systems](https://mlsanity.com/paper/2206.04149/) (2022)
- [User Modeling in the Era of Large Language Models: Current Research and Future Directions](https://mlsanity.com/paper/2312.11518/) (2023)
- [RoSGAS: Adaptive Social Bot Detection with Reinforced Self-Supervised GNN Architecture Search](https://mlsanity.com/paper/2206.06757/) (2022)
- [LMBot: Distilling Graph Knowledge into Language Model for Graph-less Deployment in Twitter Bot Detection](https://mlsanity.com/paper/2306.17408/) (2023)
- [MGTAB: A Multi-Relational Graph-Based Twitter Account Detection Benchmark](https://mlsanity.com/paper/2301.01123/) (2023)
- [SeBot: Structural Entropy Guided Multi-View Contrastive Learning for Social Bot Detection](https://mlsanity.com/paper/2405.11225/) (2024)
- [BIC: Twitter Bot Detection with Text-Graph Interaction and Semantic Consistency](https://mlsanity.com/paper/2208.08320/) (2022)
- [Simplistic Collection and Labeling Practices Limit the Utility of Benchmark Datasets for Twitter Bot Detection](https://mlsanity.com/paper/2301.07015/) (2023)
- [FedACK: Federated Adversarial Contrastive Knowledge Distillation for Cross-Lingual and Cross-Model Social Bot Detection](https://mlsanity.com/paper/2303.07113/) (2023)
- [BotShape: A Novel Social Bots Detection Approach via Behavioral Patterns](https://mlsanity.com/paper/2303.10214/) (2023)
- [BotDGT: Dynamicity-aware Social Bot Detection with Dynamic Graph Transformers](https://mlsanity.com/paper/2404.15070/) (2024)
- [Over-Sampling Strategy in Feature Space for Graphs based Class-imbalanced Bot Detection](https://mlsanity.com/paper/2302.06900/) (2023)
- [Boosting Bot Detection via Heterophily-Aware Representation Learning and Prototype-Guided Cluster Discovery](https://mlsanity.com/paper/2506.00989/) (2025)
- [MulBot: Unsupervised Bot Detection Based on Multivariate Time Series](https://mlsanity.com/paper/2209.10361/) (2022)
- [Multimodal Detection of Bots on X (Twitter) using Transformers](https://mlsanity.com/paper/2308.14484/) (2023)
- [RoBCtrl: Attacking GNN-Based Social Bot Detectors via Reinforced Manipulation of Bots Control Interaction](https://mlsanity.com/paper/2510.16035/) (2025)
- [AHEAD: A Triple Attention Based Heterogeneous Graph Anomaly Detection Approach](https://mlsanity.com/paper/2208.08200/) (2022)
- [FakeSwarm: Improving Fake News Detection with Swarming Characteristics](https://mlsanity.com/paper/2305.19194/) (2023)
- [Russo-Ukrainian War: Prediction and explanation of Twitter suspension](https://mlsanity.com/paper/2306.03502/) (2023)
- [BSG4Bot: Efficient Bot Detection based on Biased Heterogeneous Subgraphs](https://mlsanity.com/paper/2410.05356/) (2024)
- [A Graph Neural Architecture Search Approach for Identifying Bots in Social Media](https://mlsanity.com/paper/2411.16285/) (2024)
- [Certainly Bot Or Not? Trustworthy Social Bot Detection via Robust Multi-Modal Neural Processes](https://mlsanity.com/paper/2503.09626/) (2025)
- [BotTrans: A Multi-Source Graph Domain Adaptation Approach for Social Bot Detection](https://mlsanity.com/paper/2506.13795/) (2025)
- [Graph-based Fake Account Detection: A Survey](https://mlsanity.com/paper/2507.06541/) (2025)
- [Optimal Transport-Guided Adversarial Attacks on Graph Neural Network-Based Bot Detection](https://mlsanity.com/paper/2602.00318/) (2026)
- [RABot: Reinforcement-Guided Graph Augmentation for Imbalanced and Noisy Social Bot Detection](https://mlsanity.com/paper/2602.21749/) (2026)

## Abstract (arXiv)

Twitter bot detection has become an important and challenging task to combat misinformation and protect the integrity of the online discourse. State-of-the-art approaches generally leverage the topological structure of the Twittersphere, while they neglect the heterogeneity of relations and influence among users. In this paper, we propose a novel bot detection framework to alleviate this problem, which leverages the topological structure of user-formed heterogeneous graphs and models varying influence intensity between users. Specifically, we construct a heterogeneous information network with users as nodes and diversified relations as edges. We then propose relational graph transformers to model heterogeneous influence between users and learn node representations. Finally, we use semantic attention networks to aggregate messages across users and relations and conduct heterogeneity-aware Twitter bot detection. Extensive experiments demonstrate that our proposal outperforms state-of-the-art methods on a comprehensive Twitter bot detection benchmark. Additional studies also bear out the effectiveness of our proposed relational graph transformers, semantic attention networks and the graph-based approach in general.