# BotArtist: Generic approach for bot detection in Twitter via semi-automatic machine learning pipeline

arXiv: https://arxiv.org/abs/2306.00037 · HTML: https://mlsanity.com/paper/2306.00037/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 34 of its 75 references that are in the map.
- First posted on arXiv 31 May 2023.

## Builds on (most cited first, 30 of 34)

- [Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer](https://mlsanity.com/paper/1910.10683/) (2019)
- [RoBERTa: A Robustly Optimized BERT Pretraining Approach](https://mlsanity.com/paper/1907.11692/) (2019)
- [Semi-Supervised Classification with Graph Convolutional Networks](https://mlsanity.com/paper/1609.02907/) (2016)
- [Graph Attention Networks](https://mlsanity.com/paper/1710.10903/) (2017)
- [A Unified Approach to Interpreting Model Predictions](https://mlsanity.com/paper/1705.07874/) (2017)
- [Heterogeneous Graph Transformer](https://mlsanity.com/paper/2003.01332/) (2020)
- [Are we really making much progress? Revisiting, benchmarking, and refining heterogeneous graph neural networks](https://mlsanity.com/paper/2112.14936/) (2021)
- [Online Human-Bot Interactions: Detection, Estimation, and Characterization](https://mlsanity.com/paper/1703.03107/) (2017)
- [Scalable and Generalizable Social Bot Detection through Data Selection](https://mlsanity.com/paper/1911.09179/) (2019)
- [TwiBot-20: A Comprehensive Twitter Bot Detection Benchmark](https://mlsanity.com/paper/2106.13088/) (2021)
- [The paradigm-shift of social spambots: Evidence, theories, and tools for the arms race](https://mlsanity.com/paper/1701.03017/) (2017)
- [A Decade of Social Bot Detection](https://mlsanity.com/paper/2007.03604/) (2020)
- [TwiBot-22: Towards Graph-Based Twitter Bot Detection](https://mlsanity.com/paper/2206.04564/) (2022)
- [Heterogeneity-aware Twitter Bot Detection with Relational Graph Transformers](https://mlsanity.com/paper/2109.02927/) (2021)
- [BotRGCN: Twitter Bot Detection with Relational Graph Convolutional Networks](https://mlsanity.com/paper/2106.13092/) (2021)
- [Deep Neural Networks for Bot Detection](https://mlsanity.com/paper/1802.04289/) (2018)
- [Fame for sale: efficient detection of fake Twitter followers](https://mlsanity.com/paper/1509.04098/) (2015)
- [An Exploratory Study of COVID-19 Misinformation on Twitter](https://mlsanity.com/paper/2005.05710/) (2020)
- [Analyzing the Digital Traces of Political Manipulation: The 2016 Russian Interference Twitter Campaign](https://mlsanity.com/paper/1802.04291/) (2018)
- [RTbust: Exploiting Temporal Patterns for Botnet Detection on Twitter](https://mlsanity.com/paper/1902.04506/) (2019)
- [Twitter Bot Detection Using Bidirectional Long Short-term Memory Neural Networks and Word Embeddings](https://mlsanity.com/paper/2002.01336/) (2020)
- [Botometer 101: Social bot practicum for computational social scientists](https://mlsanity.com/paper/2201.01608/) (2022)
- [Arming the public with artificial intelligence to counter social bots](https://mlsanity.com/paper/1901.00912/) (2019)
- [SATAR: A Self-supervised Approach to Twitter Account Representation Learning and its Application in Bot Detection](https://mlsanity.com/paper/2106.13089/) (2021)
- [Dual Graph enhanced Embedding Neural Network for CTR Prediction](https://mlsanity.com/paper/2106.00314/) (2021)
- [DNA-inspired online behavioral modeling and its application to spambot detection](https://mlsanity.com/paper/1602.00110/) (2016)
- [LOBO -- Evaluation of Generalization Deficiencies in Twitter Bot Classifiers](https://mlsanity.com/paper/1809.09684/) (2018)
- [Graph-Hist: Graph Classification from Latent Feature Histograms With Application to Bot Detection](https://mlsanity.com/paper/1910.01180/) (2019)
- [The COVID-19 Infodemic: Twitter versus Facebook](https://mlsanity.com/paper/2012.09353/) (2020)
- [Its All in a Name: Detecting and Labeling Bots by Their Name](https://mlsanity.com/paper/1812.05932/) (2018)

## Abstract (arXiv)

Twitter, as one of the most popular social networks, provides a platform for communication and online discourse. Unfortunately, it has also become a target for bots and fake accounts, resulting in the spread of false information and manipulation. This paper introduces a semi-automatic machine learning pipeline (SAMLP) designed to address the challenges associated with machine learning model development. Through this pipeline, we develop a comprehensive bot detection model named BotArtist, based on user profile features. SAMLP leverages nine distinct publicly available datasets to train the BotArtist model. To assess BotArtist's performance against current state-of-the-art solutions, we evaluate 35 existing Twitter bot detection methods, each utilizing a diverse range of features. Our comparative evaluation of BotArtist and these existing methods, conducted across nine public datasets under standardized conditions, reveals that the proposed model outperforms existing solutions by almost 10% in terms of F1-score, achieving an average score of 83.19% and 68.5% over specific and general approaches, respectively. As a result of this research, we provide one of the largest labeled Twitter bot datasets. The dataset contains extracted features combined with BotArtist predictions for 10,929,533 Twitter user profiles, collected via Twitter API during the 2022 Russo-Ukrainian War over a 16-month period. This dataset was created based on [Shevtsov et al., 2022a] where the original authors share anonymized tweets discussing the Russo-Ukrainian war, totaling 127,275,386 tweets. The combination of the existing textual dataset and the provided labeled bot and human profiles will enable future development of more advanced bot detection large language models in the post-Twitter API era.