# Robust Spammer Detection by Nash Reinforcement Learning

arXiv: https://arxiv.org/abs/2006.06069 · HTML: https://mlsanity.com/paper/2006.06069/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 10 Jun 2020.

## Built on by (most cited first, 17 of 17)

- [GADBench: Revisiting and Benchmarking Supervised Graph Anomaly Detection](https://mlsanity.com/paper/2306.12251/) (2023)
- [Reinforced Neighborhood Selection Guided Multi-Relational Graph Neural Networks](https://mlsanity.com/paper/2104.07886/) (2021)
- [Label Information Enhanced Fraud Detection against Low Homophily in Graphs](https://mlsanity.com/paper/2302.10407/) (2023)
- [PETGEN: Personalized Text Generation Attack on Deep Sequence Embedding-based Classification Models](https://mlsanity.com/paper/2109.06777/) (2021)
- [Does DetectGPT Fully Utilize Perturbation? Bridging Selective Perturbation to Fine-tuned Contrastive Learning Detector would be Better](https://mlsanity.com/paper/2402.00263/) (2024)
- [A Survey on Deep Reinforcement Learning for Data Processing and Analytics](https://mlsanity.com/paper/2108.04526/) (2021)
- [VecAug: Unveiling Camouflaged Frauds with Cohort Augmentation for Enhanced Detection](https://mlsanity.com/paper/2408.00513/) (2024)
- [EGC2: Enhanced Graph Classification with Easy Graph Compression](https://mlsanity.com/paper/2107.07737/) (2021)
- [Counter-Empirical Attacking based on Adversarial Reinforcement Learning for Time-Relevant Scoring System](https://mlsanity.com/paper/2311.05144/) (2023)
- [Review of Metrics to Measure the Stability, Robustness and Resilience of Reinforcement Learning](https://mlsanity.com/paper/2203.12048/) (2022)
- [Data Augmentation for Supervised Graph Outlier Detection via Latent Diffusion Models](https://mlsanity.com/paper/2312.17679/) (2023)
- [CARE: Ensemble Adversarial Robustness Evaluation Against Adaptive Attackers for Security Applications](https://mlsanity.com/paper/2401.11126/) (2024)
- [Let Relations Speak: An End-to-End LLM-GNN Soft Prompt Framework for Fraud Detection](https://mlsanity.com/paper/2605.28524/) (2026)
- [Are Your Reviewers Being Treated Equally? Discovering Subgroup Structures to Improve Fairness in Spam Detection](https://mlsanity.com/paper/2204.11164/) (2022)
- [Mitigating Human and Computer Opinion Fraud via Contrastive Learning](https://mlsanity.com/paper/2301.03025/) (2023)
- [ROBAD: Robust Adversary-aware Local-Global Attended Bad Actor Detection Sequential Model](https://mlsanity.com/paper/2507.15067/) (2025)
- [User to Video: A Model for Spammer Detection Inspired by Video Classification Technology](https://mlsanity.com/paper/2510.06233/) (2025)

## Abstract (arXiv)

Online reviews provide product evaluations for customers to make decisions. Unfortunately, the evaluations can be manipulated using fake reviews ("spams") by professional spammers, who have learned increasingly insidious and powerful spamming strategies by adapting to the deployed detectors. Spamming strategies are hard to capture, as they can be varying quickly along time, different across spammers and target products, and more critically, remained unknown in most cases. Furthermore, most existing detectors focus on detection accuracy, which is not well-aligned with the goal of maintaining the trustworthiness of product evaluations. To address the challenges, we formulate a minimax game where the spammers and spam detectors compete with each other on their practical goals that are not solely based on detection accuracy. Nash equilibria of the game lead to stable detectors that are agnostic to any mixed detection strategies. However, the game has no closed-form solution and is not differentiable to admit the typical gradient-based algorithms. We turn the game into two dependent Markov Decision Processes (MDPs) to allow efficient stochastic optimization based on multi-armed bandit and policy gradient. We experiment on three large review datasets using various state-of-the-art spamming and detection strategies and show that the optimization algorithm can reliably find an equilibrial detector that can robustly and effectively prevent spammers with any mixed spamming strategies from attaining their practical goal. Our code is available at https://github.com/YingtongDou/Nash-Detect.