# Randomized Prediction Games for Adversarial Machine Learning

arXiv: https://arxiv.org/abs/1609.00804 · HTML: https://mlsanity.com/paper/1609.00804/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Sep 2016.

## Built on by (most cited first, 11 of 11)

- [The Many Faces of Adversarial Risk](https://mlsanity.com/paper/2201.08956/) (2022)
- [Mixed Nash Equilibria in the Adversarial Examples Game](https://mlsanity.com/paper/2102.06905/) (2021)
- [Balance, Imbalance, and Rebalance: Understanding Robust Overfitting from a Minimax Game Perspective](https://mlsanity.com/paper/2310.19360/) (2023)
- [Nash Equilibria and Pitfalls of Adversarial Training in Adversarial Robustness Games](https://mlsanity.com/paper/2210.12606/) (2022)
- [Classification under strategic adversary manipulation using pessimistic bilevel optimisation](https://mlsanity.com/paper/2410.20284/) (2024)
- [Position: Towards Resilience Against Adversarial Examples](https://mlsanity.com/paper/2405.01349/) (2024)
- [Scalable Optimal Classifiers for Adversarial Settings under Uncertainty](https://mlsanity.com/paper/2106.14702/) (2021)
- [Adversarial Machine Learning for Cybersecurity and Computer Vision: Current Developments and Challenges](https://mlsanity.com/paper/2107.02894/) (2021)
- [Towards Optimal Randomized Strategies in Adversarial Example Game](https://mlsanity.com/paper/2306.16738/) (2023)
- [Countering adversarial evasion in regression analysis](https://mlsanity.com/paper/2509.22113/) (2025)
- [Adversarial training with restricted data manipulation](https://mlsanity.com/paper/2510.03254/) (2025)

## Abstract (arXiv)

In spam and malware detection, attackers exploit randomization to obfuscate malicious data and increase their chances of evading detection at test time; e.g., malware code is typically obfuscated using random strings or byte sequences to hide known exploits. Interestingly, randomization has also been proposed to improve security of learning algorithms against evasion attacks, as it results in hiding information about the classifier to the attacker. Recent work has proposed game-theoretical formulations to learn secure classifiers, by simulating different evasion attacks and modifying the classification function accordingly. However, both the classification function and the simulated data manipulations have been modeled in a deterministic manner, without accounting for any form of randomization. In this work, we overcome this limitation by proposing a randomized prediction game, namely, a non-cooperative game-theoretic formulation in which the classifier and the attacker make randomized strategy selections according to some probability distribution defined over the respective strategy set. We show that our approach allows one to improve the trade-off between attack detection and false alarms with respect to state-of-the-art secure classifiers, even against attacks that are different from those hypothesized during design, on application examples including handwritten digit recognition, spam and malware detection.
