mlsanityData to 7 Oct 2026

Hidden in Plain Sight: Undetectable Adversarial Bias Attacks on Vulnerable Patient Populations

arXiv 2402.05713 ↗First posted 8 Feb 2024cs.LG cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The proliferation of artificial intelligence (AI) in radiology has shed light on the risk of deep learning (DL) models exacerbating clinical biases towards vulnerable patient populations. While prior literature has focused on quantifying biases exhibited by trained DL models, demographically targeted adversarial bias attacks on DL models and its implication in the clinical environment remains an underexplored field of research in medical imaging. In this work, we demonstrate that demographically targeted label poisoning attacks can introduce undetectable underdiagnosis bias in DL models. Our results across multiple performance metrics and demographic groups like sex, age, and their intersectional subgroups show that adversarial bias attacks demonstrate high-selectivity for bias in the targeted group by degrading group model performance without impacting overall model performance. Furthermore, our results indicate that adversarial bias attacks result in biased DL models that propagate prediction bias even when evaluated with external datasets.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 25 references that are in the map. First posted on arXiv 8 Feb 2024.

Builds on

6 of 25 references.

References · 6

  1. 2019Identifying and Correcting Label Bias in Machine Learningcited by 146
  2. 2018Adversarial Attacks Against Medical Deep Learning Systemscited by 61
  3. 2020On the limits of cross-domain generalization in automated X-ray predictioncited by 61
  4. 2022Improving the Fairness of Chest X-ray Classifierscited by 52
  5. 2023Label Poisoning is All You Needcited by 27
  6. 2019A Strong Baseline for Domain Adaptation and Generalization in Medical Imagingcited by 11

Built on by

Not cited yet.