mlsanityData to 14 Oct 2026

Adversarial Robustness of Bottleneck Injected Deep Neural Networks for Task-Oriented Communication

arXiv 2412.10265 ↗First posted 13 Dec 2024cs.LG cs.DC cs.NIcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper investigates the adversarial robustness of Deep Neural Networks (DNNs) using Information Bottleneck (IB) objectives for task-oriented communication systems. We empirically demonstrate that while IB-based approaches provide baseline resilience against attacks targeting downstream tasks, the reliance on generative models for task-oriented communication introduces new vulnerabilities. Through extensive experiments on several datasets, we analyze how bottleneck depth and task complexity influence adversarial robustness. Our key findings show that Shallow Variational Bottleneck Injection (SVBI) provides less adversarial robustness compared to Deep Variational Information Bottleneck (DVIB) approaches, with the gap widening for more complex tasks. Additionally, we reveal that IB-based objectives exhibit stronger robustness against attacks focusing on salient pixels with high intensity compared to those perturbing many pixels with lower intensity. Lastly, we demonstrate that task-oriented communication systems that rely on generative models to extract and recover salient information have an increased attack surface. The results highlight important security considerations for next-generation communication systems that leverage neural networks for goal-oriented compression.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 27 references that are in the map. First posted on arXiv 13 Dec 2024.

Builds on

17 of 27 references.

References · 17

  1. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  2. 2013Intriguing properties of neural networkscited by 5,155
  3. 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
  4. 2016Deep Variational Information Bottleneckcited by 930
  5. 2015Deep Learning and the Information Bottleneck Principlecited by 802
  6. 2015The Limitations of Deep Learning in Adversarial Settingscited by 790
  7. 2017Opening the Black Box of Deep Neural Networks via Informationcited by 503
  8. 2018Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Surveycited by 460
  9. 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 175
  10. 2020Torchattacks: A PyTorch Repository for Adversarial Attackscited by 158
  11. 2017EAD: Elastic-Net Attacks to Deep Neural Networks via Adversarial Examplescited by 155
  12. 2021Lossy Compression for Lossless Predictioncited by 52
5 more
  1. 2020End-to-end Learning of Compressible Featurescited by 43
  2. 2021Supervised Compression for Resource-Constrained Edge Computing Systemscited by 31
  3. 2016Adversarial Images for Variational Autoencoderscited by 19
  4. 2024FOOL: Addressing the Downlink Bottleneck in Satellite Computing with Neural Feature Compressioncited by 6
  5. 2023Task-Oriented Communication Design at Scalecited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.