Attack logics, not outputs: Towards efficient robustification of deep neural networks by falsifying concept-based properties
Not on the map. Why?
Abstract (arXiv)
Deep neural networks (NNs) for computer vision are vulnerable to adversarial attacks, i.e., miniscule malicious changes to inputs may induce unintuitive outputs. One key approach to verify and mitigate such robustness issues is to falsify expected output behavior. This allows, e.g., to locally proof security, or to (re)train NNs on obtained adversarial input examples. Due to the black-box nature of NNs, current attacks only falsify a class of the final output, such as flipping from textttstopsign to negtextttstopsign. In this short position paper we generalize this to search for generally illogical behavior, as considered in NN verification: falsify constraints (concept-based properties) involving further human-interpretable concepts, like textttredwedgetextttoctogonalrightarrowtextttstopsign. For this, an easy implementation of concept-based properties on already trained NNs is proposed using techniques from explainable artificial intelligence. Further, we sketch the theoretical proof that attacks on concept-based properties are expected to have a reduced search space compared to simple class falsification, whilst arguably be more aligned with intuitive robustness targets. As an outlook to this work in progress we hypothesize that this approach has potential to efficiently and simultaneously improve logical compliance and robustness.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 52 references that are in the map. First posted on arXiv 1 Oct 2025.
Builds on
40 of 52 references.
References · 40
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2013Intriguing properties of neural networkscited by 5,114
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2020Concept Bottleneck Modelscited by 1,022
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 833
- 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 703
- 2017One pixel attack for fooling deep neural networkscited by 579
- 2017Interpretation of Neural Networks is Fragilecited by 443
- 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 440
- 2022Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classificationcited by 310
28 more
- 2022Post-hoc Concept Bottleneck Modelscited by 289
- 2023Label-Free Concept Bottleneck Modelscited by 282
- 2017A Semantic Loss Function for Deep Learning with Symbolic Knowledgecited by 267
- 2019Algorithms for Verifying Deep Neural Networkscited by 221
- 2020Logic Tensor Networkscited by 197
- 2020Skip Connections Matter: On the Transferability of Adversarial Examples Generated with ResNetscited by 165
- 2022CLIP-Dissect: Automatic Description of Neuron Representations in Deep Vision Networkscited by 144
- 2018Net2Vec: Quantifying and Explaining how Concepts are Encoded by Filters in Deep Neural Networkscited by 128
- 2020Invertible Concept-based Explanations for CNN Models with Non-negative Concept Activation Vectorscited by 119
- 2018Scenic: A Language for Scenario Specification and Scene Generationcited by 79
- 2023Boosting Adversarial Transferability by Block Shuffle and Rotationcited by 64
- 2022Concept Activation Regions: A Generalized Framework For Concept-Based Explanationscited by 57
- 2018Concolic Testing for Deep Neural Networkscited by 51
- 2022ROAD-R: The Autonomous Driving Dataset with Logical Requirementscited by 34
- 2024Physical 3D Adversarial Attacks against Monocular Depth Estimation in Autonomous Drivingcited by 32
- 2019Regression Concept Vectors for Bidirectional Explanations in Histopathologycited by 31
- 2024PURE: Turning Polysemantic Neurons Into Pure Features by Identifying Relevant Circuitscited by 29
- 2024Learning to Transform Dynamically for Better Adversarial Transferabilitycited by 23
- 2022Neuro-Symbolic Verification of Deep Neural Networkscited by 21
- 2024Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go?cited by 17
- 2022Adversarial Laser Spot: Robust and Covert Physical-World Attack to DNNscited by 11
- 2019Towards Safety Verification of Direct Perception Neural Networkscited by 9
- 2021Verification of Size Invariance in DNN Activations using Concept Embeddingscited by 9
- 2021Making Corgis Important for Honeycomb Classification: Adversarial Attacks on Concept-based Explainability Toolscited by 9
- 2022Enabling Verification of Deep Neural Networks in Perception Tasks Using Fuzzy Logic and Concept Embeddingscited by 7
- 2023Local Concept Embeddings for Analysis of Concept Distributions in Vision DNN Feature Spacescited by 7
- 2024Concept-based Analysis of Neural Networks via Vision-Language Modelscited by 6
- 2024Improving Neural-based Classification with Logical Background Knowledgecited by 2
Built on by
Not cited yet.