ECLAD: Extracting Concepts with Local Aggregated Descriptors
Not on the map. Why?
Abstract (arXiv)
Convolutional neural networks (CNNs) are increasingly being used in critical systems, where robustness and alignment are crucial. In this context, the field of explainable artificial intelligence has proposed the generation of high-level explanations of the prediction process of CNNs through concept extraction. While these methods can detect whether or not a concept is present in an image, they are unable to determine its location. What is more, a fair comparison of such approaches is difficult due to a lack of proper validation procedures. To address these issues, we propose a novel method for automatic concept extraction and localization based on representations obtained through pixel-wise aggregations of CNN activation maps. Further, we introduce a process for the validation of concept-extraction techniques based on synthetic datasets with pixel-wise annotations of their main components, reducing the need for human intervention. Extensive experimentation on both synthetic and real-world datasets demonstrates that our method outperforms state-of-the-art alternatives.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 29 of its 47 references that are in the map. First posted on arXiv 9 Jun 2022.
Builds on
29 of 47 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2018Sanity Checks for Saliency Mapscited by 1,149
- 2020Concept Bottleneck Modelscited by 1,022
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 731
17 more
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 403
- 2019On Completeness-aware Concept-Based Explanations in Deep Neural Networkscited by 239
- 2020Concept Whitening for Interpretable Image Recognitioncited by 225
- 2020A Survey on the Explainability of Supervised Machine Learningcited by 225
- 2019Explainable Machine Learning in Deploymentcited by 210
- 2019Explaining Classifiers with Causal Concept Effect (CaCE)cited by 135
- 2020Explainable deep learning models in medical image analysiscited by 111
- 2019Pruning by Explaining: A Novel Criterion for Deep Neural Network Pruningcited by 89
- 2019Explanation in Human-AI Systems: A Literature Meta-Review, Synopsis of Key Ideas and Publications, and Bibliography for Explainable AIcited by 63
- 2019Visualizing Deep Networks by Optimizing with Integrated Gradientscited by 59
- 2021This looks more like that: Enhancing Self-Explaining Models by Prototypical Relevance Propagationcited by 43
- 2021A Peek Into the Reasoning of Neural Networks: Interpreting with Structural Visual Conceptscited by 33
- 2021Best of both worlds: local and global explanations with human-understandable conceptscited by 22
- 2020Explaining Deep Neural Networks using Unsupervised Clusteringcited by 9
- 2021Unsupervised Causal Binary Concepts Discovery with VAE for Black-box Model Explanationcited by 8
- 2020Abstracting Deep Neural Networks into Concept Graphs for Concept Level Interpretabilitycited by 6
- 2021Failing Conceptually: Concept-Based Explanations of Dataset Shiftcited by 6
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 4; 2025: 4; 2026: 2.
15 papers.
Sort:
By area:
- 2023Learning Bottleneck Concepts in Image Classificationcited by 49
- 2024Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go?cited by 17
- 2023Local Concept Embeddings for Analysis of Concept Distributions in Vision DNN Feature Spacescited by 7
- 2022Automatic Infectious Disease Classification Analysis with Concept Discoverycited by 2
- 2023Scalable Concept Extraction in Industry 4.0cited by 2
- 2023SurroCBM: Concept Bottleneck Surrogate Models for Generative Post-hoc Explanationcited by 2
- 2025A Survey on Interpretability in Visual Recognitioncited by 2
- 2024Unveiling Ontological Commitment in Multi-Modal Foundation Modelscited by 1
- 2025Multi-level Neural Networks for high-dimensional parametric obstacle problemscited by 1
- 2025On Background Bias of Post-Hoc Concept Embeddings in Computer Vision DNNscited by 1
- 2025CE-FAM: Concept-Based Explanation via Fusion of Activation Mapscited by 1
- 2024The Anatomy of Adversarial Attacks: Concept-based XAI Dissectioncited by 0
3 more
- 2024PCEvE: Part Contribution Evaluation Based Model Explanation for Human Figure Drawing Assessment and Beyondcited by 0
- 2026Explaining, Verifying, and Aligning Semantic Hierarchies in Vision-Language Model Embeddingscited by 0
- 2026CENDRe: Concept Extraction with Natural Domain Representationscited by 0
- 2026CENDRe: Concept Extraction with Natural Domain Representations31 Jul 2026
- 2026Explaining, Verifying, and Aligning Semantic Hierarchies in Vision-Language Model Embeddings26 Mar 2026
- 2025CE-FAM: Concept-Based Explanation via Fusion of Activation Maps28 Sep 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025On Background Bias of Post-Hoc Concept Embeddings in Computer Vision DNNs11 Apr 2025
- 2025Multi-level Neural Networks for high-dimensional parametric obstacle problems7 Apr 2025
- 2024PCEvE: Part Contribution Evaluation Based Model Explanation for Human Figure Drawing Assessment and Beyond26 Sep 2024
- 2024Unveiling Ontological Commitment in Multi-Modal Foundation Models25 Sep 2024
- 2024Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go?20 Sep 2024
- 2024The Anatomy of Adversarial Attacks: Concept-based XAI Dissection25 Mar 2024
- 2023Local Concept Embeddings for Analysis of Concept Distributions in Vision DNN Feature Spaces24 Nov 2023
- 2023SurroCBM: Concept Bottleneck Surrogate Models for Generative Post-hoc Explanation11 Oct 2023
3 more
- 2023Scalable Concept Extraction in Industry 4.06 Jun 2023
- 2023Learning Bottleneck Concepts in Image Classification20 Apr 2023
- 2022Automatic Infectious Disease Classification Analysis with Concept Discovery28 Aug 2022
- 2023Learning Bottleneck Concepts in Image Classificationcited by 49
- 2024Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go?cited by 17
- 2023Local Concept Embeddings for Analysis of Concept Distributions in Vision DNN Feature Spacescited by 7
- 2022Automatic Infectious Disease Classification Analysis with Concept Discoverycited by 2
- 2023Scalable Concept Extraction in Industry 4.0cited by 2
- 2023SurroCBM: Concept Bottleneck Surrogate Models for Generative Post-hoc Explanationcited by 2
- 2025A Survey on Interpretability in Visual Recognitioncited by 2
- 2024Unveiling Ontological Commitment in Multi-Modal Foundation Modelscited by 1
- 2025Multi-level Neural Networks for high-dimensional parametric obstacle problemscited by 1
- 2025On Background Bias of Post-Hoc Concept Embeddings in Computer Vision DNNscited by 1
- 2025CE-FAM: Concept-Based Explanation via Fusion of Activation Mapscited by 1
- 2024The Anatomy of Adversarial Attacks: Concept-based XAI Dissectioncited by 0
12 most cited of 14 All 14 (JSON)
- 2026CENDRe: Concept Extraction with Natural Domain Representations31 Jul 2026
- 2025CE-FAM: Concept-Based Explanation via Fusion of Activation Maps28 Sep 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025On Background Bias of Post-Hoc Concept Embeddings in Computer Vision DNNs11 Apr 2025
- 2025Multi-level Neural Networks for high-dimensional parametric obstacle problems7 Apr 2025
- 2024PCEvE: Part Contribution Evaluation Based Model Explanation for Human Figure Drawing Assessment and Beyond26 Sep 2024
- 2024Unveiling Ontological Commitment in Multi-Modal Foundation Models25 Sep 2024
- 2024Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go?20 Sep 2024
- 2024The Anatomy of Adversarial Attacks: Concept-based XAI Dissection25 Mar 2024
- 2023Local Concept Embeddings for Analysis of Concept Distributions in Vision DNN Feature Spaces24 Nov 2023
- 2023SurroCBM: Concept Bottleneck Surrogate Models for Generative Post-hoc Explanation11 Oct 2023
- 2023Scalable Concept Extraction in Industry 4.06 Jun 2023
12 newest of 14 All 14 (JSON)