Interactive Concept Bottleneck Models
Not on the map. Why?
Abstract (arXiv)
Concept bottleneck models (CBMs) are interpretable neural networks that first predict labels for human-interpretable concepts relevant to the prediction task, and then predict the final label based on the concept label predictions. We extend CBMs to interactive prediction settings where the model can query a human collaborator for the label to some concepts. We develop an interaction policy that, at prediction time, chooses which concepts to request a label for so as to maximally improve the final prediction. We demonstrate that a simple policy combining concept prediction uncertainty and influence of the concept on the final prediction achieves strong performance and outperforms static approaches as well as active feature acquisition methods proposed in the literature. We show that the interactive CBM can achieve accuracy gains of 5-10% with only 5 interactions over competitive baselines on the Caltech-UCSD Birds, CheXpert and OAI datasets.
Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). Builds on 7 of its 15 references that are in the map. First posted on arXiv 14 Dec 2022.
Builds on
7 of 15 references.
References · 7
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2020Concept Bottleneck Modelscited by 1,022
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 396
- 2018EDDI: Efficient Dynamic Discovery of High-Value Information with Partial VAEcited by 85
- 2020Active Feature Acquisition with Generative Surrogate Modelscited by 53
- 2020Debiasing Concept-based Explanations with Causal Analysiscited by 32
- 2021Rationalization through Conceptscited by 19
Built on by
Citing papers per year: 2023: 13; 2024: 27; 2025: 21; 2026: 18.
79 papers.
Sort:
By area:
- 2023Probabilistic Concept Bottleneck Modelscited by 101
- 2024Discover-then-Name: Task-Agnostic Concept Bottlenecks via Automated Concept Discoverycited by 91
- 2023A Closer Look at the Intervention Procedure of Concept Bottleneck Modelscited by 63
- 2024Stochastic Concept Bottleneck Modelscited by 49
- 2023Learning to Receive Help: Intervention-Aware Concept Embedding Modelscited by 41
- 2023Robust and Interpretable Medical Image Classifiers via Concept Bottleneck Modelscited by 40
- 2023Human Uncertainty in Concept-Based AI Systemscited by 39
- 2023Auxiliary Losses for Learning Generalizable Concept-based Modelscited by 35
- 2023Learning to Intervene on Concept Bottleneckscited by 29
- 2024Beyond Concept Bottleneck Models: How to Make Black Boxes Intervenable?cited by 28
- 2024Interpretable Concept Bottlenecks to Align Reinforcement Learning Agentscited by 23
- 2023Interpretability is in the Mind of the Beholder: A Causal Framework for Human-interpretable Representation Learningcited by 22
38 more
- 2024Editable Concept Bottleneck Modelscited by 22
- 2024Semi-supervised Concept Bottleneck Modelscited by 21
- 2024Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlookscited by 18
- 2025A Comprehensive Survey on Self-Interpretable Neural Networkscited by 18
- 2024Learning Discrete Concepts in Latent Hierarchical Modelscited by 17
- 2024Pre-trained Vision-Language Models Learn Discoverable Visual Conceptscited by 16
- 2025If Concept Bottlenecks are the Question, are Foundation Models the Answer?cited by 15
- 2024Understanding Inter-Concept Relationships in Concept-Based Modelscited by 13
- 2025Leakage and Interpretability in Concept-Based Modelscited by 13
- 2025Discovering Fine-Grained Visual-Concept Relations by Disentangled Optimal Transport Concept Bottleneck Modelscited by 12
- 2024Do Concept Bottleneck Models Respect Localities?cited by 10
- 2023A Framework for Interpretability in Machine Learning for Medical Imagingcited by 9
- 2024Towards Interpretable Radiology Report Generation via Concept Bottlenecks using a Multi-Agentic RAGcited by 9
- 2025Avoiding Leakage Poisoning: Concept Interventions Under Distribution Shiftscited by 9
- 2026Human-AI Co-design for Clinical Prediction Modelscited by 9
- 2025Addressing Concept Mislabeling in Concept Bottleneck Models Through Preference Optimizationcited by 7
- 2023Selective Concept Models: Permitting Stakeholder Customisation at Test-Timecited by 6
- 2024Improving Intervention Efficacy via Concept Realignment in Concept Bottleneck Modelscited by 6
- 2024EQ-CBM: A Probabilistic Concept Bottleneck with Energy-based Models and Quantized Vectorscited by 6
- 2024Towards Multi-dimensional Explanation Alignment for Medical Classificationcited by 6
- 2023Transparent Anomaly Detection via Concept-based Explanationscited by 5
- 2023Benchmarking and Enhancing Disentanglement in Concept-Residual Modelscited by 5
- 2025LogicCBMs: Logic-Enhanced Concept-Based Learningcited by 5
- 2023A Survey of Explainable AI in Deep Visual Modeling: Methods and Metricscited by 4
- 2024Can we Constrain Concept Bottleneck Models to Learn Semantically Meaningful Input Features?cited by 4
- 2024Improving deep learning with prior knowledge and cognitive models: A survey on enhancing explainability, adversarial robustness and zero-shot learningcited by 4
- 2024LICORICE: Label-Efficient Concept-Based Interpretable Reinforcement Learningcited by 4
- 2024Learning New Concepts, Remembering the Old: Continual Learning for Multimodal Concept Bottleneck Modelscited by 4
- 2025CBVLM: Training-free Explainable Concept-based Large Vision Language Models for Medical Image Classificationcited by 4
- 2025A Comprehensive Survey on the Risks and Limitations of Concept-based Modelscited by 4
- 2026Actionable Interpretability Must Be Defined in Terms of Symmetriescited by 4
- 2024Incorporating Expert Rules into Neural Networks in the Framework of Concept-Based Learningcited by 3
- 2024Concept Complement Bottleneck Model for Interpretable Medical Image Diagnosiscited by 3
- 2024Guarding the Gate: ConceptGuard Battles Concept-Level Backdoors in Concept Bottleneck Modelscited by 3
- 2025Stable Vision Concept Transformers for Medical Diagnosiscited by 3
- 2025Interpretable Reward Modeling with Active Concept Bottleneckscited by 3
- 2025A Geometric Unification of Concept Learning with Concept Conescited by 3
- 2024MINT: A wrapper to make multi-modal and multi-image AI models interactivecited by 2
50 most cited of 79 All 79 (JSON)
- 2026Interpretable but Fragile? Robustness of Concept Bottlenecks under Geometric-Semantic Perturbations29 Sep 2026
- 2026How to make effective use of domain experts for image classification?15 Sep 2026
- 2026The Neural Division of Labor: Biologically-Inspired Modular Architectures for Robust Neuromorphic Computing8 Aug 2026
- 2026Caption Bottleneck Models1 Jul 2026
- 2026On the Faithfulness of Post-Hoc Concept Bottleneck Models29 Jun 2026
- 2026Concept Flow Models: Anchoring Concept-Based Reasoning with Hierarchical Bottlenecks17 Jun 2026
- 2026In Defense of Information Leakage in Concept-based Models9 Jun 2026
- 2026Learning Label-Efficient Interpretable Medical Image Diagnosis via Semi-supervised Hypergraph Concept Bottleneck Model1 Jun 2026
- 2026ConceptM3oE: Concept-Guided Multimodal Mixture of Experts for Interpretable Computational Pathology23 May 2026
- 2026Matryoshka Concept Bottleneck Models20 May 2026
- 2026CLIF: Concept-Level Influence Functions for Transparent Bottleneck Models19 May 2026
- 2026SCoCCA: Multi-modal Sparse Concept Decomposition via Canonical Correlation Analysis14 Mar 2026
38 more
- 2026Causal Neural Probabilistic Circuits2 Mar 2026
- 2026Uncertainty-aware Language Guidance for Concept Bottleneck Models26 Feb 2026
- 2026Knowing the Unknown: Interpretable Open-World Object Detection via Concept Decomposition Model24 Feb 2026
- 2026Actionable Interpretability Must Be Defined in Terms of Symmetries19 Jan 2026
- 2026Human-AI Co-design for Clinical Prediction Models14 Jan 2026
- 2026Controllable Concept Bottleneck Models1 Jan 2026
- 2025LogicCBMs: Logic-Enhanced Concept-Based Learning8 Dec 2025
- 2025A Geometric Unification of Concept Learning with Concept Cones8 Dec 2025
- 2025CLMN: Concept based Language Models via Neural Symbolic Reasoning11 Oct 2025
- 2025Post-hoc Stochastic Concept Bottleneck Models9 Oct 2025
- 2025Concepts in Motion: Temporal Concept Bottleneck Model for Interpretable Video Classification25 Sep 2025
- 2025Debugging Concept Bottleneck Models through Removal and Retraining23 Sep 2025
- 2025Chat-CBM: Towards Interactive Concept Bottleneck Models with Frozen Large Language Models22 Sep 2025
- 2025Interpretable Reward Modeling with Active Concept Bottlenecks7 Jul 2025
- 2025Intervening in Black Box: Concept Bottleneck Model for Enhancing Human Neural Network Mutual Understanding28 Jun 2025
- 2025Stable Vision Concept Transformers for Medical Diagnosis5 Jun 2025
- 2025A Comprehensive Survey on the Risks and Limitations of Concept-based Models25 May 2025
- 2025Discovering Fine-Grained Visual-Concept Relations by Disentangled Optimal Transport Concept Bottleneck Models12 May 2025
- 2025If Concept Bottlenecks are the Question, are Foundation Models the Answer?28 Apr 2025
- 2025Addressing Concept Mislabeling in Concept Bottleneck Models Through Preference Optimization25 Apr 2025
- 2025Avoiding Leakage Poisoning: Concept Interventions Under Distribution Shifts24 Apr 2025
- 2025Leakage and Interpretability in Concept-Based Models18 Apr 2025
- 2025Prototype Guided Backdoor Defense26 Mar 2025
- 2025Factor Graph-based Interpretable Neural Networks20 Feb 2025
- 2025Survival Concept-Based Learning Models9 Feb 2025
- 2025A Comprehensive Survey on Self-Interpretable Neural Networks26 Jan 2025
- 2025CBVLM: Training-free Explainable Concept-based Large Vision Language Models for Medical Image Classification21 Jan 2025
- 2024Towards Interpretable Radiology Report Generation via Concept Bottlenecks using a Multi-Agentic RAG20 Dec 2024
- 2024Learning New Concepts, Remembering the Old: Continual Learning for Multimodal Concept Bottleneck Models25 Nov 2024
- 2024Guarding the Gate: ConceptGuard Battles Concept-Level Backdoors in Concept Bottleneck Models25 Nov 2024
- 2024Towards Multi-dimensional Explanation Alignment for Medical Classification28 Oct 2024
- 2024Concept Complement Bottleneck Model for Interpretable Medical Image Diagnosis20 Oct 2024
- 2024CAT: Concept-level backdoor ATtacks for Concept Bottleneck Models7 Oct 2024
- 2024Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlooks3 Oct 2024
- 2024EQ-CBM: A Probabilistic Concept Bottleneck with Energy-based Models and Quantized Vectors22 Sep 2024
- 2024LICORICE: Label-Efficient Concept-Based Interpretable Reinforcement Learning22 Jul 2024
- 2024Discover-then-Name: Task-Agnostic Concept Bottlenecks via Automated Concept Discovery19 Jul 2024
- 2024FI-CBL: A Probabilistic Method for Concept-Based Learning with Expert Rules28 Jun 2024
50 newest of 79 All 79 (JSON)
- 2026SCoCCA: Multi-modal Sparse Concept Decomposition via Canonical Correlation Analysiscited by 1
- 2025CLMN: Concept based Language Models via Neural Symbolic Reasoningcited by 0
- 2026ConceptM3oE: Concept-Guided Multimodal Mixture of Experts for Interpretable Computational Pathologycited by 0
- 2026Concept Flow Models: Anchoring Concept-Based Reasoning with Hierarchical Bottleneckscited by 0
- 2026Concept Flow Models: Anchoring Concept-Based Reasoning with Hierarchical Bottlenecks17 Jun 2026
- 2026ConceptM3oE: Concept-Guided Multimodal Mixture of Experts for Interpretable Computational Pathology23 May 2026
- 2026SCoCCA: Multi-modal Sparse Concept Decomposition via Canonical Correlation Analysis14 Mar 2026
- 2025CLMN: Concept based Language Models via Neural Symbolic Reasoning11 Oct 2025
- 2023Probabilistic Concept Bottleneck Modelscited by 101
- 2024Discover-then-Name: Task-Agnostic Concept Bottlenecks via Automated Concept Discoverycited by 91
- 2023A Closer Look at the Intervention Procedure of Concept Bottleneck Modelscited by 63
- 2024Stochastic Concept Bottleneck Modelscited by 49
- 2023Learning to Receive Help: Intervention-Aware Concept Embedding Modelscited by 41
- 2023Robust and Interpretable Medical Image Classifiers via Concept Bottleneck Modelscited by 40
- 2023Human Uncertainty in Concept-Based AI Systemscited by 39
- 2023Auxiliary Losses for Learning Generalizable Concept-based Modelscited by 35
- 2023Learning to Intervene on Concept Bottleneckscited by 29
- 2024Beyond Concept Bottleneck Models: How to Make Black Boxes Intervenable?cited by 28
- 2024Interpretable Concept Bottlenecks to Align Reinforcement Learning Agentscited by 23
- 2023Interpretability is in the Mind of the Beholder: A Causal Framework for Human-interpretable Representation Learningcited by 22
12 most cited of 68 All 68 (JSON)
- 2026Interpretable but Fragile? Robustness of Concept Bottlenecks under Geometric-Semantic Perturbations29 Sep 2026
- 2026How to make effective use of domain experts for image classification?15 Sep 2026
- 2026The Neural Division of Labor: Biologically-Inspired Modular Architectures for Robust Neuromorphic Computing8 Aug 2026
- 2026Caption Bottleneck Models1 Jul 2026
- 2026In Defense of Information Leakage in Concept-based Models9 Jun 2026
- 2026Learning Label-Efficient Interpretable Medical Image Diagnosis via Semi-supervised Hypergraph Concept Bottleneck Model1 Jun 2026
- 2026Matryoshka Concept Bottleneck Models20 May 2026
- 2026CLIF: Concept-Level Influence Functions for Transparent Bottleneck Models19 May 2026
- 2026Causal Neural Probabilistic Circuits2 Mar 2026
- 2026Uncertainty-aware Language Guidance for Concept Bottleneck Models26 Feb 2026
- 2026Knowing the Unknown: Interpretable Open-World Object Detection via Concept Decomposition Model24 Feb 2026
- 2026Actionable Interpretability Must Be Defined in Terms of Symmetries19 Jan 2026
12 newest of 68 All 68 (JSON)