Process-Guided Concept Bottleneck Model
Not on the map. Why?
Abstract (arXiv)
Concept Bottleneck Models (CBMs) improve the explainability of black-box Deep Learning (DL) by introducing intermediate semantic concepts. However, standard CBMs often overlook domain-specific relationships and causal mechanisms, and their dependence on complete concept labels limits applicability in scientific domains where supervision is sparse but processes are well defined. To address this, we propose the Process-Guided Concept Bottleneck Model (PG-CBM), an extension of CBMs which constrains learning to follow domain-defined causal mechanisms through biophysically meaningful intermediate concepts. Using above ground biomass density estimation from Earth Observation data as a case study, we show that PG-CBM reduces error and bias compared to multiple benchmarks, whilst leveraging multi-source heterogeneous training data and producing interpretable intermediate outputs. Beyond improved accuracy, PG-CBM enhances transparency, enables detection of spurious learning, and provides scientific insights, representing a step toward more trustworthy AI systems in scientific applications.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 21 of its 84 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
21 of 84 references.
References · 21
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2020Concept Bottleneck Modelscited by 1,032
- 2022Post-hoc Concept Bottleneck Modelscited by 293
- 2023Label-Free Concept Bottleneck Modelscited by 285
- 2023Multimodal Deep Learningcited by 258
- 2022Interventional Causal Representation Learningcited by 142
- 2021Do Concept Bottleneck Models Learn as Intended?cited by 116
- 2023Probabilistic Concept Bottleneck Modelscited by 101
- 2022A high-resolution canopy height model of the Earthcited by 91
9 more
- 2024Foundation Models for Remote Sensing and Earth Observation: A Surveycited by 70
- 2020Physics-Guided Machine Learning for Scientific Discovery: An Application in Simulating Lake Temperature Profilescited by 59
- 2024Stochastic Concept Bottleneck Modelscited by 51
- 2021Semantic Segmentation of Remote Sensing Images with Sparse Annotationscited by 30
- 2023Artificial intelligence to advance Earth observation: : A review of models, recent trends, and pathways forwardcited by 28
- 2024Beyond Concept Bottleneck Models: How to Make Black Boxes Intervenable?cited by 28
- 2021Global canopy height regression and uncertainty estimation from GEDI LIDAR waveforms with deep ensemblescited by 26
- 2022On Rademacher Complexity-based Generalization Bounds for Deep Learningcited by 16
- 2024Unified Deep Learning Model for Global Prediction of Aboveground Biomass, Canopy Height and Cover from High-Resolution, Multi-Sensor Satellite Imagerycited by 6
Built on by
Citing papers per year: 2026: 2.
2 papers.