3D-CBM: A Framework for Concept-Based Interpretability in Generative 3D Modeling
Not on the map. Why?
Abstract (arXiv)
This research introduces a framework for incorporating Concept Bottleneck Models (CBMs) into 3D generative architectures to address the inherent 'semantic gap' in deep geometric learning. As deep models become central to 3D content creation, explainability shifts from a peripheral feature to a fundamental requirement for trust and accountability in safety-critical domains such as healthcare and manufacturing. CBMs provide an intrinsic interpretability solution by constraining latent representations to align with human-defined concepts, yet their application to unstructured 3D data remains largely unexplored. We design, implement, and validate a formal 3D-CBM architecture that maps raw geometric inputs, including point clouds and meshes, into a multi-tiered taxonomy of interpretable primitives and functional attributes. The framework further identifies strategic datasets, such as PartNet and ShapeNet, specialized for concept-based supervision. Experimental results from a 3D part-manipulation proof-of-concept experiment demonstrate the framework's efficacy, achieving a concept prediction accuracy of 88.8% and a Chamfer Distance of 0.0115. Critically, the model enables precise test-time intervention, allowing for the interactive correction of structural errors. This work establishes a foundation for semantically-steerable 3D generation and invites further exploration into collaborative human-in-the-loop design systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 22 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
17 of 22 references.
References · 17
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2022Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classificationcited by 312
- 2022Post-hoc Concept Bottleneck Modelscited by 293
- 2023Label-Free Concept Bottleneck Modelscited by 285
- 2023State of the Art on Diffusion Models for Visual Computingcited by 127
- 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
- 2023Generative AI meets 3D: A Survey on Text-to-3D in AIGC Eracited by 61
- 2024Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Surveycited by 52
5 more
- 2024A Survey On Text-to-3D Contents Generation In The Wildcited by 14
- 2024Explainability of Point Cloud Neural Networks Using SMILE: Statistical Model-Agnostic Interpretability with Local Explanationscited by 4
- 2025Interpretable 3D Neural Object Volumes for Robust Conceptual Reasoningcited by 2
- 2025Human-in-the-Loop: Quantitative Evaluation of 3D Models Generation by Large Language Modelscited by 2
- 2026Interpretable Aneurysm Classification via 3D Concept Bottleneck Models: Integrating Morphological and Hemodynamic Clinical Featurescited by 1
Built on by
Not cited yet.