Weakly supervised concept Bottleneck Learning for Robust Two stage Object centric visual reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Two-stage neuro-symbolic architectures provide an elegant paradigm for visual problem solving by cleanly separating connectionist perception of predefined symbols from possibly later defined relational reasoning thereon. However, anchoring high-level predicates into visual frames typically necessitates annotations that are expensive to acquire. In this work, we introduce the Dynamic Orthogonal Concept Bottleneck (D-OCB), an object-centric slot- VAE framework designed to extract human-aligned symbolic predicates under extremely weak supervision. D-OCB eliminates the arduous manual tuning of loss-balancing coef- ficients by dynamically learning optimal hyperparameter allocations during training. To infuse prior knowledge on independence of concept categories, in addition to standard re- construction self-supervision we penalize correlation across concept subspaces. Crucially, to combat the instability of very low supervision regimes, D-OCB incorporates a dynamic di- mensionality allocation mechanism; this adaptive formulation allows well-represented con- cepts to yield latent dimensions to underperforming concepts that are lagging behind, effectively preventing representation collapse and significantly improving overall concept accuracy. Through an extensive empirical evaluation, we demonstrate that our framework achieves high concept alignment and downstream visual reasoning accuracy using minimal label budgets, matching or outperforming end-to-end paradigms.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 67 references that are in the map. First posted on arXiv 23 Aug 2026.
Builds on
30 of 67 references.
Closest ancestors · 1
Same direction, newest first
Other references · 29
- 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 378
- 2020Inductive Biases for Deep Learning of Higher-Level Cognitioncited by 275
- 2022Bridging the Gap to Real-World Object-Centric Learningcited by 220
- 2019Diagnosing and Enhancing VAE Modelscited by 193
- 2018Isolating Sources of Disentanglement in Variational Autoencoderscited by 167
- 2022Signal Propagation in Transformers: Theoretical Perspectives and the Role of Rank Collapsecited by 141
- 2019Don't Blame the ELBO! A Linear VAE Perspective on Posterior Collapsecited by 121
- 2019Spatial Broadcast Decoder: A Simple Architecture for Learning Disentangled Representations in VAEscited by 117
- 2018Robustly Disentangled Causal Mechanisms: Validating Deep Representations for Interventional Robustnesscited by 108
- 2023Probabilistic Concept Bottleneck Modelscited by 101
- 2020Right for the Right Concept: Revising Neuro-Symbolic Concepts by Interacting with their Explanationscited by 94
- 2023Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcutscited by 63
17 more
- 2022Concept Embedding Models: Beyond the Accuracy-Explainability Trade-Offcited by 61
- 2023Posterior Collapse and Latent Variable Non-identifiabilitycited by 57
- 2020Balancing reconstruction error and Kullback-Leibler divergence in Variational Autoencoderscited by 30
- 2018The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesionscited by 26
- 2021Differentiable Inductive Logic Programming for Structured Examplescited by 26
- 2024SOLD: Slot Object-Centric Latent Dynamics Models for Relational Manipulation Learning from Pixelscited by 24
- 2023Slot-VAE: Object-Centric Scene Generation with Slot Attentioncited by 20
- 2026Unified Latents (UL): How to train your latentscited by 20
- 2021Neuro-Symbolic Forward Reasoningcited by 16
- 2024SymbolicAI: A framework for logic-based approaches combining generative models and solverscited by 16
- 2024Unity by Diversity: Improved Representation Learning in Multimodal VAEscited by 14
- 2025CTRL-O: Language-Controllable Object-Centric Visual Representation Learningcited by 12
- 2025MetaSlot: Break Through the Fixed Number of Slots in Object-Centric Learningcited by 11
- 2018DeepProbLog: Neural Probabilistic Logic Programmingcited by 6
- 2024Simple and Effective Transfer Learning for Neuro-Symbolic Integrationcited by 2
- 2025Enhancing Symbolic Machine Learning by Subsymbolic Representationscited by 2
- 2025Walking the Web of Concept-Class Relationships in Incrementally Trained Interpretable Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Weakly Supervised Concept Learning for Object-centric Visual Reasoning
- 2024LARS-VSA: A Vector Symbolic Architecture For Learning with Abstract Rules
- 2025Flexible Concept Bottleneck Model
- 2025Neurosymbolic Object-Centric Learning with Distant Supervision
- 2024VLG-CBM: Training Concept Bottleneck Models with Vision-Language Guidance
- 2026Symbolic Grounding Reveals Representational Bottlenecks in Abstract Visual Reasoning
- 2026Concept Flow Models: Anchoring Concept-Based Reasoning with Hierarchical Bottlenecks
- 2026Bridging Vision and Language Concepts through Optimal Transport Semantic Flow