Visual Categorization Across Minds and Models: Cognitive Analysis of Human Labeling and Neuro-Symbolic Integration
Not on the map. Why?
Abstract (arXiv)
Understanding how humans and AI systems interpret ambiguous visual stimuli offers critical insight into the nature of perception, reasoning, and decision-making. This paper examines image labeling performance across human participants and deep neural networks, focusing on low-resolution, perceptually degraded stimuli. Drawing from computational cognitive science, cognitive architectures, and connectionist-symbolic hybrid models, we contrast human strategies such as analogical reasoning, shape-based recognition, and confidence modulation with AI's feature-based processing. Grounded in Marr's tri-level hypothesis, Simon's bounded rationality, and Thagard's frameworks of representation and emotion, we analyze participant responses in relation to Grad-CAM visualizations of model attention. Human behavior is further interpreted through cognitive principles modeled in ACT-R and Soar, revealing layered and heuristic decision strategies under uncertainty. Our findings highlight key parallels and divergences between biological and artificial systems in representation, inference, and confidence calibration. The analysis motivates future neuro-symbolic architectures that unify structured symbolic reasoning with connectionist representations. Such architectures, informed by principles of embodiment, explainability, and cognitive alignment, offer a path toward AI systems that are not only performant but also interpretable and cognitively grounded.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 46 references that are in the map. First posted on arXiv 10 Dec 2025.
Builds on
9 of 46 references.
References · 9
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
- 2020Neurosymbolic AI: The 3rd Wavecited by 253
- 2017The Consciousness Priorcited by 105
- 2022Contributions of Shape, Texture, and Color in Visual Recognitioncited by 16
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Visual cognition in multimodal large language models
- 2026A Framework for Generating Semantically Ambiguous Images to Probe Human and Machine Perception
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers
- 2025Artificial Phantasia: Emergent Mental Imagery in Large Language Models
- 2026CogGym: Towards Large-Scale Comparative Evaluation of Human and Machine Cognition
- 2025Grounding Agent Reasoning in Image Schemas: A Neurosymbolic Approach to Embodied Cognition
- 2022Zero-shot visual reasoning through probabilistic analogical mapping
- 2024Dual Thinking and Logical Processing -- Are Multi-modal Large Language Models Closing the Gap with Human Vision ?