Spontaneous emergence of linguistic statistical laws in images via artificial neural networks
Not on the map. Why?
Abstract (arXiv)
As a core element of culture, images transform perception into structured representations and undergo evolution similar to natural languages. Given that visual input accounts for 60% of human sensory experience, it is natural to ask whether images follow statistical regularities similar to those in linguistic systems. Guided by symbol-grounding theory, which posits that meaningful symbols originate from perception, we treat images as vision-centric artifacts and employ pre-trained neural networks to model visual processing. By detecting kernel activations and extracting pixels, we obtain text-like units, which reveal that these image-derived representations adhere to statistical laws such as Zipf's, Heaps', and Benford's laws, analogous to linguistic data. Notably, these statistical regularities emerge spontaneously, without the need for explicit symbols or hybrid architectures. Our results indicate that connectionist networks can automatically develop structured, quasi-symbolic units through perceptual processing alone, suggesting that text- and symbol-like properties can naturally emerge from neural networks and providing a novel perspective for interpretation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 58 references that are in the map. First posted on arXiv 26 Jan 2025.
Builds on
18 of 58 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2020Knowledge Graphscited by 621
- 2019Adversarial Examples Are a Natural Consequence of Test Error in Noisecited by 114
- 2018Benchmarking Neural Network Robustness to Common Corruptions and Surface Variationscited by 99
- 2024Toward Visual Grounding: A Surveycited by 52
6 more
- 2023The Vector Grounding Problemcited by 39
- 2020Unsupervised deep learning identifies semantic disentanglement in single inferotemporal neuronscited by 33
- 2024A Survey on Text-guided 3D Visual Grounding: Elements, Recent Advances, and Future Directionscited by 25
- 2021Emergent Graphical Conventions in a Visual Communication Gamecited by 16
- 2024Unsupervised, Bottom-up Category Discovery for Symbol Grounding with a Curious Robotcited by 2
- 2023In-depth analysis of music structure as a text networkcited by 1
Built on by
Not cited yet.