Constructive Approach to Bidirectional Influence between Qualia Structure and Language Emergence
Not on the map. Why?
Abstract (arXiv)
This perspective paper explores the bidirectional influence between language emergence and the relational structure of subjective experiences, termed qualia structure, and lays out a constructive approach to the intricate dependency between the two. We hypothesize that the emergence of languages with distributional semantics (e.g., syntactic-semantic structures) is linked to the coordination of internal representations shaped by experience, potentially facilitating more structured language through reciprocal influence. This hypothesized mutual dependency connects to recent advancements in AI and symbol emergence robotics, and is explored within this paper through theoretical frameworks such as the collective predictive coding. Computational studies show that neural network-based language models form systematically structured internal representations, and multimodal language models can share representations between language and perceptual information. This perspective suggests that language emergence serves not only as a mechanism creating a communication tool but also as a mechanism for allowing people to realize shared understanding of qualitative experiences. The paper discusses the implications of this bidirectional influence in the context of consciousness studies, linguistics, and cognitive science, and outlines future constructive research directions to further explore this dynamic relationship between language emergence and qualia structure.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 28 of its 116 references that are in the map. First posted on arXiv 14 Sep 2024.
Builds on
28 of 116 references.
References · 28
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Neural Discrete Representation Learningcited by 4,712
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2017Word Translation Without Parallel Datacited by 487
- 2024The Platonic Representation Hypothesiscited by 382
- 2020Emergent Multi-Agent Communication in the Deep Learning Eracited by 170
- 2017Autoencoding Variational Inference For Topic Modelscited by 169
- 2023Getting aligned on representational alignmentcited by 143
- 2016Joint Multimodal Learning with Deep Generative Modelscited by 87
- 2020Measuring Disentanglement: A Review of Metricscited by 70
- 2019Distributional Semantics and Linguistic Theorycited by 53
16 more
- 2023Large language models predict human sensory judgments across six modalitiescited by 48
- 2022A survey of multimodal deep generative modelscited by 47
- 2018How agents see things: On visual representations in an emergent language gamecited by 45
- 2019A free energy principle for a particular physicscited by 40
- 2018Symbol Emergence in Cognitive Developmental Systems: a Surveycited by 39
- 2023World Models and Predictive Coding for Cognitive and Developmental Robotics: Frontiers and Challengescited by 36
- 2015Symbol Emergence in Robotics: A Surveycited by 31
- 2020Enriching ImageNet with Human Similarity Judgments and Psychological Embeddingscited by 23
- 2019Neuro-SERKET: Development of Integrative Cognitive System through the Composition of Deep Probabilistic Generative Modelscited by 20
- 2022Emergent Communication through Metropolis-Hastings Naming Game with Deep Generative Modelscited by 16
- 2023Gromov-Wasserstein unsupervised alignment reveals structural correspondences between the color similarity structures of humans and large language modelscited by 16
- 2019Symbol Emergence as an Interpersonal Multimodal Categorizationcited by 14
- 2023Recursive Metropolis-Hastings Naming Game: Symbol Emergence in a Multi-agent System based on Probabilistic Generative Modelscited by 8
- 2024The Curious Case of Representational Alignment: Unravelling Visio-Linguistic Tasks in Emergent Communicationcited by 7
- 2023Metropolis-Hastings algorithm in joint-attention naming game: Experimental semiotics studycited by 5
- 2023Perceptual Structure in the Absence of Grounding for LLMs: The Impact of Abstractedness and Subjectivity in Color Languagecited by 4
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 2.
5 papers.
- 2024Generative Emergent Communication: Large Language Model is a Collective World Modelcited by 15
- 2026Geometry of Human Perceptual Domains Emerges Transiently in LLM Representationscited by 1
- 2025Beyond Individuals: Collective Predictive Coding for Memory, Attention, and the Emergence of Languagecited by 0
- 2025Social Comparison without Explicit Inference of Others' Reward Values: A Constructive Approach Using a Probabilistic Generative Modelcited by 0
- 2026Emergent Communication between Heterogeneous Visual Agents through Decentralized Learningcited by 0
- 2026Geometry of Human Perceptual Domains Emerges Transiently in LLM Representations27 May 2026
- 2026Emergent Communication between Heterogeneous Visual Agents through Decentralized Learning12 May 2026
- 2025Social Comparison without Explicit Inference of Others' Reward Values: A Constructive Approach Using a Probabilistic Generative Model21 Dec 2025
- 2025Beyond Individuals: Collective Predictive Coding for Memory, Attention, and the Emergence of Language20 Aug 2025
- 2024Generative Emergent Communication: Large Language Model is a Collective World Model31 Dec 2024
Similar, not cited
Close in wording, no citation either way
- 2026Emergent Language as an Approach to Conscious AI
- 2025The Mechanistic Emergence of Symbol Grounding in Language Models
- 2025Identifying Features that Shape Perceived Consciousness in Large Language Model-based AI: A Quantitative Study of Human Responses
- 2025AI Mother Tongue: Self-Emergent Communication in MARL via Endogenous Symbol Systems
- 2026From S3Q Theory to Implementation: Towards an Architecture for Machine Qualia
- 2024A Philosophical Introduction to Language Models -- Part I: Continuity With Classic Debates
- 2025Recognizing internal states in AI: evidence from patterned preferences in large language models
- 2025Artificial Phantasia: Emergent Mental Imagery in Large Language Models