mlsanityData to 14 Oct 2026

Constructive Approach to Bidirectional Influence between Qualia Structure and Language Emergence

arXiv 2409.09413 ↗First posted 14 Sep 2024cs.CL cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

This perspective paper explores the bidirectional influence between language emergence and the relational structure of subjective experiences, termed qualia structure, and lays out a constructive approach to the intricate dependency between the two. We hypothesize that the emergence of languages with distributional semantics (e.g., syntactic-semantic structures) is linked to the coordination of internal representations shaped by experience, potentially facilitating more structured language through reciprocal influence. This hypothesized mutual dependency connects to recent advancements in AI and symbol emergence robotics, and is explored within this paper through theoretical frameworks such as the collective predictive coding. Computational studies show that neural network-based language models form systematically structured internal representations, and multimodal language models can share representations between language and perceptual information. This perspective suggests that language emergence serves not only as a mechanism creating a communication tool but also as a mechanism for allowing people to realize shared understanding of qualitative experiences. The paper discusses the implications of this bidirectional influence in the context of consciousness studies, linguistics, and cognitive science, and outlines future constructive research directions to further explore this dynamic relationship between language emergence and qualia structure.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 28 of its 116 references that are in the map. First posted on arXiv 14 Sep 2024.

Builds on

28 of 116 references.

References · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2017Neural Discrete Representation Learningcited by 4,712
  3. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  4. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  5. 2017Word Translation Without Parallel Datacited by 487
  6. 2024The Platonic Representation Hypothesiscited by 382
  7. 2020Emergent Multi-Agent Communication in the Deep Learning Eracited by 170
  8. 2017Autoencoding Variational Inference For Topic Modelscited by 169
  9. 2023Getting aligned on representational alignmentcited by 143
  10. 2016Joint Multimodal Learning with Deep Generative Modelscited by 87
  11. 2020Measuring Disentanglement: A Review of Metricscited by 70
  12. 2019Distributional Semantics and Linguistic Theorycited by 53
16 more
  1. 2023Large language models predict human sensory judgments across six modalitiescited by 48
  2. 2022A survey of multimodal deep generative modelscited by 47
  3. 2018How agents see things: On visual representations in an emergent language gamecited by 45
  4. 2019A free energy principle for a particular physicscited by 40
  5. 2018Symbol Emergence in Cognitive Developmental Systems: a Surveycited by 39
  6. 2023World Models and Predictive Coding for Cognitive and Developmental Robotics: Frontiers and Challengescited by 36
  7. 2015Symbol Emergence in Robotics: A Surveycited by 31
  8. 2020Enriching ImageNet with Human Similarity Judgments and Psychological Embeddingscited by 23
  9. 2019Neuro-SERKET: Development of Integrative Cognitive System through the Composition of Deep Probabilistic Generative Modelscited by 20
  10. 2022Emergent Communication through Metropolis-Hastings Naming Game with Deep Generative Modelscited by 16
  11. 2023Gromov-Wasserstein unsupervised alignment reveals structural correspondences between the color similarity structures of humans and large language modelscited by 16
  12. 2019Symbol Emergence as an Interpersonal Multimodal Categorizationcited by 14
  13. 2023Recursive Metropolis-Hastings Naming Game: Symbol Emergence in a Multi-agent System based on Probabilistic Generative Modelscited by 8
  14. 2024The Curious Case of Representational Alignment: Unravelling Visio-Linguistic Tasks in Emergent Communicationcited by 7
  15. 2023Metropolis-Hastings algorithm in joint-attention naming game: Experimental semiotics studycited by 5
  16. 2023Perceptual Structure in the Absence of Grounding for LLMs: The Impact of Abstractedness and Subjectivity in Color Languagecited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 2.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Emergent Language as an Approach to Conscious AI
  2. 2025The Mechanistic Emergence of Symbol Grounding in Language Models
  3. 2025Identifying Features that Shape Perceived Consciousness in Large Language Model-based AI: A Quantitative Study of Human Responses
  4. 2025AI Mother Tongue: Self-Emergent Communication in MARL via Endogenous Symbol Systems
  5. 2026From S3Q Theory to Implementation: Towards an Architecture for Machine Qualia
  6. 2024A Philosophical Introduction to Language Models -- Part I: Continuity With Classic Debates
  7. 2025Recognizing internal states in AI: evidence from patterned preferences in large language models
  8. 2025Artificial Phantasia: Emergent Mental Imagery in Large Language Models