mlsanityData to 7 Oct 2026

The Emergence of the Shape Bias Results from Communicative Efficiency

arXiv 2109.06232 ↗First posted 13 Sep 2021cs.CL cs.IT cs.NEcited by 13

Not on the map. Why?

Abstract (arXiv)

By the age of two, children tend to assume that new word categories are based on objects' shape, rather than their color or texture; this assumption is called the shape bias. They are thought to learn this bias by observing that their caregiver's language is biased towards shape based categories. This presents a chicken and egg problem: if the shape bias must be present in the language in order for children to learn it, how did it arise in language in the first place? In this paper, we propose that communicative efficiency explains both how the shape bias emerged and why it persists across generations. We model this process with neural emergent language agents that learn to communicate about raw pixelated images. First, we show that the shape bias emerges as a result of efficient communication strategies employed by agents. Second, we show that pressure brought on by communicative need is also necessary for it to persist across generations; simply having a shape bias in an agent's input language is insufficient. These results suggest that, over and above the operation of other learning strategies, the shape bias in human learners may emerge and be sustained by communicative pressures.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 26 of its 62 references that are in the map. First posted on arXiv 13 Sep 2021.

Builds on

26 of 62 references.

References · 26

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  3. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
  4. 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
  5. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
  6. 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 561
  7. 2017Emergence of Grounded Compositional Language in Multi-Agent Populationscited by 257
  8. 2021Understanding Robustness of Transformers for Image Classificationcited by 250
  9. 2016Multi-Agent Cooperation and the Emergence of (Natural) Languagecited by 181
  10. 2017Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbolscited by 123
  11. 2021Are Convolutional Neural Networks or Transformers more like human vision?cited by 109
  12. 2018Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Inputcited by 102
14 more
  1. 2017Natural Language Does Not Emerge 'Naturally' in Multi-Agent Dialogcited by 86
  2. 2020Compositional Languages Emerge in a Neural Iterated Learning Modelcited by 75
  3. 2016Reasoning About Pragmatics with Neural Listeners and Speakerscited by 68
  4. 2019Ease-of-Teaching and Language Structure from Emergent Communicationcited by 65
  5. 2018Emergent Communication through Negotiationcited by 62
  6. 2020Countering Language Drift with Seeded Iterated Learningcited by 57
  7. 2017Cognitive Psychology for Deep Neural Networks: A Shape Bias Case Studycited by 46
  8. 2018How agents see things: On visual representations in an emergent language gamecited by 45
  9. 2019Emergent Linguistic Phenomena in Multi-Agent Communication Gamescited by 36
  10. 2018Assessing Shape Bias Property of Convolutional Neural Networkscited by 18
  11. 2020Co-evolution of language and agents in referential gamescited by 18
  12. 2019Emergence of Compositional Language with Deep Generational Transmissioncited by 17
  13. 2018Color naming reflects both perceptual structure and communicative needcited by 13
  14. 2019Miss Tools and Mr Fruit: Emergent communication in agents learning about object affordancescited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 0; 2024: 5; 2025: 1; 2026: 2.

13 papers.

Sort:

By area: