Learning as the Unsupervised Alignment of Conceptual Systems
Not on the map. Why?
Abstract (arXiv)
Concept induction requires the extraction and naming of concepts from noisy perceptual experience. For supervised approaches, as the number of concepts grows, so does the number of required training examples. Philosophers, psychologists, and computer scientists, have long recognized that children can learn to label objects without being explicitly taught. In a series of computational experiments, we highlight how information in the environment can be used to build and align conceptual systems. Unlike supervised learning, the learning problem becomes easier the more concepts and systems there are to master. The key insight is that each concept has a unique signature within one conceptual system (e.g., images) that is recapitulated in other systems (e.g., text or audio). As predicted, children's early concepts form readily aligned systems.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 7; 2024: 3.
14 papers.
Sort:
By area:
- 2023Getting aligned on representational alignmentcited by 142
- 2024Elements of World Knowledge (EWoK): A Cognition-Inspired Framework for Evaluating Basic World Knowledge in Language Modelscited by 55
- 2022Event knowledge in large language models: the gap between the impossible and the unlikelycited by 44
- 2023Dissociating language and thought in large language modelscited by 27
- 2023Alignment with human representations supports robust few-shot learningcited by 25
- 2024Human-like object concept representations emerge naturally in multimodal large language modelscited by 24
- 2024Dimensions underlying the representational alignment of deep neural networks with humanscited by 22
- 2021Probabilistic Analogical Mapping with Semantic Relation Networkscited by 14
- 2023Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalizationcited by 6
- 2023Expand BERT Representation with Visual Information via Grounded Language Learning with Multimodal Partial Alignmentcited by 5
- 2022Cross-Modal Alignment Learning of Vision-Language Conceptual Systemscited by 4
- 2023Align before Search: Aligning Ads Image to Text for Accurate Cross-Modal Sponsored Searchcited by 3
- 2024Human-like object concept representations emerge naturally in multimodal large language models1 Jul 2024
- 2024Dimensions underlying the representational alignment of deep neural networks with humans27 Jun 2024
- 2024Elements of World Knowledge (EWoK): A Cognition-Inspired Framework for Evaluating Basic World Knowledge in Language Models15 May 2024
- 2023Expand BERT Representation with Visual Information via Grounded Language Learning with Multimodal Partial Alignment4 Dec 2023
- 2023Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization19 Oct 2023
- 2023Getting aligned on representational alignment18 Oct 2023
- 2023Align before Search: Aligning Ads Image to Text for Accurate Cross-Modal Sponsored Search28 Sep 2023
- 2023Quantifying the Roles of Visual, Linguistic, and Visual-Linguistic Complexity in Verb Acquisition5 Apr 2023
- 2023Alignment with human representations supports robust few-shot learning27 Jan 2023
- 2023Dissociating language and thought in large language models16 Jan 2023
- 2022Event knowledge in large language models: the gap between the impossible and the unlikely2 Dec 2022
- 2022Cross-Modal Alignment Learning of Vision-Language Conceptual Systems31 Jul 2022
2 more
- 2021What Remains of Visual Semantic Embeddings26 Jul 2021
- 2021Probabilistic Analogical Mapping with Semantic Relation Networks30 Mar 2021
- 2023Dissociating language and thought in large language modelscited by 27
- 2023Dissociating language and thought in large language models16 Jan 2023
- 2023Getting aligned on representational alignmentcited by 142
- 2022Event knowledge in large language models: the gap between the impossible and the unlikelycited by 44
- 2023Alignment with human representations supports robust few-shot learningcited by 25
- 2024Dimensions underlying the representational alignment of deep neural networks with humanscited by 22
- 2021Probabilistic Analogical Mapping with Semantic Relation Networkscited by 14
- 2023Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalizationcited by 6
- 2023Expand BERT Representation with Visual Information via Grounded Language Learning with Multimodal Partial Alignmentcited by 5
- 2022Cross-Modal Alignment Learning of Vision-Language Conceptual Systemscited by 4
- 2023Align before Search: Aligning Ads Image to Text for Accurate Cross-Modal Sponsored Searchcited by 3
- 2023Quantifying the Roles of Visual, Linguistic, and Visual-Linguistic Complexity in Verb Acquisitioncited by 1
- 2021What Remains of Visual Semantic Embeddingscited by 0
- 2024Dimensions underlying the representational alignment of deep neural networks with humans27 Jun 2024
- 2023Expand BERT Representation with Visual Information via Grounded Language Learning with Multimodal Partial Alignment4 Dec 2023
- 2023Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization19 Oct 2023
- 2023Getting aligned on representational alignment18 Oct 2023
- 2023Align before Search: Aligning Ads Image to Text for Accurate Cross-Modal Sponsored Search28 Sep 2023
- 2023Quantifying the Roles of Visual, Linguistic, and Visual-Linguistic Complexity in Verb Acquisition5 Apr 2023
- 2023Alignment with human representations supports robust few-shot learning27 Jan 2023
- 2022Event knowledge in large language models: the gap between the impossible and the unlikely2 Dec 2022
- 2022Cross-Modal Alignment Learning of Vision-Language Conceptual Systems31 Jul 2022
- 2021What Remains of Visual Semantic Embeddings26 Jul 2021
- 2021Probabilistic Analogical Mapping with Semantic Relation Networks30 Mar 2021