Human Inspired Progressive Alignment and Comparative Learning for Grounded Word Acquisition
Not on the map. Why?
Abstract (arXiv)
Human language acquisition is an efficient, supervised, and continual process. In this work, we took inspiration from how human babies acquire their first language, and developed a computational process for word acquisition through comparative learning. Motivated by cognitive findings, we generated a small dataset that enables the computation models to compare the similarities and differences of various attributes, learn to filter out and extract the common information for each shared linguistic label. We frame the acquisition of words as not only the information filtration process, but also as representation-symbol mapping. This procedure does not involve a fixed vocabulary size, nor a discriminative objective, and allows the models to continually learn more concepts efficiently. Our results in controlled experiments have shown the potential of this approach for efficient continual learning of grounded words.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 40 of its 70 references that are in the map. First posted on arXiv 5 Jul 2023.
Builds on
40 of 70 references.
References · 40
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2020Supervised Contrastive Learningcited by 2,803
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,548
28 more
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
- 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,213
- 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
- 2022A Generalist Agentcited by 802
- 2021Multimodal Few-Shot Learning with Frozen Language Modelscited by 657
- 2021SimVLM: Simple Visual Language Model Pretraining with Weak Supervisioncited by 645
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
- 2019Three scenarios for continual learningcited by 610
- 2021Unifying Vision-and-Language Tasks via Text Generationcited by 411
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
- 2022Kubric: A scalable dataset generatorcited by 373
- 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 369
- 2017Variational Continual Learningcited by 335
- 2014Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networkscited by 299
- 2017CORe50: a New Dataset and Benchmark for Continuous Object Recognitioncited by 287
- 2016A Theory of Generative ConvNetcited by 174
- 2023PACO: Parts and Attributes of Common Objectscited by 146
- 2020Vokenization: Improving Language Understanding with Contextualized, Visual-Grounded Supervisioncited by 93
- 2020Symmetry and Group in Attribute-Object Compositionscited by 89
- 2021Unsupervised Learning of Compositional Energy Conceptscited by 71
- 2020Compositional Learning of Image-Text Query for Image Retrievalcited by 57
- 2020Grounded Language Learning Fast and Slowcited by 54
- 2021Learning Graph Embeddings for Open World Compositional Zero-Shot Learningcited by 49
- 2018Lifelong Learning of Spatiotemporal Representations with Dual-Memory Recurrent Self-Organizationcited by 38
- 2022ZeroC: A Neuro-Symbolic Model for Zero-shot Concept Recognition and Acquisition at Inference Timecited by 16
- 2022GeoCode: Interpretable Shape Programscited by 16
- 2022Learning to Mediate Disparities Towards Pragmatic Communicationcited by 14
- 2022Visual Superordinate Abstraction for Robust Concept Learningcited by 1
Built on by
Citing papers per year: 2023: 1.
1 paper.