mlsanityData to 7 Oct 2026

Human Inspired Progressive Alignment and Comparative Learning for Grounded Word Acquisition

arXiv 2307.02615 ↗First posted 5 Jul 2023cs.CL cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Human language acquisition is an efficient, supervised, and continual process. In this work, we took inspiration from how human babies acquire their first language, and developed a computational process for word acquisition through comparative learning. Motivated by cognitive findings, we generated a small dataset that enables the computation models to compare the similarities and differences of various attributes, learn to filter out and extract the common information for each shared linguistic label. We frame the acquisition of words as not only the information filtration process, but also as representation-symbol mapping. This procedure does not involve a fixed vocabulary size, nor a discriminative objective, and allows the models to continually learn more concepts efficiently. Our results in controlled experiments have shown the potential of this approach for efficient continual learning of grounded words.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 40 of its 70 references that are in the map. First posted on arXiv 5 Jul 2023.

Builds on

40 of 70 references.

References · 40

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  5. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  6. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  7. 2020Supervised Contrastive Learningcited by 2,803
  8. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  10. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
  11. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
  12. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,548
28 more
  1. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
  2. 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,213
  3. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
  4. 2022A Generalist Agentcited by 802
  5. 2021Multimodal Few-Shot Learning with Frozen Language Modelscited by 657
  6. 2021SimVLM: Simple Visual Language Model Pretraining with Weak Supervisioncited by 645
  7. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
  8. 2019Three scenarios for continual learningcited by 610
  9. 2021Unifying Vision-and-Language Tasks via Text Generationcited by 411
  10. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
  11. 2022Kubric: A scalable dataset generatorcited by 373
  12. 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 369
  13. 2017Variational Continual Learningcited by 335
  14. 2014Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networkscited by 299
  15. 2017CORe50: a New Dataset and Benchmark for Continuous Object Recognitioncited by 287
  16. 2016A Theory of Generative ConvNetcited by 174
  17. 2023PACO: Parts and Attributes of Common Objectscited by 146
  18. 2020Vokenization: Improving Language Understanding with Contextualized, Visual-Grounded Supervisioncited by 93
  19. 2020Symmetry and Group in Attribute-Object Compositionscited by 89
  20. 2021Unsupervised Learning of Compositional Energy Conceptscited by 71
  21. 2020Compositional Learning of Image-Text Query for Image Retrievalcited by 57
  22. 2020Grounded Language Learning Fast and Slowcited by 54
  23. 2021Learning Graph Embeddings for Open World Compositional Zero-Shot Learningcited by 49
  24. 2018Lifelong Learning of Spatiotemporal Representations with Dual-Memory Recurrent Self-Organizationcited by 38
  25. 2022ZeroC: A Neuro-Symbolic Model for Zero-shot Concept Recognition and Acquisition at Inference Timecited by 16
  26. 2022GeoCode: Interpretable Shape Programscited by 16
  27. 2022Learning to Mediate Disparities Towards Pragmatic Communicationcited by 14
  28. 2022Visual Superordinate Abstraction for Robust Concept Learningcited by 1

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.