mlsanityData to 13 Oct 2026

Multimodal Grounding for Language Processing

arXiv 1806.06371 ↗First posted 17 Jun 2018cs.CL cs.AIcited by 14

Not on the map. Why?

Abstract (arXiv)

This survey discusses how recent developments in multimodal processing facilitate conceptual grounding of language. We categorize the information flow in multimodal processing with respect to cognitive models of human information processing and analyze different methods for combining multimodal representations. Based on this methodological inventory, we discuss the benefit of multimodal grounding for a variety of language processing tasks and the challenges that arise. We particularly focus on multimodal grounding of verbs which play a crucial role for the compositional power of language.

Key facts. Cited by 14 papers in the map (data through 13 Oct 2026). First posted on arXiv 17 Jun 2018.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 4; 2022: 0; 2023: 2; 2024: 3; 2025: 5.

14 papers.

Sort:

  1. 2021Relative Importance in Sentence Processingcited by 22
  2. 2021Probing Multimodal Embeddings for Linguistic Properties: the Visual-Semantic Casecited by 20
  3. 2021MultiSubs: A Large-scale Multimodal and Multilingual Datasetcited by 10
  4. 2025TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialoguescited by 9
  5. 2021Embodying Pre-Trained Word Embeddings Through Robot Actionscited by 4
  6. 2025Multimodal Representation Learning and Fusioncited by 3
  7. 2023Learning to Play Chess from Textbooks (LEAP): a Corpus for Evaluating Chess Moves based on Sentiment Analysiscited by 2
  8. 2024Aspect-based Sentiment Evaluation of Chess Moves (ASSESS): an NLP-based Method for Evaluating Chess Strategies from Textbookscited by 1
  9. 2024Brotherhood at WMT 2024: Leveraging LLM-Generated Contextual Conversations for Cross-Lingual Image Captioningcited by 1
  10. 2025Natural Language Generation from Visual Events: State-of-the-Art and Key Open Questionscited by 1
  11. 2023Describe me an Aucklet: Generating Grounded Perceptual Category Descriptionscited by 0
  12. 2024Learning Multimodal Cues of Children's Uncertaintycited by 0
2 more
  1. 2025A Picture is Worth a Thousand (Correct) Captions: A Vision-Guided Judge-Corrector System for Multimodal Machine Translationcited by 0
  2. 2025Don't Learn, Ground: A Case for Natural Language Inference with Visual Groundingcited by 0