mlsanityData to 7 Oct 2026

The MeMAD Submission to the WMT18 Multimodal Translation Task

arXiv 1808.10802 ↗First posted 31 Aug 2018cs.CLcited by 22

Not on the map. Why?

Abstract (arXiv)

This paper describes the MeMAD project entry to the WMT Multimodal Machine Translation Shared Task. We propose adapting the Transformer neural machine translation (NMT) architecture to a multi-modal setting. In this paper, we also describe the preliminary experiments with text-only translation systems leading us up to this choice. We have the top scoring system for both English-to-German and English-to-French, according to the automatic metrics for flickr18. Our experiments show that the effect of the visual features in our system is small. Our largest gains come from the quality of the underlying text-only NMT system. We find that appropriate use of additional data is effective.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Aug 2018.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 4; 2022: 6; 2023: 7; 2024: 2; 2025: 3.

22 papers.

Sort:

By area:

  1. 2021Unifying Vision-and-Language Tasks via Text Generationcited by 411
  2. 2021Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translationcited by 44
  3. 2022On Vision Features in Multimodal Machine Translationcited by 31
  4. 2022Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluationcited by 26
  5. 2021Cross-lingual Visual Pre-training for Multimodal Machine Translationcited by 19
  6. 2023Universal Multimodal Representation for Language Understandingcited by 14
  7. 2023CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translationcited by 14
  8. 2022Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translationcited by 13
  9. 2022Increasing Visual Awareness in Multimodal Neural Machine Translation from an Information Theoretic Perspectivecited by 10
  10. 2021Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translationcited by 7
  11. 2025IndicVisionBench: Benchmarking Cultural and Multilingual Understanding in VLMscited by 7
  12. 2025Chitranuvad: Adapting Multi-Lingual LLMs for Multimodal Translationcited by 6
10 more
  1. 2022Multimodal Neural Machine Translation with Search Engine Based Image Retrievalcited by 4
  2. 20243AM: An Ambiguity-Aware Multi-Modal Machine Translation Datasetcited by 4
  3. 2023Incorporating Probing Signals into Multimodal Machine Translation via Visual Question-Answering Pairscited by 3
  4. 2022Silo NLP's Participation at WAT2022cited by 2
  5. 2023RC3: Regularized Contrastive Cross-lingual Cross-modal Pre-trainingcited by 2
  6. 2023Impact of Visual Context on Noisy Multimodal NMT: An Empirical Study for English to Indian Languagescited by 2
  7. 2024Exploring the Necessity of Visual Modality in Multimodal Machine Translation using Authentic Datasetscited by 1
  8. 2025GIIFT: Graph-guided Inductive Image-free Multimodal Machine Translationcited by 1
  9. 2023Generalization algorithm of multimodal pre-training model based on graph-text self-supervised trainingcited by 0
  10. 2023Modality Influence in Multimodal Machine Learningcited by 0