mlsanityData to 14 Oct 2026

Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description

arXiv 1710.07177 ↗First posted 19 Oct 2017cs.CL cs.CVcited by 76

Not on the map. Why?

Abstract (arXiv)

We present the results from the second shared task on multimodal machine translation and multilingual image description. Nine teams submitted 19 systems to two tasks. The multimodal translation task, in which the source sentence is supplemented by an image, was extended with a new language (French) and two new test sets. The multilingual image description task was changed such that at test time, only the image is given. Compared to last year, multimodal systems improved, but text-only systems remain competitive.

Key facts. Cited by 76 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Oct 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 22; 2022: 21; 2023: 14; 2024: 8; 2025: 8; 2026: 3.

76 papers.

Sort:

By area:

  1. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  2. 2021WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine Learningcited by 287
  3. 2022Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Datasetcited by 100
  4. 2021UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-trainingcited by 64
  5. 2022IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languagescited by 54
  6. 2021LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrievalcited by 44
  7. 2021Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translationcited by 44
  8. 2021MURAL: Multimodal, Multitask Retrieval Across Languagescited by 44
  9. 2023Language Model Alignment with Elastic Resetcited by 34
  10. 2022On Vision Features in Multimodal Machine Translationcited by 31
  11. 2021Retrieve Fast, Rerank Smart: Cooperative and Joint Approaches for Improved Cross-Modal Retrievalcited by 28
  12. 2022Bloom Library: Multimodal Datasets in 300+ Languages for a Variety of Downstream Taskscited by 28
38 more
  1. 2022VALHALLA: Visual Hallucination for Machine Translationcited by 27
  2. 2021A Survey on Multi-modal Summarizationcited by 26
  3. 2022Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluationcited by 26
  4. 2021Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Modelscited by 21
  5. 2022LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translationcited by 21
  6. 2021GEM: A General Evaluation Benchmark for Multimodal Taskscited by 16
  7. 2021Guiding Visual Question Generationcited by 14
  8. 2022Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translationcited by 13
  9. 2022VISA: An Ambiguous Subtitles Dataset for Visual Scene-Aware Machine Translationcited by 11
  10. 2023Babel-ImageNet: Massively Multilingual Evaluation of Vision-and-Language Representationscited by 11
  11. 2021MultiSubs: A Large-scale Multimodal and Multilingual Datasetcited by 10
  12. 2021Maximum Likelihood Estimation for Multimodal Learning with Missing Modalitycited by 10
  13. 2021Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-trainingcited by 10
  14. 2022MaXM: Towards Multilingual Visual Question Answeringcited by 9
  15. 2023BIG-C: a Multimodal Multi-Purpose Dataset for Bembacited by 9
  16. 2023Translation-Enhanced Multilingual Text-to-Image Generationcited by 9
  17. 2024mOSCAR: A Large-scale Multilingual and Multimodal Document-level Corpuscited by 9
  18. 2022Delving Deeper into Cross-lingual Visual Question Answeringcited by 8
  19. 2021Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translationcited by 7
  20. 2021Visual Grounding Strategies for Text-Only Natural Language Processingcited by 7
  21. 2022ERNIE-UniX2: A Unified Cross-lingual Cross-modal Framework for Understanding and Generationcited by 7
  22. 2024Can visual language models resolve textual ambiguity with visual cues? Let visual puns tell you!cited by 7
  23. 2023Bridging the Gap between Synthetic and Authentic Images for Multimodal Machine Translationcited by 6
  24. 2024A Survey on Multi-modal Machine Translation: Tasks, Methods and Challengescited by 6
  25. 2021ViTA: Visual-Linguistic Translation by Aligning Object Tagscited by 5
  26. 2023PR-MCS: Perturbation Robust Metric for MultiLingual Image Captioningcited by 5
  27. 2021Towards Zero-shot Cross-lingual Image Retrieval and Taggingcited by 4
  28. 2022Flow-Adapter Architecture for Unsupervised Machine Translationcited by 4
  29. 2022Multimodal Neural Machine Translation with Search Engine Based Image Retrievalcited by 4
  30. 2025MultiScript30k: Leveraging Multilingual Embeddings to Extend Cross Script Parallel Datacited by 4
  31. 2022GLAMI-1M: A Multilingual Image-Text Fashion Datasetcited by 3
  32. 2023Incorporating Probing Signals into Multimodal Machine Translation via Visual Question-Answering Pairscited by 3
  33. 2023Video-Helpful Multimodal Machine Translationcited by 3
  34. 2024Towards Zero-Shot Multimodal Machine Translationcited by 3
  35. 2021Visual Cues and Error Correction for Translation Robustnesscited by 2
  36. 2021Training Heterogeneous Features in Sequence to Sequence Tasks: Latent Enhanced Multi-filter Seq2Seq Modelcited by 2
  37. 2022Supervised Visual Attention for Simultaneous Multimodal Machine Translationcited by 2
  38. 2022EMMT: A simultaneous eye-tracking, 4-electrode EEG and audio corpus for multi-modal reading and translation scenarioscited by 2

50 most cited of 76 All 76 (JSON)