mlsanityData to 14 Oct 2026

MIT-10M: A Large Scale Parallel Corpus of Multilingual Image Translation

arXiv 2412.07147 ↗First posted 10 Dec 2024cs.CV cs.AIcited by 12

Not on the map. Why?

Abstract (arXiv)

Image Translation (IT) holds immense potential across diverse domains, enabling the translation of textual content within images into various languages. However, existing datasets often suffer from limitations in scale, diversity, and quality, hindering the development and evaluation of IT models. To address this issue, we introduce MIT-10M, a large-scale parallel corpus of multilingual image translation with over 10M image-text pairs derived from real-world data, which has undergone extensive data cleaning and multilingual translation validation. It contains 840K images in three sizes, 28 categories, tasks with three levels of difficulty and 14 languages image-text pairs, which is a considerable improvement on existing datasets. We conduct extensive experiments to evaluate and train models on MIT-10M. The experimental results clearly indicate that our dataset has higher adaptability when it comes to evaluating the performance of the models in tackling challenging and complex image translation tasks in the real world. Moreover, the performance of the model fine-tuned with MIT-10M has tripled compared to the baseline model, further confirming its superiority.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 12 of its 36 references that are in the map. First posted on arXiv 10 Dec 2024.

Builds on

12 of 36 references.

References · 12

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  3. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  4. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  5. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  6. 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 217
  7. 2020Towards Fully Automated Manga Translationcited by 22
  8. 2020Towards End-to-End In-Image Neural Machine Translationcited by 20
  9. 2022Improving End-to-End Text Image Translation From the Auxiliary Text Translation Taskcited by 20
  10. 2024DUAL-REFLECT: Enhancing Large Language Models for Reflective Translation through Dual Learning Feedback Mechanismscited by 16
  11. 2024Translatotron-V(ison): An End-to-End Model for In-Image Machine Translationcited by 14
  12. 2023E2TIMT: Efficient and Effective Modal Adapter for Text Image Machine Translationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 8.

12 papers.