MIT-10M: A Large Scale Parallel Corpus of Multilingual Image Translation
Not on the map. Why?
Abstract (arXiv)
Image Translation (IT) holds immense potential across diverse domains, enabling the translation of textual content within images into various languages. However, existing datasets often suffer from limitations in scale, diversity, and quality, hindering the development and evaluation of IT models. To address this issue, we introduce MIT-10M, a large-scale parallel corpus of multilingual image translation with over 10M image-text pairs derived from real-world data, which has undergone extensive data cleaning and multilingual translation validation. It contains 840K images in three sizes, 28 categories, tasks with three levels of difficulty and 14 languages image-text pairs, which is a considerable improvement on existing datasets. We conduct extensive experiments to evaluate and train models on MIT-10M. The experimental results clearly indicate that our dataset has higher adaptability when it comes to evaluating the performance of the models in tackling challenging and complex image translation tasks in the real world. Moreover, the performance of the model fine-tuned with MIT-10M has tripled compared to the baseline model, further confirming its superiority.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 12 of its 36 references that are in the map. First posted on arXiv 10 Dec 2024.
Builds on
12 of 36 references.
References · 12
- 2023GPT-4 Technical Reportcited by 18,396
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
- 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 217
- 2020Towards Fully Automated Manga Translationcited by 22
- 2020Towards End-to-End In-Image Neural Machine Translationcited by 20
- 2022Improving End-to-End Text Image Translation From the Auxiliary Text Translation Taskcited by 20
- 2024DUAL-REFLECT: Enhancing Large Language Models for Reflective Translation through Dual Learning Feedback Mechanismscited by 16
- 2024Translatotron-V(ison): An End-to-End Model for In-Image Machine Translationcited by 14
- 2023E2TIMT: Efficient and Effective Modal Adapter for Text Image Machine Translationcited by 5
Built on by
Citing papers per year: 2025: 4; 2026: 8.
12 papers.
- 2025PRIM: Towards Practical In-Image Multilingual Machine Translationcited by 7
- 2025MT3: Scaling MLLM-based Text Image Machine Translation via Multi-Task Reinforcement Learningcited by 5
- 2025Rethinking Multilingual Vision-Language Translation: Dataset, Evaluation, and Adaptationcited by 3
- 2026Global-Local Dual Perception for MLLMs in High-Resolution Text-Rich Image Translationcited by 3
- 2026IMTBench: A Multi-Scenario Cross-Modal Collaborative Evaluation Benchmark for In-Image Machine Translationcited by 2
- 2026MNAFT: modality neuron-aware fine-tuning of multimodal large language models for image translationcited by 2
- 2026SARA: Unlocking Multilingual Knowledge in Mixture-of-Experts via Semantically Anchored Routing Alignmentcited by 2
- 2026MACS: Modality-Aware Capacity Scaling for Efficient Multimodal MoE Inferencecited by 1
- 2025HITSZ's End-To-End Speech Translation Systems Combining Sequence-to-Sequence Auto Speech Recognition Model and Indic Large Language Model for IWSLT 2025 in Indic Trackcited by 0
- 2026VaaWIT: Visual-Aware Adaptation of Large Language Models for Multilingual Web Image Translationcited by 0
- 2026Comparative Evaluation of Machine Translation Systems on Images with Textcited by 0
- 2026VISTA-Bench: Benchmarking Multilingual Image Translation with Image-Specific Rubricscited by 0
- 2026VISTA-Bench: Benchmarking Multilingual Image Translation with Image-Specific Rubrics29 Sep 2026
- 2026SARA: Unlocking Multilingual Knowledge in Mixture-of-Experts via Semantically Anchored Routing Alignment24 Jun 2026
- 2026Comparative Evaluation of Machine Translation Systems on Images with Text28 May 2026
- 2026VaaWIT: Visual-Aware Adaptation of Large Language Models for Multilingual Web Image Translation23 May 2026
- 2026MACS: Modality-Aware Capacity Scaling for Efficient Multimodal MoE Inference19 Apr 2026
- 2026MNAFT: modality neuron-aware fine-tuning of multimodal large language models for image translation18 Apr 2026
- 2026IMTBench: A Multi-Scenario Cross-Modal Collaborative Evaluation Benchmark for In-Image Machine Translation11 Mar 2026
- 2026Global-Local Dual Perception for MLLMs in High-Resolution Text-Rich Image Translation25 Feb 2026
- 2025PRIM: Towards Practical In-Image Multilingual Machine Translation5 Sep 2025
- 2025HITSZ's End-To-End Speech Translation Systems Combining Sequence-to-Sequence Auto Speech Recognition Model and Indic Large Language Model for IWSLT 2025 in Indic Track25 Jul 2025
- 2025Rethinking Multilingual Vision-Language Translation: Dataset, Evaluation, and Adaptation13 Jun 2025
- 2025MT3: Scaling MLLM-based Text Image Machine Translation via Multi-Task Reinforcement Learning26 May 2025