MMTIT-Bench: A Multilingual and Multi-Scenario Benchmark with Cognition-Perception-Reasoning Guided Text-Image Machine Translation
Not on the map. Why?
Abstract (arXiv)
End-to-end text-image machine translation (TIMT), which directly translates textual content in images across languages, is crucial for real-world multilingual scene understanding. Despite advances in vision-language large models (VLLMs), robustness across diverse visual scenes and low-resource languages remains underexplored due to limited evaluation resources. We present MMTIT-Bench, a human-verified multilingual and multi-scenario benchmark with 1,400 images spanning fourteen non-English and non-Chinese languages and diverse settings such as documents, scenes, and web images, enabling rigorous assessment of end-to-end TIMT. Beyond benchmarking, we study how reasoning-oriented data design improves translation. Although recent VLLMs have begun to incorporate long Chain-of-Thought (CoT) reasoning, effective thinking paradigms for TIMT are still immature: existing designs either cascade parsing and translation in a sequential manner or focus on language-only reasoning, overlooking the visual cognition central to VLLMs. We propose Cognition-Perception-Reasoning for Translation (CPR-Trans), a data paradigm that integrates scene cognition, text perception, and translation reasoning within a unified reasoning process. Using a VLLM-driven data generation pipeline, CPR-Trans provides structured, interpretable supervision that aligns perception with reasoning. Experiments on 3B and 7B models show consistent gains in accuracy and interpretability. We will release MMTIT-Bench to promote the multilingual and multi-scenario TIMT research upon acceptance.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 25 of its 39 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
25 of 39 references.
References · 25
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2021OCR-free Document Understanding Transformercited by 400
- 2025Demystifying Long Chain-of-Thought Reasoning in LLMscited by 323
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
- 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
- 2024Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Modelscited by 150
- 2024M3DocRAG: Multi-modal Retrieval is What You Need for Multi-page Multi-document Understandingcited by 110
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
13 more
- 2025MiMo-VL Technical Reportcited by 106
- 2023Vary: Scaling up the Vision Vocabulary for Large Vision-Language Modelscited by 84
- 2025dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Modelcited by 44
- 2023Exploring Better Text Image Translation with Multimodal Codebookcited by 23
- 2020Towards Fully Automated Manga Translationcited by 21
- 2022Improving End-to-End Text Image Translation From the Auxiliary Text Translation Taskcited by 20
- 2024Lost in the Source Language: How Large Language Models Evaluate the Quality of Machine Translationcited by 16
- 2024Translatotron-V(ison): An End-to-End Model for In-Image Machine Translationcited by 14
- 2025MT3: Scaling MLLM-based Text Image Machine Translation via Multi-Task Reinforcement Learningcited by 5
- 2025Improving MLLM's Document Image Machine Translation via Synchronously Self-reviewing Its OCR Proficiencycited by 5
- 2025Single-to-mix Modality Alignment with Multimodal Large Language Model for Document Image Machine Translationcited by 4
- 2025PATIMT-Bench: A Multi-Scenario Benchmark for Position-Aware Text Image Machine Translation in Large Vision-Language Modelscited by 2
- 2025Automatic Evaluation Metrics for Document-level Translation: Overview, Challenges and Trendscited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Bettercited by 14
- 2026Chronicles-OCR: A Cross-Temporal Perception Benchmark for the Evolutionary Trajectory of Chinese Characterscited by 5
- 2026MORE: A Multilingual Document Parsing Benchmark and Evaluationcited by 2
- 2026UniTranslator: A Unified Multi-modal Framework for End-to-end In-Image Machine Translationcited by 1
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better6 Jul 2026
- 2026MORE: A Multilingual Document Parsing Benchmark and Evaluation3 Jul 2026
- 2026UniTranslator: A Unified Multi-modal Framework for End-to-end In-Image Machine Translation23 Jun 2026
- 2026Chronicles-OCR: A Cross-Temporal Perception Benchmark for the Evolutionary Trajectory of Chinese Characters12 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Rethinking Multilingual Vision-Language Translation: Dataset, Evaluation, and Adaptation
- 2024Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning
- 2024What Is Missing in Multilingual Visual Reasoning and How to Fix It
- 2026Not Truly Multilingual: Script Consistency as a Missing Dimension in VLM Evaluation
- 2025CaMMT: Benchmarking Culturally Aware Multimodal Machine Translation
- 2024JourneyBench: A Challenging One-Stop Vision-Language Understanding Benchmark of Generated Images
- 2023A Survey of Vision-Language Pre-training from the Lens of Multimodal Machine Translation
- 2024MCTBench: Multimodal Cognition towards Text-Rich Visual Scenes Benchmark