mlsanityData to 7 Oct 2026

MMTIT-Bench: A Multilingual and Multi-Scenario Benchmark with Cognition-Perception-Reasoning Guided Text-Image Machine Translation

arXiv 2603.23896 ↗First posted 25 Mar 2026cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

End-to-end text-image machine translation (TIMT), which directly translates textual content in images across languages, is crucial for real-world multilingual scene understanding. Despite advances in vision-language large models (VLLMs), robustness across diverse visual scenes and low-resource languages remains underexplored due to limited evaluation resources. We present MMTIT-Bench, a human-verified multilingual and multi-scenario benchmark with 1,400 images spanning fourteen non-English and non-Chinese languages and diverse settings such as documents, scenes, and web images, enabling rigorous assessment of end-to-end TIMT. Beyond benchmarking, we study how reasoning-oriented data design improves translation. Although recent VLLMs have begun to incorporate long Chain-of-Thought (CoT) reasoning, effective thinking paradigms for TIMT are still immature: existing designs either cascade parsing and translation in a sequential manner or focus on language-only reasoning, overlooking the visual cognition central to VLLMs. We propose Cognition-Perception-Reasoning for Translation (CPR-Trans), a data paradigm that integrates scene cognition, text perception, and translation reasoning within a unified reasoning process. Using a VLLM-driven data generation pipeline, CPR-Trans provides structured, interpretable supervision that aligns perception with reasoning. Experiments on 3B and 7B models show consistent gains in accuracy and interpretability. We will release MMTIT-Bench to promote the multilingual and multi-scenario TIMT research upon acceptance.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 25 of its 39 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

25 of 39 references.

References · 25

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  6. 2021OCR-free Document Understanding Transformercited by 400
  7. 2025Demystifying Long Chain-of-Thought Reasoning in LLMscited by 323
  8. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
  9. 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
  10. 2024Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Modelscited by 150
  11. 2024M3DocRAG: Multi-modal Retrieval is What You Need for Multi-page Multi-document Understandingcited by 110
  12. 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
13 more
  1. 2025MiMo-VL Technical Reportcited by 106
  2. 2023Vary: Scaling up the Vision Vocabulary for Large Vision-Language Modelscited by 84
  3. 2025dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Modelcited by 44
  4. 2023Exploring Better Text Image Translation with Multimodal Codebookcited by 23
  5. 2020Towards Fully Automated Manga Translationcited by 21
  6. 2022Improving End-to-End Text Image Translation From the Auxiliary Text Translation Taskcited by 20
  7. 2024Lost in the Source Language: How Large Language Models Evaluate the Quality of Machine Translationcited by 16
  8. 2024Translatotron-V(ison): An End-to-End Model for In-Image Machine Translationcited by 14
  9. 2025MT3: Scaling MLLM-based Text Image Machine Translation via Multi-Task Reinforcement Learningcited by 5
  10. 2025Improving MLLM's Document Image Machine Translation via Synchronously Self-reviewing Its OCR Proficiencycited by 5
  11. 2025Single-to-mix Modality Alignment with Multimodal Large Language Model for Document Image Machine Translationcited by 4
  12. 2025PATIMT-Bench: A Multi-Scenario Benchmark for Position-Aware Text Image Machine Translation in Large Vision-Language Modelscited by 2
  13. 2025Automatic Evaluation Metrics for Document-level Translation: Overview, Challenges and Trendscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Rethinking Multilingual Vision-Language Translation: Dataset, Evaluation, and Adaptation
  2. 2024Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning
  3. 2024What Is Missing in Multilingual Visual Reasoning and How to Fix It
  4. 2026Not Truly Multilingual: Script Consistency as a Missing Dimension in VLM Evaluation
  5. 2025CaMMT: Benchmarking Culturally Aware Multimodal Machine Translation
  6. 2024JourneyBench: A Challenging One-Stop Vision-Language Understanding Benchmark of Generated Images
  7. 2023A Survey of Vision-Language Pre-training from the Lens of Multimodal Machine Translation
  8. 2024MCTBench: Multimodal Cognition towards Text-Rich Visual Scenes Benchmark