mlsanityData to 7 Oct 2026

Towards End-to-End In-Image Neural Machine Translation

arXiv 2010.10648 ↗First posted 20 Oct 2020cs.CL cs.CV cs.LGcited by 20

Not on the map. Why?

Abstract (arXiv)

In this paper, we offer a preliminary investigation into the task of in-image machine translation: transforming an image containing text in one language into an image containing the same text in another language. We propose an end-to-end neural model for this task inspired by recent approaches to neural machine translation, and demonstrate promising initial results based purely on pixel-level supervision. We then offer a quantitative and qualitative evaluation of our system outputs and discuss some common failure modes. Finally, we conclude with directions for future work.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 3; 2023: 4; 2024: 3; 2025: 4; 2026: 4.

20 papers.

Sort:

By area:

  1. 2021Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLPcited by 130
  2. 2022Language Modelling with Pixelscited by 53
  3. 2022CLIPPO: Image-and-Language Understanding from Pixels Onlycited by 53
  4. 2021Robust Open-Vocabulary Translation from Visual Text Representationscited by 47
  5. 2023Exploring Better Text Image Translation with Multimodal Codebookcited by 23
  6. 2022Improving End-to-End Text Image Translation From the Auxiliary Text Translation Taskcited by 20
  7. 2024MIT-10M: A Large Scale Parallel Corpus of Multilingual Image Translationcited by 12
  8. 2024AnyTrans: Translate AnyText in the Image with Large Scale Modelscited by 8
  9. 2025Exploring In-Image Machine Translation with Real-World Backgroundcited by 7
  10. 2025PRIM: Towards Practical In-Image Multilingual Machine Translationcited by 7
  11. 2024A Survey on Multi-modal Machine Translation: Tasks, Methods and Challengescited by 6
  12. 2023E2TIMT: Efficient and Effective Modal Adapter for Text Image Machine Translationcited by 5
8 more
  1. 2023Show Me the World in My Language: Establishing the First Baseline for Scene-Text to Scene-Text Translationcited by 5
  2. 2023Multi-Teacher Knowledge Distillation For Text Image Machine Translationcited by 2
  3. 2025PATIMT-Bench: A Multi-Scenario Benchmark for Position-Aware Text Image Machine Translation in Large Vision-Language Modelscited by 2
  4. 2026Global-Local Dual Perception for MLLMs in High-Resolution Text-Rich Image Translationcited by 2
  5. 2026MNAFT: modality neuron-aware fine-tuning of multimodal large language models for image translationcited by 2
  6. 2025LLaVA-NeuMT: Selective Layer-Neuron Modulation for Efficient Multilingual Multimodal Translationcited by 0
  7. 2026Vectra: A New Metric, Dataset, and Model for Visual Quality Assessment in E-Commerce In-Image Machine Translationcited by 0
  8. 2026VaaWIT: Visual-Aware Adaptation of Large Language Models for Multilingual Web Image Translationcited by 0