ForMaT: Dataset for Visually-Grounded Multilingual PDF Translation
Not on the map. Why?
Abstract (arXiv)
We present ForMaT (Format-Preserving Multilingual Translation), a parallel corpus of 3,956 PDFs across 15 language pairs that preserves original layout metadata proposed for multimodal machine translation. To ensure structural diversity in the dataset, we employ K-Medoids sampling over 45 geometric features, capturing complex elements like nested tables and formulas to focus only on visually diverse PDF documents. Our evaluation reveals that current MT systems struggle with spatial grounding and geometric synchronization, often losing the link between text and its visual context. ForMaT provides a benchmark for developing layout-aware translation models that integrate visual and textual context for high-fidelity document reconstruction.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 19 references that are in the map. First posted on arXiv 15 May 2026.
Builds on
11 of 19 references.
References · 11
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
- 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 398
- 2016Multi30K: Multilingual English-German Image Descriptionscited by 250
- 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 82
- 2024A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document Understandingcited by 57
- 2025PP-DocLayout: A Unified Document Layout Detection Model to Accelerate Large-Scale Data Constructioncited by 26
- 2024Fine-Grained and Multi-Dimensional Metrics for Document-Level Machine Translationcited by 10
- 2025DocHPLT: A Massively Multilingual Document-Level Translation Datasetcited by 7
- 2024M3T: A New Benchmark Dataset for Multi-Modal Document-Level Machine Translationcited by 4
- 2026Global-Local Dual Perception for MLLMs in High-Resolution Text-Rich Image Translationcited by 3
- 2026ICDAR 2025 Competition on End-to-End Document Image Machine Translation Towards Complex Layoutscited by 1
Built on by
Not cited yet.