ACADATA: Parallel Dataset of Academic Data for Machine Translation
Not on the map. Why?
Abstract (arXiv)
We present ACADATA, a high-quality parallel dataset for academic translation, that consists of two subsets: ACAD-TRAIN, which contains approximately 1.5 million author-generated paragraph pairs across 96 language directions and ACAD-BENCH, a curated evaluation set of almost 6,000 translations covering 12 directions. To validate its utility, we fine-tune two Large Language Models (LLMs) on ACAD-TRAIN and benchmark them on ACAD-BENCH against specialized machine-translation systems, general-purpose, open-weight LLMs, and several large-scale proprietary models. Experimental results demonstrate that fine-tuning on ACAD-TRAIN leads to improvements in academic translation quality by +6.1 and +12.4 d-BLEU points on average for 7B and 2B models respectively, while also improving long-context translation in a general domain by up to 24.9% when translating out of English. The fine-tuned top-performing model surpasses the best propietary and open-weight models on academic translation domain. By releasing ACAD-TRAIN, ACAD-BENCH and the fine-tuned models, we provide the community with a valuable resource to advance research in academic domain and long-context translation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 61 references that are in the map. First posted on arXiv 14 Oct 2025.
Builds on
26 of 61 references.
References · 26
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2025Gemma 3 Technical Reportcited by 1,686
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
- 2020Language-agnostic BERT Sentence Embeddingcited by 621
- 2019WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipediacited by 221
- 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 205
- 2024Tower: An Open Multilingual Large Language Model for Translation-Related Taskscited by 205
- 2023MADLAD-400: A Multilingual And Document-Level Large Audited Datasetcited by 180
- 2019CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEBcited by 177
- 2019CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairscited by 136
14 more
- 2015Yara Parser: A Fast and Accurate Dependency Parsercited by 110
- 2025WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialectscited by 79
- 2018On the Impact of Various Types of Noise on Neural Machine Translationcited by 76
- 2018Improving the Transformer Translation Model with Document-Level Contextcited by 74
- 2024Adapting Large Language Models for Document-Level Machine Translationcited by 59
- 2021BlonDe: An Automatic Evaluation Metric for Document-level Machine Translationcited by 58
- 2022Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric Into a Document-Level Metriccited by 56
- 2024A New Massive Multilingual Dataset for High-Performance Language Technologiescited by 56
- 2024Quality Does Matter: A Detailed Look at the Quality and Utility of Web-Mined Parallel Corporacited by 13
- 2019A Large Parallel Corpus of Full-Text Scientific Articlescited by 12
- 2023SLIDE: Reference-free Evaluation for Machine Translation using a Sliding Document Windowcited by 11
- 2025Multilingual Contextualization of Large Language Models for Document-Level Machine Translationcited by 11
- 2023Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Levelcited by 9
- 2019A Parallel Corpus of Theses and Dissertations Abstractscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.