mlsanityData to 7 Oct 2026

ACADATA: Parallel Dataset of Academic Data for Machine Translation

arXiv 2510.12621 ↗First posted 14 Oct 2025cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

We present ACADATA, a high-quality parallel dataset for academic translation, that consists of two subsets: ACAD-TRAIN, which contains approximately 1.5 million author-generated paragraph pairs across 96 language directions and ACAD-BENCH, a curated evaluation set of almost 6,000 translations covering 12 directions. To validate its utility, we fine-tune two Large Language Models (LLMs) on ACAD-TRAIN and benchmark them on ACAD-BENCH against specialized machine-translation systems, general-purpose, open-weight LLMs, and several large-scale proprietary models. Experimental results demonstrate that fine-tuning on ACAD-TRAIN leads to improvements in academic translation quality by +6.1 and +12.4 d-BLEU points on average for 7B and 2B models respectively, while also improving long-context translation in a general domain by up to 24.9% when translating out of English. The fine-tuned top-performing model surpasses the best propietary and open-weight models on academic translation domain. By releasing ACAD-TRAIN, ACAD-BENCH and the fine-tuned models, we provide the community with a valuable resource to advance research in academic domain and long-context translation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 61 references that are in the map. First posted on arXiv 14 Oct 2025.

Builds on

26 of 61 references.

References · 26

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2025Gemma 3 Technical Reportcited by 1,686
  5. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  6. 2020Language-agnostic BERT Sentence Embeddingcited by 621
  7. 2019WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipediacited by 221
  8. 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 205
  9. 2024Tower: An Open Multilingual Large Language Model for Translation-Related Taskscited by 205
  10. 2023MADLAD-400: A Multilingual And Document-Level Large Audited Datasetcited by 180
  11. 2019CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEBcited by 177
  12. 2019CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairscited by 136
14 more
  1. 2015Yara Parser: A Fast and Accurate Dependency Parsercited by 110
  2. 2025WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialectscited by 79
  3. 2018On the Impact of Various Types of Noise on Neural Machine Translationcited by 76
  4. 2018Improving the Transformer Translation Model with Document-Level Contextcited by 74
  5. 2024Adapting Large Language Models for Document-Level Machine Translationcited by 59
  6. 2021BlonDe: An Automatic Evaluation Metric for Document-level Machine Translationcited by 58
  7. 2022Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric Into a Document-Level Metriccited by 56
  8. 2024A New Massive Multilingual Dataset for High-Performance Language Technologiescited by 56
  9. 2024Quality Does Matter: A Detailed Look at the Quality and Utility of Web-Mined Parallel Corporacited by 13
  10. 2019A Large Parallel Corpus of Full-Text Scientific Articlescited by 12
  11. 2023SLIDE: Reference-free Evaluation for Machine Translation using a Sliding Document Windowcited by 11
  12. 2025Multilingual Contextualization of Large Language Models for Document-Level Machine Translationcited by 11
  13. 2023Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Levelcited by 9
  14. 2019A Parallel Corpus of Theses and Dissertations Abstractscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.