mlsanityData to 14 Oct 2026

Preliminary WMT24 Ranking of General MT Systems and LLMs

arXiv 2407.19884 ↗First posted 29 Jul 2024cs.CLcited by 20

Not on the map. Why?

Abstract (arXiv)

This is the preliminary ranking of WMT24 General MT systems based on automatic metrics. The official ranking will be a human evaluation, which is superior to the automatic ranking and supersedes it. The purpose of this report is not to interpret any findings but only provide preliminary results to the participants of the General MT task that may be useful during the writing of the system submission.

Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Builds on 3 of its 11 references that are in the map. First posted on arXiv 29 Jul 2024.

Builds on

3 of 11 references.

References · 3

  1. 2024Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translationcited by 62
  2. 2024Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuraciescited by 40
  3. 2024Machine Translation Meta Evaluation through Translation Accuracy Challenge Setscited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 13; 2025: 6; 2026: 1.

20 papers.

Sort:

By area:

  1. 2024EuroLLM: Multilingual Language Models for Europecited by 106
  2. 2025MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learningcited by 48
  3. 2024Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form Textscited by 31
  4. 2025How to Select Datapoints for Efficient Human Evaluation of NLG Models?cited by 23
  5. 2025R1-T1: Fully Incentivizing Translation Capability in LLMs via Reasoning Learningcited by 21
  6. 2025Multilingual Language Model Pretraining using Machine-translated Datacited by 17
  7. 2024Quality or Quantity? On Data Scale and Diversity in Adapting Large Language Models for Low-Resource Translationcited by 13
  8. 2024On the Implications of Verbose LLM Outputs: A Case Study in Translation Evaluationcited by 13
  9. 2024Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated High-Quality Parallel Data Outperforms Traditional Web-Crawled Datacited by 10
  10. 2024Pitfalls and Outlooks in Using COMETcited by 10
  11. 2024Towards Automatic Evaluation for Image Transcreationcited by 7
  12. 2024Multilingual Pretraining Using a Large Corpus Machine-Translated from a Single Source Languagecited by 5
8 more
  1. 2025ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilitiescited by 5
  2. 2024IKUN for WMT24 General MT Task: LLMs Are here for Multilingual Machine Translationcited by 3
  3. 2024A Context-aware Framework for Translation-mediated Conversationscited by 2
  4. 2024Dialectal and Low-Resource Machine Translation for Aromaniancited by 1
  5. 2026MADE: Beyond Scoring via a Multilingual Agentic Diagnosing Engine for Fine-Grained Evaluation Insightscited by 1
  6. 2024Plug, Play, and Fuse: Zero-Shot Joint Decoding via Word-Level Re-ranking Across Diverse Vocabulariescited by 0
  7. 2024Cogs in a Machine, Doing What They're Meant to Do -- The AMI Submission to the WMT24 General Translation Taskcited by 0
  8. 2025Human + AI for Accelerating Ad Localization Evaluationcited by 0