MLQE-PE: A Multilingual Quality Estimation and Post-Editing Dataset
Not on the map. Why?
Abstract (arXiv)
We present MLQE-PE, a new dataset for Machine Translation (MT) Quality Estimation (QE) and Automatic Post-Editing (APE). The dataset contains eleven language pairs, with human labels for up to 10,000 translations per language pair in the following formats: sentence-level direct assessments and post-editing effort, and word-level good/bad labels. It also contains the post-edited sentences, as well as titles of the articles where the sentences were extracted from, and the neural MT models used to translate the text.
Key facts. Cited by 47 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 14; 2023: 7; 2024: 5; 2025: 5; 2026: 9.
47 papers.
Sort:
By area:
- 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 265
- 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 207
- 2023Scaling up COMETKIWI: Unbabel-IST 2023 Submission for the Quality Estimation Shared Taskcited by 88
- 2021The Eval4NLP Shared Task on Explainable Quality Estimation: Overview and Resultscited by 27
- 2021Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factorscited by 25
- 2023AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languagescited by 24
- 2021Translation Error Detection as Rationale Extractioncited by 22
- 2022USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translationcited by 15
- 2022Towards Explainable Evaluation Metrics for Natural Language Generationcited by 15
- 2022Extrinsic Evaluation of Machine Translation Metricscited by 14
- 2022Optimal Transport for Unsupervised Hallucination Detection in Neural Machine Translationcited by 13
- 2024The Zeno's Paradox of `Low-Resource' Languagescited by 12
35 more
- 2022DivEMT: Neural Machine Translation Post-Editing Effort Across Typologically Diverse Languagescited by 11
- 2024From Handcrafted Features to LLMs: A Brief Survey for Machine Translation Quality Estimationcited by 10
- 2024Beyond Correlation: Interpretable Evaluation of Machine Translation Metricscited by 10
- 2022Reproducibility Issues for BERT-based Evaluation Metricscited by 9
- 2022PreQuEL: Quality Estimation of Machine Translation Outputs in Advancecited by 9
- 2025Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translationcited by 8
- 2021Regressive Ensemble for Machine Translation Quality Evaluationcited by 6
- 2023Perturbation-based QE: An Explainable, Unsupervised Word-level Quality Estimation Method for Blackbox Machine Translationcited by 6
- 2025Estimating Machine Translation Difficultycited by 6
- 2021Beyond Glass-Box Features: Uncertainty Quantification Enhanced Quality Estimation for Neural Machine Translationcited by 5
- 2022Reducing Hallucinations in Neural Machine Translation with Feature Attributioncited by 5
- 2024Is Context Helpful for Chat Translation Evaluation?cited by 5
- 2023Towards Fine-Grained Information: Identifying the Type and Location of Translation Errorscited by 4
- 2023Tailoring Domain Adaptation for Machine Translation Quality Estimationcited by 4
- 2025Unsupervised Word-level Quality Estimation for Machine Translation Through the Lens of Annotators (Dis)agreementcited by 4
- 2023X-PARADE: Cross-Lingual Textual Entailment and Information Divergence across Paragraphscited by 3
- 2025CAPO: Confidence Aware Preference Optimization Learning for Multilingual Preferencescited by 3
- 2026Exploring the Effects of Alignment on Numerical Bias in Large Language Modelscited by 3
- 2021Ensemble Fine-tuned mBERT for Translation Quality Estimationcited by 2
- 2022Rethink about the Word-level Quality Estimation for Machine Translation from Human Judgementcited by 2
- 2024Textual Similarity as a Key Metric in Machine Translation Quality Estimationcited by 2
- 2022Mismatching-Aware Unsupervised Translation Quality Estimation For Low-Resource Languagescited by 1
- 2026Speaking in Self-Assessing Tongues: On the Verbalized Confidence of LLMs in Machine Translationcited by 1
- 2021Classification-based Quality Estimation: Small and Efficient Models for Real-world Applicationscited by 0
- 2022An Empirical Study of Automatic Post-Editingcited by 0
- 2022QUAK: A Synthetic Quality Estimation Dataset for Korean-English Neural Machine Translationcited by 0
- 2022BMX: Boosting Natural Language Generation Metrics with Explainabilitycited by 0
- 2025A Critical Study of Automatic Evaluation in Sign Language Translationcited by 0
- 2026Beyond Scalar Scores: Reinforcement Learning for Error-Aware Quality Estimation of Machine Translationcited by 0
- 2026Towards Reliable Machine Translation: Scaling LLMs for Critical Error Detection and Safetycited by 0
- 2026Model-Based Quality Assessment for Massively Multilingual Parallel Datacited by 0
- 2026Token-Level Off-Policy Learning for Faithful Generation Under Distribution Shiftcited by 0
- 2026APEX-VW: A Document-Level English-Spanish Post-Editing Dataset in the Healthcare Domaincited by 0
- 2026IndicQE-APE: A Consolidated Benchmark for Quality Estimation and Automatic Post-Editing for Indic Languagescited by 0
- 2026When Edit Localization Amplifies Relative Selection Bias: Gradient Geometry, Target Mismatch, and Importance Weightingcited by 0
- 2026When Edit Localization Amplifies Relative Selection Bias: Gradient Geometry, Target Mismatch, and Importance Weighting12 Sep 2026
- 2026IndicQE-APE: A Consolidated Benchmark for Quality Estimation and Automatic Post-Editing for Indic Languages17 Aug 2026
- 2026APEX-VW: A Document-Level English-Spanish Post-Editing Dataset in the Healthcare Domain8 Aug 2026
- 2026Token-Level Off-Policy Learning for Faithful Generation Under Distribution Shift20 Jul 2026
- 2026Speaking in Self-Assessing Tongues: On the Verbalized Confidence of LLMs in Machine Translation15 Jun 2026
- 2026Model-Based Quality Assessment for Massively Multilingual Parallel Data29 May 2026
- 2026Towards Reliable Machine Translation: Scaling LLMs for Critical Error Detection and Safety11 Feb 2026
- 2026Beyond Scalar Scores: Reinforcement Learning for Error-Aware Quality Estimation of Machine Translation9 Feb 2026
- 2026Exploring the Effects of Alignment on Numerical Bias in Large Language Models23 Jan 2026
- 2025CAPO: Confidence Aware Preference Optimization Learning for Multilingual Preferences10 Nov 2025
- 2025A Critical Study of Automatic Evaluation in Sign Language Translation29 Oct 2025
- 2025Estimating Machine Translation Difficulty13 Aug 2025
35 more
- 2025Unsupervised Word-level Quality Estimation for Machine Translation Through the Lens of Annotators (Dis)agreement29 May 2025
- 2025Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation9 Mar 2025
- 2024The Zeno's Paradox of `Low-Resource' Languages28 Oct 2024
- 2024Beyond Correlation: Interpretable Evaluation of Machine Translation Metrics7 Oct 2024
- 2024Textual Similarity as a Key Metric in Machine Translation Quality Estimation11 Jun 2024
- 2024From Handcrafted Features to LLMs: A Brief Survey for Machine Translation Quality Estimation21 Mar 2024
- 2024Is Context Helpful for Chat Translation Evaluation?13 Mar 2024
- 2023AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languages16 Nov 2023
- 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detection16 Oct 2023
- 2023Scaling up COMETKIWI: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task21 Sep 2023
- 2023X-PARADE: Cross-Lingual Textual Entailment and Information Divergence across Paragraphs16 Sep 2023
- 2023Perturbation-based QE: An Explainable, Unsupervised Word-level Quality Estimation Method for Blackbox Machine Translation12 May 2023
- 2023Tailoring Domain Adaptation for Machine Translation Quality Estimation18 Apr 2023
- 2023Towards Fine-Grained Information: Identifying the Type and Location of Translation Errors17 Feb 2023
- 2022BMX: Boosting Natural Language Generation Metrics with Explainability20 Dec 2022
- 2022Extrinsic Evaluation of Machine Translation Metrics20 Dec 2022
- 2022Optimal Transport for Unsupervised Hallucination Detection in Neural Machine Translation19 Dec 2022
- 2022Reducing Hallucinations in Neural Machine Translation with Feature Attribution17 Nov 2022
- 2022QUAK: A Synthetic Quality Estimation Dataset for Korean-English Neural Machine Translation30 Sep 2022
- 2022An Empirical Study of Automatic Post-Editing16 Sep 2022
- 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Task13 Sep 2022
- 2022Rethink about the Word-level Quality Estimation for Machine Translation from Human Judgement13 Sep 2022
- 2022Mismatching-Aware Unsupervised Translation Quality Estimation For Low-Resource Languages31 Jul 2022
- 2022DivEMT: Neural Machine Translation Post-Editing Effort Across Typologically Diverse Languages24 May 2022
- 2022PreQuEL: Quality Estimation of Machine Translation Outputs in Advance18 May 2022
- 2022Reproducibility Issues for BERT-based Evaluation Metrics30 Mar 2022
- 2022Towards Explainable Evaluation Metrics for Natural Language Generation21 Mar 2022
- 2022USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translation21 Feb 2022
- 2021Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factors8 Oct 2021
- 2021The Eval4NLP Shared Task on Explainable Quality Estimation: Overview and Results8 Oct 2021
- 2021Classification-based Quality Estimation: Small and Efficient Models for Real-world Applications17 Sep 2021
- 2021Regressive Ensemble for Machine Translation Quality Evaluation15 Sep 2021
- 2021Beyond Glass-Box Features: Uncertainty Quantification Enhanced Quality Estimation for Neural Machine Translation15 Sep 2021
- 2021Ensemble Fine-tuned mBERT for Translation Quality Estimation8 Sep 2021
- 2021Translation Error Detection as Rationale Extraction27 Aug 2021
- 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 265
- 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 207
- 2023Scaling up COMETKIWI: Unbabel-IST 2023 Submission for the Quality Estimation Shared Taskcited by 88
- 2021The Eval4NLP Shared Task on Explainable Quality Estimation: Overview and Resultscited by 27
- 2021Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factorscited by 25
- 2023AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languagescited by 24
- 2021Translation Error Detection as Rationale Extractioncited by 22
- 2022USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translationcited by 15
- 2022Towards Explainable Evaluation Metrics for Natural Language Generationcited by 15
- 2022Extrinsic Evaluation of Machine Translation Metricscited by 14
- 2022Optimal Transport for Unsupervised Hallucination Detection in Neural Machine Translationcited by 13
- 2024The Zeno's Paradox of `Low-Resource' Languagescited by 12
12 most cited of 44 All 44 (JSON)
- 2026When Edit Localization Amplifies Relative Selection Bias: Gradient Geometry, Target Mismatch, and Importance Weighting12 Sep 2026
- 2026IndicQE-APE: A Consolidated Benchmark for Quality Estimation and Automatic Post-Editing for Indic Languages17 Aug 2026
- 2026APEX-VW: A Document-Level English-Spanish Post-Editing Dataset in the Healthcare Domain8 Aug 2026
- 2026Token-Level Off-Policy Learning for Faithful Generation Under Distribution Shift20 Jul 2026
- 2026Speaking in Self-Assessing Tongues: On the Verbalized Confidence of LLMs in Machine Translation15 Jun 2026
- 2026Model-Based Quality Assessment for Massively Multilingual Parallel Data29 May 2026
- 2026Towards Reliable Machine Translation: Scaling LLMs for Critical Error Detection and Safety11 Feb 2026
- 2026Exploring the Effects of Alignment on Numerical Bias in Large Language Models23 Jan 2026
- 2025A Critical Study of Automatic Evaluation in Sign Language Translation29 Oct 2025
- 2025Estimating Machine Translation Difficulty13 Aug 2025
- 2025Unsupervised Word-level Quality Estimation for Machine Translation Through the Lens of Annotators (Dis)agreement29 May 2025
- 2024The Zeno's Paradox of `Low-Resource' Languages28 Oct 2024
12 newest of 44 All 44 (JSON)