TransQuest at WMT2020: Sentence-Level Direct Assessment
Not on the map. Why?
Abstract (arXiv)
This paper presents the team TransQuest's participation in Sentence-Level Direct Assessment shared task in WMT 2020. We introduce a simple QE framework based on cross-lingual transformers, and we use it to implement and evaluate two different neural architectures. The proposed methods achieve state-of-the-art results surpassing the results obtained by OpenKiwi, the baseline used in the shared task. We further fine tune the QE framework by performing ensemble and data augmentation. Our approach is the winning solution in all of the language pairs according to the WMT 2020 official results.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 4; 2023: 2; 2024: 1; 2025: 2.
20 papers.
Sort:
- 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 207
- 2021Uncertainty-Aware Machine Translation Evaluationcited by 35
- 2021The Eval4NLP Shared Task on Explainable Quality Estimation: Overview and Resultscited by 27
- 2021Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factorscited by 25
- 2021Translation Error Detection as Rationale Extractioncited by 22
- 2022T5Score: Discriminative Fine-tuning of Generative Evaluation Metricscited by 19
- 2021An Exploratory Analysis of Multilingual Word-Level Quality Estimation with Cross-Lingual Transformerscited by 18
- 2022USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translationcited by 15
- 2023Towards Explainable Evaluation Metrics for Machine Translationcited by 15
- 2022PreQuEL: Quality Estimation of Machine Translation Outputs in Advancecited by 9
- 2024What do Large Language Models Need for Machine Translation Evaluation?cited by 6
- 2021Beyond Glass-Box Features: Uncertainty Quantification Enhanced Quality Estimation for Neural Machine Translationcited by 5
8 more
- 2021QEMind: Alibaba's Submission to the WMT21 Quality Estimation Shared Taskcited by 4
- 2021Levenshtein Training for Word-level Quality Estimationcited by 3
- 2025Giving the Old a Fresh Spin: Quality Estimation-Assisted Constrained Decoding for Automatic Post-Editingcited by 3
- 2021Quality Estimation Using Round-trip Translation with Sentence Embeddingscited by 2
- 2023SurreyAI 2023 Submission for the Quality Estimation Shared Taskcited by 1
- 2025Enhancing Plagiarism Detection in Marathi with a Weighted Ensemble of TF-IDF and BERT Embeddings for Low-Resource Language Processingcited by 1
- 2021MDQE: A More Accurate Direct Pretraining for Machine Translation Quality Estimationcited by 0
- 2021Classification-based Quality Estimation: Small and Efficient Models for Real-world Applicationscited by 0
- 2025Giving the Old a Fresh Spin: Quality Estimation-Assisted Constrained Decoding for Automatic Post-Editing28 Jan 2025
- 2025Enhancing Plagiarism Detection in Marathi with a Weighted Ensemble of TF-IDF and BERT Embeddings for Low-Resource Language Processing9 Jan 2025
- 2024What do Large Language Models Need for Machine Translation Evaluation?4 Oct 2024
- 2023SurreyAI 2023 Submission for the Quality Estimation Shared Task1 Dec 2023
- 2023Towards Explainable Evaluation Metrics for Machine Translation22 Jun 2023
- 2022T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics12 Dec 2022
- 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Task13 Sep 2022
- 2022PreQuEL: Quality Estimation of Machine Translation Outputs in Advance18 May 2022
- 2022USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translation21 Feb 2022
- 2021QEMind: Alibaba's Submission to the WMT21 Quality Estimation Shared Task30 Dec 2021
- 2021Quality Estimation Using Round-trip Translation with Sentence Embeddings31 Oct 2021
- 2021Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factors8 Oct 2021
8 more
- 2021The Eval4NLP Shared Task on Explainable Quality Estimation: Overview and Results8 Oct 2021
- 2021Classification-based Quality Estimation: Small and Efficient Models for Real-world Applications17 Sep 2021
- 2021Beyond Glass-Box Features: Uncertainty Quantification Enhanced Quality Estimation for Neural Machine Translation15 Sep 2021
- 2021Uncertainty-Aware Machine Translation Evaluation13 Sep 2021
- 2021Levenshtein Training for Word-level Quality Estimation12 Sep 2021
- 2021Translation Error Detection as Rationale Extraction27 Aug 2021
- 2021MDQE: A More Accurate Direct Pretraining for Machine Translation Quality Estimation24 Jul 2021
- 2021An Exploratory Analysis of Multilingual Word-Level Quality Estimation with Cross-Lingual Transformers31 May 2021
- 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 207
- 2021Uncertainty-Aware Machine Translation Evaluationcited by 35
- 2021The Eval4NLP Shared Task on Explainable Quality Estimation: Overview and Resultscited by 27
- 2021Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factorscited by 25
- 2021Translation Error Detection as Rationale Extractioncited by 22
- 2022T5Score: Discriminative Fine-tuning of Generative Evaluation Metricscited by 19
- 2021An Exploratory Analysis of Multilingual Word-Level Quality Estimation with Cross-Lingual Transformerscited by 18
- 2022USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translationcited by 15
- 2023Towards Explainable Evaluation Metrics for Machine Translationcited by 15
- 2022PreQuEL: Quality Estimation of Machine Translation Outputs in Advancecited by 9
- 2024What do Large Language Models Need for Machine Translation Evaluation?cited by 6
- 2021Beyond Glass-Box Features: Uncertainty Quantification Enhanced Quality Estimation for Neural Machine Translationcited by 5
12 most cited of 20 All 20 (JSON)
- 2025Giving the Old a Fresh Spin: Quality Estimation-Assisted Constrained Decoding for Automatic Post-Editing28 Jan 2025
- 2025Enhancing Plagiarism Detection in Marathi with a Weighted Ensemble of TF-IDF and BERT Embeddings for Low-Resource Language Processing9 Jan 2025
- 2024What do Large Language Models Need for Machine Translation Evaluation?4 Oct 2024
- 2023SurreyAI 2023 Submission for the Quality Estimation Shared Task1 Dec 2023
- 2023Towards Explainable Evaluation Metrics for Machine Translation22 Jun 2023
- 2022T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics12 Dec 2022
- 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Task13 Sep 2022
- 2022PreQuEL: Quality Estimation of Machine Translation Outputs in Advance18 May 2022
- 2022USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translation21 Feb 2022
- 2021QEMind: Alibaba's Submission to the WMT21 Quality Estimation Shared Task30 Dec 2021
- 2021Quality Estimation Using Round-trip Translation with Sentence Embeddings31 Oct 2021
- 2021Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factors8 Oct 2021
12 newest of 20 All 20 (JSON)