# Score Combination for Improved Parallel Corpus Filtering for Low Resource Conditions

arXiv: https://arxiv.org/abs/2011.07933 · HTML: https://mlsanity.com/paper/2011.07933/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 16 Nov 2020.

## Built on by (most cited first, 1 of 1)

- [Learning Feature Weights using Reward Modeling for Denoising Parallel Corpora](https://mlsanity.com/paper/2103.06968/) (2021)

## Abstract (arXiv)

This paper describes our submission to the WMT20 sentence filtering task. We combine scores from (1) a custom LASER built for each source language, (2) a classifier built to distinguish positive and negative pairs by semantic alignment, and (3) the original scores included in the task devkit. For the mBART finetuning setup, provided by the organizers, our method shows 7% and 5% relative improvement over baseline, in sacreBLEU score on the test set for Pashto and Khmer respectively.