# Announcing CzEng 2.0 Parallel Corpus with over 2 Gigawords

arXiv: https://arxiv.org/abs/2007.03006 · HTML: https://mlsanity.com/paper/2007.03006/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 6 Jul 2020.

## Built on by (most cited first, 17 of 17)

- [Sequence Length is a Domain: Length-based Overfitting in Transformer Models](https://mlsanity.com/paper/2109.07276/) (2021)
- [Why don't people use character-level machine translation?](https://mlsanity.com/paper/2110.08191/) (2021)
- [Improving Paraphrase Detection with the Adversarial Paraphrasing Task](https://mlsanity.com/paper/2106.07691/) (2021)
- [Czech Grammar Error Correction with a Large and Diverse Corpus](https://mlsanity.com/paper/2201.05590/) (2022)
- [Unveiling Multilinguality in Transformer Models: Exploring Language Specificity in Feed-Forward Networks](https://mlsanity.com/paper/2310.15552/) (2023)
- [Backtranslation Feedback Improves User Confidence in MT, Not Quality](https://mlsanity.com/paper/2104.05688/) (2021)
- [Understanding Model Robustness to User-generated Noisy Texts](https://mlsanity.com/paper/2110.07428/) (2021)
- [End-to-End Lexically Constrained Machine Translation for Morphologically Rich Languages](https://mlsanity.com/paper/2106.12398/) (2021)
- [Breeding Machine Translations: Evolutionary approach to survive and thrive in the world of automated evaluation](https://mlsanity.com/paper/2305.19330/) (2023)
- [Some Like It Small: Czech Semantic Embedding Models for Industry Applications](https://mlsanity.com/paper/2311.13921/) (2023)
- [Sampling and Filtering of Neural Machine Translation Distillation Data](https://mlsanity.com/paper/2104.00664/) (2021)
- [CUNI Submission in WMT22 General Task](https://mlsanity.com/paper/2211.16174/) (2022)
- [CUNI Systems for the WMT22 Czech-Ukrainian Translation Task](https://mlsanity.com/paper/2212.00486/) (2022)
- [Charles Translator: A Machine Translation System between Ukrainian and Czech](https://mlsanity.com/paper/2404.06964/) (2024)
- [Negative Lexical Constraints in Neural Machine Translation](https://mlsanity.com/paper/2308.03601/) (2023)
- [Leveraging Neural Machine Translation for Word Alignment](https://mlsanity.com/paper/2103.17250/) (2021)
- [A Comparative Study of Text Retrieval Models on DaReCzech](https://mlsanity.com/paper/2411.12921/) (2024)

## Abstract (arXiv)

We present a new release of the Czech-English parallel corpus CzEng 2.0 consisting of over 2 billion words (2 "gigawords") in each language. The corpus contains document-level information and is filtered with several techniques to lower the amount of noise. In addition to the data in the previous version of CzEng, it contains new authentic and also high-quality synthetic parallel data. CzEng is freely available for research and educational purposes.