Facebook FAIR's WMT19 News Translation Task Submission
Not on the map. Why?
Abstract (arXiv)
This paper describes Facebook FAIR's submission to the WMT19 shared news translation task. We participate in two language pairs and four language directions, English <-> German and English <-> Russian. Following our submission from last year, our baseline systems are large BPE-based transformer models trained with the Fairseq sequence modeling toolkit which rely on sampled back-translations. This year we experiment with different bitext data filtering schemes, as well as with adding filtered back-translated data. We also ensemble and fine-tune our models on domain-specific data, then decode using noisy channel model reranking. Our submissions are ranked first in all four directions of the human evaluation campaign. On En->De, our system significantly outperforms other systems as well as human translations. This system improves upon our WMT'18 submission by 4.5 BLEU points.
Key facts. Cited by 179 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 53; 2022: 46; 2023: 41; 2024: 30; 2025: 6; 2026: 3.
179 papers.
Sort:
By area:
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 376
- 2022In-context Examples Selection for Machine Translationcited by 172
- 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 141
- 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 137
- 2023AugGPT: Leveraging ChatGPT for Text Data Augmentationcited by 130
- 2021TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generationcited by 120
- 2022Locally Typical Samplingcited by 111
- 2021Self-Guided Contrastive Learning for BERT Sentence Representationscited by 103
- 2021Efficient Nearest Neighbor Language Modelscited by 93
- 2022On Decoding Strategies for Neural Text Generatorscited by 90
- 2021Towards Improving Adversarial Training of NLP Modelscited by 79
- 2021Spinning Language Models: Risks of Propaganda-As-A-Service and Countermeasurescited by 73
38 more
- 2022Do Language Models Plagiarize?cited by 73
- 2022Neuro-Symbolic Language Modeling with Automaton-augmented Retrievalcited by 60
- 2021Adaptive Nearest Neighbor Machine Translationcited by 58
- 2021Facebook AI WMT21 News Translation Task Submissioncited by 57
- 2022On the Limitations of Reference-Free Evaluations of Generated Textcited by 52
- 2022Quality-Aware Decoding for Neural Machine Translationcited by 49
- 2021Differentiable Subset Pruning of Transformer Headscited by 47
- 2021Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairscited by 45
- 2022Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionalitycited by 44
- 2021Generate, Annotate, and Learn: NLP with Synthetic Textcited by 42
- 2022Things not Written in Text: Exploring Spatial Commonsense from Visual Signalscited by 41
- 2022Attribution and Obfuscation of Neural Text Authorship: A Data Mining Perspectivecited by 41
- 2023GPT-who: An Information Density-based Machine-Generated Text Detectorcited by 40
- 2022A Survey on Cross-Lingual Summarizationcited by 38
- 2023Machine-Made Media: Monitoring the Mobilization of Machine-Generated Articles on Misinformation and Mainstream News Websitescited by 38
- 2021Fast Nearest Neighbor Machine Translationcited by 37
- 2021SHAPE: Shifted Absolute Position Embedding for Transformerscited by 37
- 2023ConDA: Contrastive Domain Adaptation for AI-generated Text Detectioncited by 37
- 2022Prompter: Utilizing Large Language Model Prompting for a Data Efficient Embodied Instruction Followingcited by 33
- 2021Bidimensional Leaderboards: Generate and Evaluate Language Hand in Handcited by 32
- 2021fairseq S^2: A Scalable and Integrable Speech Synthesis Toolkitcited by 24
- 2022Efficient Cluster-Based k-Nearest-Neighbor Machine Translationcited by 24
- 2024Benchmarking Large Multimodal Models against Common Corruptionscited by 24
- 2022ALLSH: Active Learning Guided by Local Sensitivity and Hardnesscited by 23
- 2021Putting words into the system's mouth: A targeted attack on neural machine translation using monolingual data poisoningcited by 21
- 2022Chunk-based Nearest Neighbor Machine Translationcited by 21
- 2022CoNT: Contrastive Neural Text Generationcited by 21
- 2022Rainproof: An Umbrella To Shield Text Generators From Out-Of-Distribution Datacited by 21
- 2023Augmenting Large Language Model Translators via Translation Memoriescited by 21
- 2024Linear-time Minimum Bayes Risk Decoding with Reference Aggregationcited by 21
- 2024Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddingscited by 21
- 2021Non-Parametric Unsupervised Domain Adaptation for Neural Machine Translationcited by 20
- 2021Cross-lingual Visual Pre-training for Multimodal Machine Translationcited by 19
- 2023Aligning Neural Machine Translation Models: Human Feedback in Training and Inferencecited by 19
- 2021Determinantal Beam Searchcited by 18
- 2021Self-Training Sampling with Monolingual Data Uncertainty for Neural Machine Translationcited by 17
- 2022LLMEffiChecker: Understanding and Testing Efficiency Degradation of Large Language Modelscited by 16
- 2023Adaptive Gating in Mixture-of-Experts based Language Modelscited by 16
50 most cited of 179 All 179 (JSON)
- 2026Extracting Problem and Method Sentence from Scientific Papers: A Context-enhanced Transformer Using Formulaic Expression Desensitization25 Jun 2026
- 2026The Word and the Way: Strategies for Domain-Specific BERT Pre-Training in German Medical NLP2 Jun 2026
- 2026Robust Test-time Video-Text Retrieval: Benchmarking and Adapting for Query Shifts15 Feb 2026
- 2025Exploring Performance Variations in Finetuned Translators of Ultra-Low Resource Languages: Do Linguistic Differences Matter?27 Nov 2025
- 2025Cognitive Linguistic Identity Fusion Score (CLIFS): A Scalable Cognition-Informed Approach to Quantifying Identity Fusion from Text20 Sep 2025
- 2025Angular Dispersion Accelerates k-Nearest Neighbors Machine Translation20 Sep 2025
- 2025Case-Based Decision-Theoretic Decoding with Quality Memories16 Sep 2025
- 2025The Mediomatix Corpus: Parallel Data for Romansh Language Varieties via Comparable Schoolbooks22 Aug 2025
- 2025A model and package for German ColBERT25 Apr 2025
- 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRA16 Sep 2024
- 2024RAGent: Retrieval-based Access Control Policy Generation8 Sep 2024
- 2024Vision-fused Attack: Advancing Aggressive and Stealthy Adversarial Text against Neural Machine Translation8 Sep 2024
38 more
- 2024DOCE: Finding the Sweet Spot for Execution-Based Code Generation25 Aug 2024
- 2024Harnessing the Power of Artificial Intelligence to Vitalize Endangered Indigenous Languages: Technologies and Experiences17 Jul 2024
- 2024Is Contrasting All You Need? Contrastive Learning for the Detection and Attribution of AI-generated Text12 Jul 2024
- 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models24 Jun 2024
- 2024Transferable speech-to-text large language model alignment module19 Jun 2024
- 2024Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translation17 Jun 2024
- 2024Efficient k-Nearest-Neighbor Machine Translation with Dynamic Retrieval10 Jun 2024
- 2024Evaluating Durability: Benchmark Insights into Multimodal Watermarking6 Jun 2024
- 2024Language Models can Evaluate Themselves via Probability Discrepancy17 May 2024
- 2024F-MALLOC: Feed-forward Memory Allocation for Continual Learning in Neural Machine Translation7 Apr 2024
- 2024AQuA -- Combining Experts' and Non-Experts' Views To Assess Deliberation Quality in Online Discussions Using LLMs3 Apr 2024
- 2024Low-resource neural machine translation with morphological modeling3 Apr 2024
- 2024On the True Distribution Approximation of Minimum Bayes-Risk Decoding31 Mar 2024
- 2024Cross-lingual Contextualized Phrase Retrieval25 Mar 2024
- 2024EAGLE: A Domain Generalization Framework for AI-generated Text Detection23 Mar 2024
- 2024Detecting Concrete Visual Tokens for Multimodal Machine Translation5 Mar 2024
- 2024Adding Multimodal Capabilities to a Text-only Translation Model5 Mar 2024
- 2024The Case for Evaluating Multimodal Translation Models on Text Datasets5 Mar 2024
- 2024Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddings26 Feb 2024
- 2024Generating Diverse Translation with Perturbed kNN-MT14 Feb 2024
- 2024Improving Black-box Robustness with In-Context Rewriting13 Feb 2024
- 2024Linear-time Minimum Bayes Risk Decoding with Reference Aggregation6 Feb 2024
- 2024Stolen Subwords: Importance of Vocabularies for Machine Translation Model Stealing29 Jan 2024
- 2024Benchmarking Large Multimodal Models against Common Corruptions22 Jan 2024
- 2024Don't Rank, Combine! Combining Machine Translation Hypotheses Using Quality Estimation12 Jan 2024
- 2024Generating Diverse and High-Quality Texts by Minimum Bayes Risk Decoding10 Jan 2024
- 2024To Diverge or Not to Diverge: A Morphosyntactic Perspective on Machine Translation vs Human Translation2 Jan 2024
- 2023Towards Faster k-Nearest-Neighbor Machine Translation12 Dec 2023
- 2023Quick Back-Translation for Unsupervised Machine Translation1 Dec 2023
- 2023Exploring Methods for Cross-lingual Text Style Transfer: The Case of Text Detoxification23 Nov 2023
- 2023Aligning Neural Machine Translation Models: Human Feedback in Training and Inference15 Nov 2023
- 2023Model-Based Minimum Bayes Risk Decoding for Text Generation9 Nov 2023
- 2023Translating away Translationese without Parallel Data28 Oct 2023
- 2023The Distributional Hypothesis Does Not Fully Explain the Benefits of Masked Language Model Pretraining25 Oct 2023
- 2023Reference Free Domain Adaptation for Translation of Noisy Questions with Question Specific Rewards23 Oct 2023
- 2023knn-seq: Efficient, Extensible kNN-MT Framework18 Oct 2023
- 2023Adaptive Gating in Mixture-of-Experts based Language Models11 Oct 2023
- 2023GPT-who: An Information Density-based Machine-Generated Text Detector9 Oct 2023
50 newest of 179 All 179 (JSON)
- 2023Aligning Neural Machine Translation Models: Human Feedback in Training and Inferencecited by 19
- 2021Non-Parametric Online Learning from Human Feedback for Neural Machine Translationcited by 8
- 2021Learning Feature Weights using Reward Modeling for Denoising Parallel Corporacited by 1
- 2024Transferable speech-to-text large language model alignment modulecited by 0
- 2024Transferable speech-to-text large language model alignment module19 Jun 2024
- 2023Aligning Neural Machine Translation Models: Human Feedback in Training and Inference15 Nov 2023
- 2021Non-Parametric Online Learning from Human Feedback for Neural Machine Translation23 Sep 2021
- 2021Learning Feature Weights using Reward Modeling for Denoising Parallel Corpora11 Mar 2021
- 2023Adaptive Gating in Mixture-of-Experts based Language Modelscited by 16
- 2023Adaptive Gating in Mixture-of-Experts based Language Models11 Oct 2023
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 376
- 2022In-context Examples Selection for Machine Translationcited by 172
- 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 141
- 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 137
- 2023AugGPT: Leveraging ChatGPT for Text Data Augmentationcited by 130
- 2021TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generationcited by 120
- 2022Locally Typical Samplingcited by 111
- 2021Self-Guided Contrastive Learning for BERT Sentence Representationscited by 103
- 2021Efficient Nearest Neighbor Language Modelscited by 93
- 2022On Decoding Strategies for Neural Text Generatorscited by 90
- 2021Towards Improving Adversarial Training of NLP Modelscited by 79
- 2022Do Language Models Plagiarize?cited by 73
12 most cited of 168 All 168 (JSON)
- 2026Extracting Problem and Method Sentence from Scientific Papers: A Context-enhanced Transformer Using Formulaic Expression Desensitization25 Jun 2026
- 2026The Word and the Way: Strategies for Domain-Specific BERT Pre-Training in German Medical NLP2 Jun 2026
- 2026Robust Test-time Video-Text Retrieval: Benchmarking and Adapting for Query Shifts15 Feb 2026
- 2025Exploring Performance Variations in Finetuned Translators of Ultra-Low Resource Languages: Do Linguistic Differences Matter?27 Nov 2025
- 2025Cognitive Linguistic Identity Fusion Score (CLIFS): A Scalable Cognition-Informed Approach to Quantifying Identity Fusion from Text20 Sep 2025
- 2025Angular Dispersion Accelerates k-Nearest Neighbors Machine Translation20 Sep 2025
- 2025Case-Based Decision-Theoretic Decoding with Quality Memories16 Sep 2025
- 2025The Mediomatix Corpus: Parallel Data for Romansh Language Varieties via Comparable Schoolbooks22 Aug 2025
- 2025A model and package for German ColBERT25 Apr 2025
- 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRA16 Sep 2024
- 2024RAGent: Retrieval-based Access Control Policy Generation8 Sep 2024
- 2024Vision-fused Attack: Advancing Aggressive and Stealthy Adversarial Text against Neural Machine Translation8 Sep 2024
12 newest of 168 All 168 (JSON)