Marian: Cost-effective High-Quality Neural Machine Translation in C++
Not on the map. Why?
Abstract (arXiv)
This paper describes the submissions of the "Marian" team to the WNMT 2018 shared task. We investigate combinations of teacher-student training, low-precision matrix products, auto-tuning and other methods to optimize the Transformer model on GPU and CPU. By further integrating these methods with the new averaging attention networks, a recently introduced faster Transformer variant, we create a number of high-quality, high-performance models on the GPU and CPU, dominating the Pareto frontier for this shared task.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 6; 2023: 5; 2024: 2; 2025: 2; 2026: 1.
22 papers.
Sort:
By area:
- 2021Understanding and Overcoming the Challenges of Efficient Transformer Quantizationcited by 141
- 2024Outlier-Efficient Hopfield Layers for Large Transformer-Based Modelscited by 38
- 2023Escaping the sentence-level paradigm in machine translationcited by 27
- 2022Neural Approaches to Multilingual Information Retrievalcited by 18
- 2021Modelling Latent Translations for Cross-Lingual Transfercited by 16
- 2025Scaling Low-Resource MT via Synthetic Data Generation with LLMscited by 14
- 2023Translation-Enhanced Multilingual Text-to-Image Generationcited by 9
- 2021Few-shot learning through contextual data augmentationcited by 8
- 2023Neural Machine Translation of Clinical Text: An Empirical Investigation into Multilingual Pre-Trained Language Models and Transfer-Learningcited by 8
- 2022Non-Autoregressive Neural Machine Translation: A Call for Claritycited by 5
- 2022Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Resource MT Modelscited by 5
- 2021The Highs and Lows of Simple Lexical Domain Adaptation Approaches for Neural Machine Translationcited by 4
10 more
- 2022The Devil is in the Details: On the Pitfalls of Vocabulary Selection in Neural Machine Translationcited by 3
- 2022Sockeye 3: Fast Neural Machine Translation with PyTorchcited by 3
- 2023SOTASTREAM: A Streaming Approach to Machine Translation Trainingcited by 3
- 2022Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Modelscited by 2
- 2024PyMarian: Fast Neural Machine Translation and Evaluation in Pythoncited by 2
- 2023Reducing Gender Bias in Machine Translation through Counterfactual Data Generationcited by 1
- 2026Every Bit Counts: A Theoretical Study of Precision-Expressivity Tradeoffs in Quantized Transformerscited by 1
- 2021Leveraging Neural Machine Translation for Word Alignmentcited by 0
- 2021Grammatical Error Generation Based on Translated Fragmentscited by 0
- 2025MoVoC: Morphology-Aware Subword Construction for Geez Script Languagescited by 0
- 2026Every Bit Counts: A Theoretical Study of Precision-Expressivity Tradeoffs in Quantized Transformers2 Feb 2026
- 2025MoVoC: Morphology-Aware Subword Construction for Geez Script Languages10 Sep 2025
- 2025Scaling Low-Resource MT via Synthetic Data Generation with LLMs20 May 2025
- 2024PyMarian: Fast Neural Machine Translation and Evaluation in Python15 Aug 2024
- 2024Outlier-Efficient Hopfield Layers for Large Transformer-Based Models4 Apr 2024
- 2023Neural Machine Translation of Clinical Text: An Empirical Investigation into Multilingual Pre-Trained Language Models and Transfer-Learning12 Dec 2023
- 2023Reducing Gender Bias in Machine Translation through Counterfactual Data Generation27 Nov 2023
- 2023SOTASTREAM: A Streaming Approach to Machine Translation Training14 Aug 2023
- 2023Translation-Enhanced Multilingual Text-to-Image Generation30 May 2023
- 2023Escaping the sentence-level paradigm in machine translation25 Apr 2023
- 2022Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Resource MT Models27 Oct 2022
- 2022Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models24 Oct 2022
10 more
- 2022Neural Approaches to Multilingual Information Retrieval3 Sep 2022
- 2022Sockeye 3: Fast Neural Machine Translation with PyTorch12 Jul 2022
- 2022Non-Autoregressive Neural Machine Translation: A Call for Clarity21 May 2022
- 2022The Devil is in the Details: On the Pitfalls of Vocabulary Selection in Neural Machine Translation13 May 2022
- 2021Understanding and Overcoming the Challenges of Efficient Transformer Quantization27 Sep 2021
- 2021Modelling Latent Translations for Cross-Lingual Transfer23 Jul 2021
- 2021Grammatical Error Generation Based on Translated Fragments20 Apr 2021
- 2021Leveraging Neural Machine Translation for Word Alignment31 Mar 2021
- 2021Few-shot learning through contextual data augmentation31 Mar 2021
- 2021The Highs and Lows of Simple Lexical Domain Adaptation Approaches for Neural Machine Translation2 Jan 2021
- 2021Understanding and Overcoming the Challenges of Efficient Transformer Quantizationcited by 141
- 2024Outlier-Efficient Hopfield Layers for Large Transformer-Based Modelscited by 38
- 2023Escaping the sentence-level paradigm in machine translationcited by 27
- 2022Neural Approaches to Multilingual Information Retrievalcited by 18
- 2021Modelling Latent Translations for Cross-Lingual Transfercited by 16
- 2023Translation-Enhanced Multilingual Text-to-Image Generationcited by 9
- 2021Few-shot learning through contextual data augmentationcited by 8
- 2023Neural Machine Translation of Clinical Text: An Empirical Investigation into Multilingual Pre-Trained Language Models and Transfer-Learningcited by 8
- 2022Non-Autoregressive Neural Machine Translation: A Call for Claritycited by 5
- 2021The Highs and Lows of Simple Lexical Domain Adaptation Approaches for Neural Machine Translationcited by 4
- 2022The Devil is in the Details: On the Pitfalls of Vocabulary Selection in Neural Machine Translationcited by 3
- 2022Sockeye 3: Fast Neural Machine Translation with PyTorchcited by 3
12 most cited of 20 All 20 (JSON)
- 2026Every Bit Counts: A Theoretical Study of Precision-Expressivity Tradeoffs in Quantized Transformers2 Feb 2026
- 2025MoVoC: Morphology-Aware Subword Construction for Geez Script Languages10 Sep 2025
- 2024PyMarian: Fast Neural Machine Translation and Evaluation in Python15 Aug 2024
- 2024Outlier-Efficient Hopfield Layers for Large Transformer-Based Models4 Apr 2024
- 2023Neural Machine Translation of Clinical Text: An Empirical Investigation into Multilingual Pre-Trained Language Models and Transfer-Learning12 Dec 2023
- 2023Reducing Gender Bias in Machine Translation through Counterfactual Data Generation27 Nov 2023
- 2023SOTASTREAM: A Streaming Approach to Machine Translation Training14 Aug 2023
- 2023Translation-Enhanced Multilingual Text-to-Image Generation30 May 2023
- 2023Escaping the sentence-level paradigm in machine translation25 Apr 2023
- 2022Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models24 Oct 2022
- 2022Neural Approaches to Multilingual Information Retrieval3 Sep 2022
- 2022Sockeye 3: Fast Neural Machine Translation with PyTorch12 Jul 2022
12 newest of 20 All 20 (JSON)