Evaluating the Impact of Verbal Multiword Expressions on Machine Translation
Not on the map. Why?
Abstract (arXiv)
Verbal multiword expressions (VMWEs) remain difficult for machine translation because their meanings are often not recoverable from their component words. In this study, we analyze the impact of three VMWE categories -- verbal idioms, verb-particle constructions, and light verb constructions -- on machine translation quality from English to multiple languages. Using both established multiword expression datasets and standard machine translation datasets, we evaluate how state-of-the-art translation systems handle these expressions. Our experimental results consistently show that VMWEs negatively affect translation quality, with deeper analysis indicating that this degradation is primarily attributable to the VMWE itself rather than general sentence-level difficulty. We release our code and evaluation framework to test new MT systems for the community.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 79 references that are in the map. First posted on arXiv 24 Aug 2025.
Builds on
25 of 79 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2020Beyond English-Centric Multilingual Machine Translationcited by 561
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
- 2017Six Challenges for Neural Machine Translationcited by 335
- 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 265
- 2018Marian: Fast Neural Machine Translation in C++cited by 203
13 more
- 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 192
- 2023MADLAD-400: A Multilingual And Document-Level Large Audited Datasetcited by 181
- 2020SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddingscited by 156
- 2024MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Taskcited by 93
- 2021Larger-Scale Transformers for Multilingual Masked Language Modelingcited by 87
- 2024LLaMAX: Scaling Linguistic Horizons of LLM by Enhancing Translation Capabilities Beyond 100 Languagescited by 48
- 2017The Parallel Meaning Bank: Towards a Multilingual Corpus of Translations Annotated with Compositional Meaning Representationscited by 42
- 2025Multilingual Machine Translation with Open Large Language Models at Practical Scale: An Empirical Studycited by 38
- 2020EPIE Dataset: A Corpus For Possible Idiomatic Expressionscited by 24
- 2024Improving LLM Abilities in Idiomatic Translationcited by 16
- 2024Comparative Study of Multilingual Idioms and Similes in Large Language Modelscited by 10
- 2022Automatic Evaluation and Analysis of Idioms in Neural Machine Translationcited by 8
- 2025ConMeC: A Dataset for Metonymy Resolution with Common Nounscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Last Translation Benchmarkcited by 1
- 2026Last Translation Benchmark3 Sep 2026