Creative and Context-Aware Translation of East Asian Idioms with GPT-4
Not on the map. Why?
Abstract (arXiv)
As a type of figurative language, an East Asian idiom condenses rich cultural background into only a few characters. Translating such idioms is challenging for human translators, who often resort to choosing a context-aware translation from an existing list of candidates. However, compiling a dictionary of candidate translations demands much time and creativity even for expert translators. To alleviate such burden, we evaluate if GPT-4 can help generate high-quality translations. Based on automatic evaluations of faithfulness and creativity, we first identify Pareto-optimal prompting strategies that can outperform translation engines from Google and DeepL. Then, at a low cost, our context-aware translations can achieve far more high-quality translations per idiom than the human baseline. We open-source all code and data to facilitate further research.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 1 Oct 2024.
Builds on
25 of 42 references.
References · 25
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 713
- 2021Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translationcited by 338
- 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 207
- 2023GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4cited by 146
- 2023The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluationcited by 95
- 2023Large language models effectively leverage document-level context for literary translation, but critical errors persistcited by 80
13 more
- 2021BlonDe: An Automatic Evaluation Metric for Document-level Machine Translationcited by 58
- 2023Leveraging GPT-4 for Automatic Translation Post-Editingcited by 56
- 2022Exploring Document-Level Literary Machine Translation with Parallel Paragraphs from World Literaturecited by 45
- 2021It's not Rocket Science : Interpreting Figurative Language in Narrativescited by 39
- 2024Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form Textscited by 31
- 2023Do GPTs Produce Less Literal Translations?cited by 30
- 2023Findings of the WMT 2023 Shared Task on Discourse-Level Literary Translation: A Fresh Orb in the Cosmos of LLMscited by 25
- 2023Translate Meanings, Not Just Words: IdiomKB's Role in Optimizing Idiomatic Translation with Language Modelscited by 24
- 2023Augmenting Large Language Model Translators via Translation Memoriescited by 21
- 2022PETCI: A Parallel English Translation Dataset of Chinese Idiomscited by 10
- 2024CAT-LLM: Style-enhanced Large Language Models with Text Style Definition for Chinese Article-style Transfercited by 10
- 2024Improving Language Model Reasoning with Self-motivated Learningcited by 4
- 2024Thinker-DDM: Modeling Deliberation for Machine Translation with a Drift-Diffusion Processcited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 5.
10 papers.
- 2026Large Language Model Reasoning Failurescited by 21
- 2026Steer2Adapt: Dynamically Composing Steering Vectors Elicits Efficient Adaptation of LLMscited by 7
- 2026Interactive Evaluation Requires a Design Sciencecited by 3
- 2025Translation in the Wildcited by 2
- 2025Evaluating LLMs on Chinese Idiom Translationcited by 2
- 2025GuessBench: Sensemaking Multimodal Creativity in the Wildcited by 1
- 2024Large Language Models for Persian leftrightarrow English Idiom Translationcited by 0
- 2025DIY-MKG: An LLM-Based Polyglot Language Learning Systemcited by 0
- 2026ExpressEdit: Fast Editing of Stylized Facial Expressions with Diffusion Models in Photoshopcited by 0
- 2026VIVID: A Culturally Grounded Benchmark Exposing the Figurative Language Gap in Vietnamese NLPcited by 0
- 2026VIVID: A Culturally Grounded Benchmark Exposing the Figurative Language Gap in Vietnamese NLP4 Aug 2026
- 2026Interactive Evaluation Requires a Design Science18 May 2026
- 2026ExpressEdit: Fast Editing of Stylized Facial Expressions with Diffusion Models in Photoshop3 Apr 2026
- 2026Steer2Adapt: Dynamically Composing Steering Vectors Elicits Efficient Adaptation of LLMs7 Feb 2026
- 2026Large Language Model Reasoning Failures5 Feb 2026
- 2025Evaluating LLMs on Chinese Idiom Translation14 Aug 2025
- 2025DIY-MKG: An LLM-Based Polyglot Language Learning System2 Jul 2025
- 2025GuessBench: Sensemaking Multimodal Creativity in the Wild1 Jun 2025
- 2025Translation in the Wild29 May 2025
- 2024Large Language Models for Persian leftrightarrow English Idiom Translation13 Dec 2024