ChatGPT as a Translation Engine: A Case Study on Japanese-English
Not on the map. Why?
Abstract (arXiv)
This study investigates ChatGPT for Japanese-English translation, exploring simple and enhanced prompts and comparing against commercially available translation engines. Performing both automatic and MQM-based human evaluations, we found that document-level translation outperforms sentence-level translation for ChatGPT. On the other hand, we were not able to determine if enhanced prompts performed better than simple prompts in our experiments. We also discovered that ChatGPT-3.5 was preferred by automatic evaluation, but a tradeoff exists between accuracy (ChatGPT-3.5) and fluency (ChatGPT-4). Lastly, ChatGPT yields competitive results against two widely-known translation systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 12 references that are in the map. First posted on arXiv 9 Oct 2025.
Builds on
5 of 12 references.
References · 5
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2023Towards Making the Most of ChatGPT for Machine Translationcited by 138
- 2023Optimizing Machine Translation through Prompt Engineering: An Investigation into ChatGPT's Customizabilitycited by 11
- 2021Difficulty-Aware Machine Translation Evaluationcited by 6
Built on by
Not cited yet.