mlsanityData to 7 Oct 2026

Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translation

arXiv 2410.00683 ↗First posted 1 Oct 2024cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper addresses the challenge of accurately translating technical terms, which are crucial for clear communication in specialized fields. We introduce the Parenthetical Terminology Translation (PTT) task, designed to mitigate potential inaccuracies by displaying the original term in parentheses alongside its translation. To implement this approach, we generated a representative PTT dataset using a collaborative approach with large language models and applied knowledge distillation to fine-tune traditional Neural Machine Translation (NMT) models and small-sized Large Language Models (sLMs). Additionally, we developed a novel evaluation metric to assess both overall translation accuracy and the correct parenthetical presentation of terms. Our findings indicate that sLMs did not consistently outperform NMT models, with fine-tuning proving more effective than few-shot prompting, particularly in models with continued pre-training in the target language. These insights contribute to the advancement of more reliable terminology translation methodologies.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 26 references that are in the map. First posted on arXiv 1 Oct 2024.

Builds on

15 of 26 references.

References · 15

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  6. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  7. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  8. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  9. 2020Beyond English-Centric Multilingual Machine Translationcited by 559
  10. 2023Continual Pre-training of Language Modelscited by 194
  11. 2017Neural Machine Translation with Extended Contextcited by 95
  12. 2024From LLM to NMT: Advancing Low-Resource Machine Translation with Claudecited by 57
3 more
  1. 2018Neural Machine Translation Decoding with Terminology Constraintscited by 36
  2. 2022Memory-efficient NLLB-200: Language-specific Expert Pruning of a Massively Multilingual Machine Translation Modelcited by 36
  3. 2024MT-PATCHER: Selective and Extendable Knowledge Distillation from Large Language Models for Machine Translationcited by 10

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.