PATMT2: Two-stage domain adaptation for multilingual patent translation
Not on the map. Why?
Abstract (arXiv)
We present PatMT2 (Patent Machine Translation, v2), a two-stage LoRA pipeline that adapts the Hy-MT2-7B dedicated translation model to four-language (Chinese/English/Japanese/Korean) patent translation. On six translation directions, the Stage-2 checkpoint reaches a macro-average BLEU of 43.39 (BF16) to 43.57 (AWQ INT4), improving over the Hy-MT2-7B base by up to +8.8 BLEU and also exceeding Qwen3-32B and several external systems on the same average. We then measure the cost of adaptation: probing 38 languages absent from the fine-tuning data, the model still produces correct, fluent output on 34, while four low-resource languages collapse into distinct, reproducible failure modes. We treat these as diagnostic cases rather than retention rates, and report their mechanisms without attributing them to a single cause. Paired bootstrap tests confirm the translation gains over all baselines (p < 0.001).
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 7 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
6 of 7 references.
References · 6
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2025Qwen3 Technical Reportcited by 8,820
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,298
- 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
Built on by
Not cited yet.