mlsanityData to 14 Oct 2026

VNJPTranslate: A comprehensive pipeline for Vietnamese-Japanese translation

arXiv 2504.00339 ↗First posted 1 Apr 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural Machine Translation (NMT) driven by Transformer architectures has advanced significantly, yet faces challenges with low-resource language pairs like Vietnamese-Japanese (Vi-Ja). Issues include sparse parallel data and handling linguistic/cultural nuances. Recent progress in Large Language Models (LLMs) with strong reasoning, often refined via Reinforcement Learning (RL), enables high-quality synthetic data generation. We introduce VNJPTranslate, a pipeline designed to systematically address the Vi-Ja translation task. It features a targeted data augmentation strategy using advanced LLMs with Chain-of-Thought prompting for challenging segments identified via corpus analysis. Subsequently, we employ efficient fine-tuning techniques (Unsloth with QLoRA) on a capable, low-parameter autoregressive model (specifically, a fine-tuned version of the 1.8B parameter Sailor model, which is based on the Qwen architecture) to create a practical and high-performing translation system. This integrated approach aims to improve Vi-Ja translation quality significantly over existing baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 43 references that are in the map. First posted on arXiv 1 Apr 2025.

Builds on

23 of 43 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  6. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  7. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  8. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  9. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  10. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  11. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  12. 2016Sequence-Level Knowledge Distillationcited by 801
11 more
  1. 2019Massively Multilingual Neural Machine Translation in the Wild: Findings and Challengescited by 257
  2. 2018Meta-Learning for Low-Resource Neural Machine Translationcited by 105
  3. 2023Synthetic Prompting: Generating Chain-of-Thought Demonstrations for Large Language Modelscited by 61
  4. 2023Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decodercited by 44
  5. 2021Selective Knowledge Distillation for Neural Machine Translationcited by 43
  6. 2022A Survey of Active Learning for Natural Language Processingcited by 40
  7. 2021A Survey on Low-Resource Neural Machine Translationcited by 16
  8. 2024Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languagescited by 5
  9. 2019Overcoming the Rare Word Problem for Low-Resource Language Pairs in Neural Machine Translationcited by 3
  10. 2024Effective In-Context Example Selection through Data Compressioncited by 2
  11. 2024Machine Translation with Large Language Models: Decoder Only vs. Encoder-Decodercited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MERIT: Multilingual Expert-Reward Informed Tuning for Chinese-Centric Low-Resource Machine Translation
  2. 2025Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation
  3. 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation
  4. 2026Backtranslation Augmented Direct Preference Optimization for Neural Machine Translation
  5. 2025Calibrating Translation Decoding with Quality Estimation on LLMs
  6. 2026North Small Translate: Advanced Cost-Effective Translation (Cohere CAT+)
  7. 2025Faster Machine Translation Ensembling with Reinforcement Learning and Competitive Correction
  8. 2024From LLM to NMT: Advancing Low-Resource Machine Translation with Claude