BJTU-WeChat's Systems for the WMT22 Chat Translation Task
Not on the map. Why?
Abstract (arXiv)
This paper introduces the joint submission of the Beijing Jiaotong University and WeChat AI to the WMT'22 chat translation task for English-German. Based on the Transformer, we apply several effective variants. In our experiments, we utilize the pre-training-then-fine-tuning paradigm. In the first pre-training stage, we employ data filtering and synthetic data generation (i.e., back-translation, forward-translation, and knowledge distillation). In the second fine-tuning stage, we investigate speaker-aware in-domain data generation, speaker adaptation, prompt-based context modeling, target denoising fine-tuning, and boosted self-COMET-based model ensemble. Our systems achieve 0.810 and 0.946 COMET scores. The COMET scores of English-German and German-English are the highest among all submissions.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 31 references that are in the map. First posted on arXiv 28 Nov 2022.
Builds on
19 of 31 references.
References · 19
- 2017Attention Is All You Needcited by 60,361
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2016Sequence-Level Knowledge Distillationcited by 801
- 2015Sequence Level Training with Recurrent Neural Networkscited by 576
- 2019Taskmaster-1: Toward a Realistic and Diverse Dialog Datasetcited by 140
- 2019Bridging the Gap between Training and Inference for Neural Machine Translationcited by 123
- 2020Talking-Heads Attentioncited by 62
- 2021Selective Knowledge Distillation for Neural Machine Translationcited by 43
- 2018Accelerating Neural Transformer via an Average Attention Networkcited by 22
- 2021Modeling Bilingual Conversational Characteristics for Neural Chat Translationcited by 18
- 2022MSCTD: A Multimodal Sentiment Chat Translation Datasetcited by 15
7 more
- 2018DTMT: A Novel Deep Transition Architecture for Neural Machine Translationcited by 13
- 2020Multi-Unit Transformers for Neural Machine Translationcited by 13
- 2021Towards Making the Most of Dialogue Characteristics for Neural Chat Translationcited by 12
- 2020WeChat Neural Machine Translation Systems for WMT20cited by 11
- 2021WeChat Neural Machine Translation Systems for WMT21cited by 11
- 2020Emotional Conversation Generation with Heterogeneous Graph Neural Networkcited by 9
- 2022Scheduled Multi-task Learning for Neural Chat Translationcited by 7
Built on by
Citing papers per year: 2023: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New Languages
- 2021Facebook AI WMT21 News Translation Task Submission
- 2025Early-Exit and Instant Confidence Translation Quality Estimation
- 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models
- 2023Speech Translation with Foundation Models and Optimal Transport: UPC at IWSLT23
- 2024Evaluating Large Language Models with Human Feedback: Establishing a Swedish Benchmark
- 2021The USYD-JD Speech Translation System for IWSLT 2021
- 2023A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets