mlsanityData to 7 Oct 2026

Asynchronous and Segmented Bidirectional Encoding for NMT

arXiv 2402.14849 ↗First posted 19 Feb 2024cs.CL cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

With the rapid advancement of Neural Machine Translation (NMT), enhancing translation efficiency and quality has become a focal point of research. Despite the commendable performance of general models such as the Transformer in various aspects, they still fall short in processing long sentences and fully leveraging bidirectional contextual information. This paper introduces an improved model based on the Transformer, implementing an asynchronous and segmented bidirectional decoding strategy aimed at elevating translation efficiency and accuracy. Compared to traditional unidirectional translations from left-to-right or right-to-left, our method demonstrates heightened efficiency and improved translation quality, particularly in handling long sentences. Experimental results on the IWSLT2017 dataset confirm the effectiveness of our approach in accelerating translation and increasing accuracy, especially surpassing traditional unidirectional strategies in long sentence translation. Furthermore, this study analyzes the impact of sentence length on decoding outcomes and explores the model's performance in various scenarios. The findings of this research not only provide an effective encoding strategy for the NMT field but also pave new avenues and directions for future studies.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 9 of its 20 references that are in the map. First posted on arXiv 19 Feb 2024.

Builds on

9 of 20 references.

References · 9

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
  4. 2022What Makes Convolutional Models Great on Long Sequence Modeling?cited by 86
  5. 2022Lego-MT: Learning Detachable Models for Massively Multilingual Machine Translationcited by 21
  6. 2021Meta Back-translationcited by 16
  7. 2022LiteLSTM Architecture for Deep Recurrent Neural Networkscited by 5
  8. 2022An Overview on Machine Translation Evaluationcited by 4
  9. 2020FGraDA: A Dataset and Benchmark for Fine-Grained Domain Adaptation in Machine Translationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.