Neural Machine Translation with Reconstruction
Not on the map. Why?
Abstract (arXiv)
Although end-to-end Neural Machine Translation (NMT) has achieved remarkable progress in the past two years, it suffers from a major drawback: translations generated by NMT systems often lack of adequacy. It has been widely observed that NMT tends to repeatedly translate some source words while mistakenly ignoring other words. To alleviate this problem, we propose a novel encoder-decoder-reconstructor framework for NMT. The reconstructor, incorporated into the NMT model, manages to reconstruct the input source sentence from the hidden layer of the output target sentence, to ensure that the information in the source side is transformed to the target side as much as possible. Experiments show that the proposed framework significantly improves the adequacy of NMT output and achieves superior translation result over state-of-the-art NMT and statistical MT systems.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 9; 2023: 3; 2024: 5; 2025: 1.
28 papers.
Sort:
By area:
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMscited by 163
- 2024Robustifying Safety-Aligned Large Language Models through Clean Data Curationcited by 44
- 2022How Large Language Models are Transforming Machine-Paraphrased Plagiarismcited by 38
- 2021Prevent the Language Model from being Overconfident in Neural Machine Translationcited by 34
- 2022Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methodscited by 27
- 2021Structural Information Preserving for Graph-to-Text Generationcited by 24
- 2021Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Taskscited by 24
- 2022BORT: Back and Denoising Reconstruction for End-to-End Task-Oriented Dialogcited by 20
- 2022Understanding and Improving Sequence-to-Sequence Pretraining for Neural Machine Translationcited by 14
- 2021Improving Both Domain Robustness and Domain Adaptability in Machine Translationcited by 11
- 2021Query Rewriting via Cycle-Consistent Translation for E-Commerce Searchcited by 10
16 more
- 2022Innovations in Neural Data-to-text Generation: A Surveycited by 10
- 2022Understanding and Mitigating the Uncertainty in Zero-Shot Translationcited by 9
- 2021Sentence Concatenation Approach to Data Augmentation for Neural Machine Translationcited by 8
- 2022Is Encoder-Decoder Redundant for Neural Machine Translation?cited by 5
- 2021Data-to-text Generation by Splicing Together Nearest Neighborscited by 4
- 2021Modeling Coverage for Non-Autoregressive Neural Machine Translationcited by 4
- 2021Generating abstractive summaries of Lithuanian news articles using a transformer modelcited by 2
- 2022Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality?cited by 2
- 2024WikiSplit++: Easy Data Refinement for Split and Rephrasecited by 2
- 2023Encoder-decoder multimodal speaker change detectioncited by 1
- 2023A Case Study on Context Encoding in Multi-Encoder based Document-Level Neural Machine Translationcited by 1
- 2024Understanding and Addressing the Under-Translation Problem from the Perspective of Decoding Objectivecited by 1
- 2021The IWSLT 2021 BUT Speech Translation Systemscited by 0
- 2023An Image captioning algorithm based on the Hybrid Deep Learning Technique (CNN+GRU)cited by 0
- 2024Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translationcited by 0
- 2024NatLan: Native Language Prompting Facilitates Knowledge Elicitation Through Language Trigger Provision and Domain Trigger Retentioncited by 0
- 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs30 Jan 2025
- 2024NatLan: Native Language Prompting Facilitates Knowledge Elicitation Through Language Trigger Provision and Domain Trigger Retention7 Aug 2024
- 2024Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translation17 Jun 2024
- 2024Understanding and Addressing the Under-Translation Problem from the Perspective of Decoding Objective29 May 2024
- 2024Robustifying Safety-Aligned Large Language Models through Clean Data Curation24 May 2024
- 2024WikiSplit++: Easy Data Refinement for Split and Rephrase13 Apr 2024
- 2023A Case Study on Context Encoding in Multi-Encoder based Document-Level Neural Machine Translation11 Aug 2023
- 2023Encoder-decoder multimodal speaker change detection1 Jun 2023
- 2023An Image captioning algorithm based on the Hybrid Deep Learning Technique (CNN+GRU)6 Jan 2023
- 2022Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality?25 Nov 2022
- 2022Is Encoder-Decoder Redundant for Neural Machine Translation?21 Oct 2022
- 2022How Large Language Models are Transforming Machine-Paraphrased Plagiarism7 Oct 2022
16 more
- 2022Innovations in Neural Data-to-text Generation: A Survey25 Jul 2022
- 2022Understanding and Mitigating the Uncertainty in Zero-Shot Translation20 May 2022
- 2022BORT: Back and Denoising Reconstruction for End-to-End Task-Oriented Dialog5 May 2022
- 2022Understanding and Improving Sequence-to-Sequence Pretraining for Neural Machine Translation16 Mar 2022
- 2022Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methods10 Mar 2022
- 2022Survey of Hallucination in Natural Language Generation8 Feb 2022
- 2021Improving Both Domain Robustness and Domain Adaptability in Machine Translation15 Dec 2021
- 2021The IWSLT 2021 BUT Speech Translation Systems13 Jul 2021
- 2021Prevent the Language Model from being Overconfident in Neural Machine Translation24 May 2021
- 2021Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks2 May 2021
- 2021Modeling Coverage for Non-Autoregressive Neural Machine Translation24 Apr 2021
- 2021Generating abstractive summaries of Lithuanian news articles using a transformer model23 Apr 2021
- 2021Sentence Concatenation Approach to Data Augmentation for Neural Machine Translation17 Apr 2021
- 2021Query Rewriting via Cycle-Consistent Translation for E-Commerce Search1 Mar 2021
- 2021Structural Information Preserving for Graph-to-Text Generation12 Feb 2021
- 2021Data-to-text Generation by Splicing Together Nearest Neighbors20 Jan 2021
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2022How Large Language Models are Transforming Machine-Paraphrased Plagiarismcited by 38
- 2021Prevent the Language Model from being Overconfident in Neural Machine Translationcited by 34
- 2022Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methodscited by 27
- 2021Structural Information Preserving for Graph-to-Text Generationcited by 24
- 2021Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Taskscited by 24
- 2022BORT: Back and Denoising Reconstruction for End-to-End Task-Oriented Dialogcited by 20
- 2022Understanding and Improving Sequence-to-Sequence Pretraining for Neural Machine Translationcited by 14
- 2021Improving Both Domain Robustness and Domain Adaptability in Machine Translationcited by 11
- 2021Query Rewriting via Cycle-Consistent Translation for E-Commerce Searchcited by 10
- 2022Innovations in Neural Data-to-text Generation: A Surveycited by 10
- 2022Understanding and Mitigating the Uncertainty in Zero-Shot Translationcited by 9
12 most cited of 25 All 25 (JSON)
- 2024NatLan: Native Language Prompting Facilitates Knowledge Elicitation Through Language Trigger Provision and Domain Trigger Retention7 Aug 2024
- 2024Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translation17 Jun 2024
- 2024Understanding and Addressing the Under-Translation Problem from the Perspective of Decoding Objective29 May 2024
- 2024WikiSplit++: Easy Data Refinement for Split and Rephrase13 Apr 2024
- 2023A Case Study on Context Encoding in Multi-Encoder based Document-Level Neural Machine Translation11 Aug 2023
- 2023Encoder-decoder multimodal speaker change detection1 Jun 2023
- 2023An Image captioning algorithm based on the Hybrid Deep Learning Technique (CNN+GRU)6 Jan 2023
- 2022Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality?25 Nov 2022
- 2022Is Encoder-Decoder Redundant for Neural Machine Translation?21 Oct 2022
- 2022How Large Language Models are Transforming Machine-Paraphrased Plagiarism7 Oct 2022
- 2022Innovations in Neural Data-to-text Generation: A Survey25 Jul 2022
- 2022Understanding and Mitigating the Uncertainty in Zero-Shot Translation20 May 2022
12 newest of 25 All 25 (JSON)