Neural Machine Translation and Sequence-to-sequence Models: A Tutorial
Not on the map. Why?
Abstract (arXiv)
This tutorial introduces a new and powerful set of techniques variously called "neural machine translation" or "neural sequence-to-sequence models". These techniques have been used in a number of tasks regarding the handling of human language, and can be a powerful tool in the toolbox of anyone who wants to model sequential data of some sort. The tutorial assumes that the reader knows the basics of math and programming, but does not assume any particular experience with neural networks or natural language processing. It attempts to explain the intuition behind the various methods covered, then delves into them with enough mathematical detail to understand them concretely, and culiminates with a suggestion for an implementation exercise, where readers can test that they understood the content in practice.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 7; 2023: 3; 2024: 4; 2025: 2.
25 papers.
Sort:
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2021An Overview and Experimental Study of Learning-based Optimization Algorithms for Vehicle Routing Problemcited by 22
- 2022PromptEHR: Conditional Electronic Healthcare Records Generation with Prompt Learningcited by 22
- 2022Transferable and Adaptable Driving Behavior Predictioncited by 20
- 2021Generating Relevant and Coherent Dialogue Responses using Self-separated Conditional Variational AutoEncoderscited by 18
- 2022Non-Imaging Medical Data Synthesis for Trustworthy AI: A Comprehensive Surveycited by 9
- 2023Neural Machine Translation for the Indigenous Languages of the Americas: An Introductioncited by 7
- 2021Online Adaptation of Neural Network Models by Modified Extended Kalman Filter for Customizable and Transferable Driving Behavior Predictioncited by 6
- 2021Attention Forcing for Machine Translationcited by 3
- 2022Word Alignment in the Era of Deep Learning: A Tutorialcited by 3
- 2023Mercury: An Automated Remote Side-channel Attack to Nvidia Deep Learning Acceleratorcited by 3
- 2024Transfer Learning with Foundational Models for Time Series Forecasting using Low-Rank Adaptationscited by 3
13 more
- 2024Muscles in Time: Learning to Understand Human Motion by Simulating Muscle Activationscited by 3
- 2021Transformer-based Map Matching Model with Limited Ground-Truth Data using Transfer-Learning Approachcited by 2
- 2022PharmMT: A Neural Machine Translation Approach to Simplify Prescription Directionscited by 2
- 2024AgriLLM: Harnessing Transformers for Farmer Queriescited by 2
- 2024Large Language Model Evaluation via Matrix Nuclear-Normcited by 2
- 2021Unsupervised Transfer Learning in Multilingual Neural Machine Translation with Cross-Lingual Word Embeddingscited by 1
- 2021Vision-Guided Forecasting -- Visual Context for Multi-Horizon Time Series Forecastingcited by 1
- 2022Modeling Complex Dialogue Mappings via Sentence Semantic Segmentation Guided Conditional Variational Auto-Encodercited by 1
- 2023Optimizing Large Language Models to Expedite the Development of Smart Contractscited by 1
- 2025Intent-Aware Neural Query Reformulation for Behavior-Aligned Product Searchcited by 1
- 2021English-to-Chinese Transliteration with Phonetic Back-transliterationcited by 0
- 2022Deliberation Networks and How to Train Themcited by 0
- 2025Low-Resource Neural Machine Translation Using Recurrent Neural Networks and Transfer Learning: A Case Study on English-to-Igbocited by 0
- 2025Intent-Aware Neural Query Reformulation for Behavior-Aligned Product Search29 Jul 2025
- 2025Low-Resource Neural Machine Translation Using Recurrent Neural Networks and Transfer Learning: A Case Study on English-to-Igbo24 Apr 2025
- 2024Muscles in Time: Learning to Understand Human Motion by Simulating Muscle Activations31 Oct 2024
- 2024Transfer Learning with Foundational Models for Time Series Forecasting using Low-Rank Adaptations15 Oct 2024
- 2024Large Language Model Evaluation via Matrix Nuclear-Norm14 Oct 2024
- 2024AgriLLM: Harnessing Transformers for Farmer Queries21 Jun 2024
- 2023Optimizing Large Language Models to Expedite the Development of Smart Contracts8 Oct 2023
- 2023Mercury: An Automated Remote Side-channel Attack to Nvidia Deep Learning Accelerator2 Aug 2023
- 2023Neural Machine Translation for the Indigenous Languages of the Americas: An Introduction11 Jun 2023
- 2022Modeling Complex Dialogue Mappings via Sentence Semantic Segmentation Guided Conditional Variational Auto-Encoder1 Dec 2022
- 2022Word Alignment in the Era of Deep Learning: A Tutorial30 Nov 2022
- 2022Deliberation Networks and How to Train Them6 Nov 2022
13 more
- 2022PromptEHR: Conditional Electronic Healthcare Records Generation with Prompt Learning11 Oct 2022
- 2022Non-Imaging Medical Data Synthesis for Trustworthy AI: A Comprehensive Survey17 Sep 2022
- 2022PharmMT: A Neural Machine Translation Approach to Simplify Prescription Directions8 Apr 2022
- 2022Transferable and Adaptable Driving Behavior Prediction10 Feb 2022
- 2021English-to-Chinese Transliteration with Phonetic Back-transliteration20 Dec 2021
- 2021Online Adaptation of Neural Network Models by Modified Extended Kalman Filter for Customizable and Transferable Driving Behavior Prediction9 Dec 2021
- 2021Transformer-based Map Matching Model with Limited Ground-Truth Data using Transfer-Learning Approach1 Aug 2021
- 2021Vision-Guided Forecasting -- Visual Context for Multi-Horizon Time Series Forecasting27 Jul 2021
- 2021An Overview and Experimental Study of Learning-based Optimization Algorithms for Vehicle Routing Problem15 Jul 2021
- 2021Generating Relevant and Coherent Dialogue Responses using Self-separated Conditional Variational AutoEncoders7 Jun 2021
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Survey14 Apr 2021
- 2021Attention Forcing for Machine Translation2 Apr 2021
- 2021Unsupervised Transfer Learning in Multilingual Neural Machine Translation with Cross-Lingual Word Embeddings11 Mar 2021
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2021An Overview and Experimental Study of Learning-based Optimization Algorithms for Vehicle Routing Problemcited by 22
- 2022PromptEHR: Conditional Electronic Healthcare Records Generation with Prompt Learningcited by 22
- 2022Transferable and Adaptable Driving Behavior Predictioncited by 20
- 2021Generating Relevant and Coherent Dialogue Responses using Self-separated Conditional Variational AutoEncoderscited by 18
- 2022Non-Imaging Medical Data Synthesis for Trustworthy AI: A Comprehensive Surveycited by 9
- 2023Neural Machine Translation for the Indigenous Languages of the Americas: An Introductioncited by 7
- 2021Online Adaptation of Neural Network Models by Modified Extended Kalman Filter for Customizable and Transferable Driving Behavior Predictioncited by 6
- 2021Attention Forcing for Machine Translationcited by 3
- 2022Word Alignment in the Era of Deep Learning: A Tutorialcited by 3
- 2023Mercury: An Automated Remote Side-channel Attack to Nvidia Deep Learning Acceleratorcited by 3
- 2024Transfer Learning with Foundational Models for Time Series Forecasting using Low-Rank Adaptationscited by 3
12 most cited of 25 All 25 (JSON)
- 2025Intent-Aware Neural Query Reformulation for Behavior-Aligned Product Search29 Jul 2025
- 2025Low-Resource Neural Machine Translation Using Recurrent Neural Networks and Transfer Learning: A Case Study on English-to-Igbo24 Apr 2025
- 2024Muscles in Time: Learning to Understand Human Motion by Simulating Muscle Activations31 Oct 2024
- 2024Transfer Learning with Foundational Models for Time Series Forecasting using Low-Rank Adaptations15 Oct 2024
- 2024Large Language Model Evaluation via Matrix Nuclear-Norm14 Oct 2024
- 2024AgriLLM: Harnessing Transformers for Farmer Queries21 Jun 2024
- 2023Optimizing Large Language Models to Expedite the Development of Smart Contracts8 Oct 2023
- 2023Mercury: An Automated Remote Side-channel Attack to Nvidia Deep Learning Accelerator2 Aug 2023
- 2023Neural Machine Translation for the Indigenous Languages of the Americas: An Introduction11 Jun 2023
- 2022Modeling Complex Dialogue Mappings via Sentence Semantic Segmentation Guided Conditional Variational Auto-Encoder1 Dec 2022
- 2022Word Alignment in the Era of Deep Learning: A Tutorial30 Nov 2022
- 2022Deliberation Networks and How to Train Them6 Nov 2022
12 newest of 25 All 25 (JSON)