mlsanityData to 7 Oct 2026

On the Properties of Neural Machine Translation: Encoder-Decoder Approaches

arXiv 1409.1259 ↗First posted 3 Sep 2014cs.CL stat.MLcited by 1,303

Not on the map. Why?

Abstract (arXiv)

Neural machine translation is a relatively new approach to statistical machine translation based purely on neural networks. The neural machine translation models often consist of an encoder and a decoder. The encoder extracts a fixed-length representation from a variable-length input sentence, and the decoder generates a correct translation from this representation. In this paper, we focus on analyzing the properties of the neural machine translation using two models; RNN Encoder--Decoder and a newly proposed gated recursive convolutional neural network. We show that the neural machine translation performs relatively well on short sentences without unknown words, but its performance degrades rapidly as the length of the sentence and the number of unknown words increase. Furthermore, we find that the proposed gated recursive convolutional network learns a grammatical structure of a sentence automatically.

Key facts. Cited by 1,303 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Sep 2014.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2019: 2; 2020: 1; 2021: 213; 2022: 335; 2023: 324; 2024: 194; 2025: 147; 2026: 87.

1,303 papers.

Sort:

By area:

  1. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  2. 2022Simplified State Space Layers for Sequence Modelingcited by 776
  3. 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 507
  4. 2024Large Language Models: A Surveycited by 506
  5. 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 495
  6. 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 436
  7. 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 397
  8. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
  9. 2021Spectral Temporal Graph Neural Network for Multivariate Time-series Forecastingcited by 298
  10. 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
  11. 2022Recurrent Memory Transformercited by 197
  12. 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
38 more
  1. 2023Putting the Object Back into Video Object Segmentationcited by 182
  2. 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
  3. 2022Graph neural networks for materials science and chemistrycited by 181
  4. 2022Mega: Moving Average Equipped Gated Attentioncited by 178
  5. 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
  6. 2022Translation between Molecules and Natural Languagecited by 173
  7. 2023Think Twice before Driving: Towards Scalable Decoders for End-to-End Autonomous Drivingcited by 168
  8. 2022BRIO: Bringing Order to Abstractive Summarizationcited by 161
  9. 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 154
  10. 2021Probabilistic Embeddings for Cross-Modal Retrievalcited by 150
  11. 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 149
  12. 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 147
  13. 2023Human-Timescale Adaptation in an Open-Ended Task Spacecited by 136
  14. 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
  15. 2022Deep Learning for Time Series Anomaly Detection: A Surveycited by 130
  16. 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
  17. 2022Decoupled Dynamic Spatial-Temporal Graph Neural Network for Traffic Forecastingcited by 122
  18. 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 122
  19. 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
  20. 2023Exploring Progress in Multivariate Time Series Forecasting: Comprehensive Benchmarking and Heterogeneity Analysiscited by 113
  21. 2021Dive into Deep Learningcited by 111
  22. 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
  23. 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulationcited by 103
  24. 2021Modeling Irregular Time Series with Continuous Recurrent Unitscited by 101
  25. 2023The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecastingcited by 100
  26. 2021Neural Flows: Efficient Alternative to Neural ODEscited by 99
  27. 2023Scaling Transformer to 1M tokens and beyond with RMTcited by 97
  28. 2021Finetuning Pretrained Transformers into RNNscited by 94
  29. 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
  30. 2021Appearance-based Gaze Estimation With Deep Learning: A Review and Benchmarkcited by 82
  31. 2022UViM: A Unified Modeling Approach for Vision with Learned Guiding Codescited by 77
  32. 2025Learning from Reward-Free Offline Data: A Case for Planning with Latent Dynamics Modelscited by 77
  33. 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
  34. 2021Self-Supervised Graph Neural Networks for Improved Electroencephalographic Seizure Analysiscited by 75
  35. 2023Efficient and Degree-Guided Graph Generation via Discrete Diffusion Modelingcited by 75
  36. 2024SOFTS: Efficient Multivariate Time Series Forecasting with Series-Core Fusioncited by 75
  37. 2022BYOL-Explore: Exploration by Bootstrapped Predictioncited by 71
  38. 2022Recovering Private Text in Federated Learning of Language Modelscited by 67

50 most cited of 1,303 All 1,303 (JSON)