Tensor2Tensor for Neural Machine Translation
Not on the map. Why?
Abstract (arXiv)
Tensor2Tensor is a library for deep learning models that is well-suited for neural machine translation and includes the reference implementation of the state-of-the-art Transformer model.
Key facts. Cited by 85 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 39; 2022: 15; 2023: 14; 2024: 6; 2025: 8; 2026: 3.
85 papers.
Sort:
By area:
- 2021A Survey of Transformerscited by 401
- 2022Scaling Up Models and Data with textttt5x and textttseqiocited by 187
- 2021Hurdles to Progress in Long-form Question Answeringcited by 167
- 2021Primer: Searching for Efficient Transformers for Language Modelingcited by 164
- 2021FastMoE: A Fast Mixture-of-Expert Training Systemcited by 112
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 109
- 2021Luna: Linear Unified Nested Attentioncited by 96
- 2021Do Transformer Modifications Transfer Across Implementations and Applications?cited by 87
- 2023ChatGPT or Human? Detect and Explain. Explaining Decisions of Machine Learning Model for Detecting Short ChatGPT-generated Textcited by 85
- 2023Dynamic Context Pruning for Efficient and Interpretable Autoregressive Transformerscited by 67
- 2022General-purpose, long-context autoregressive modeling with Perceiver ARcited by 60
- 2021Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Modelscited by 56
38 more
- 2023AttentionViz: A Global View of Transformer Attentioncited by 50
- 2021The Low-Resource Double Bind: An Empirical Study of Pruning for Low-Resource Machine Translationcited by 47
- 2023Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decodercited by 44
- 2021Counter-Interference Adapter for Multilingual Machine Translationcited by 40
- 2023Transformers in Speech Processing: A Surveycited by 39
- 2022On the Explainability of Natural Language Processing Deep Modelscited by 38
- 2021A Simple and Effective Positional Encoding for Transformerscited by 37
- 2021Leveraging redundancy in attention with Reuse Transformerscited by 33
- 2021Many-to-English Machine Translation Tools, Data, and Pretrained Modelscited by 31
- 2021MUFASA: Multimodal Fusion Architecture Search for Electronic Health Recordscited by 30
- 2021First the worst: Finding better gender translations during beam searchcited by 29
- 2021Full Page Handwriting Recognition via Image to Sequence Extractioncited by 24
- 2021Rethinking Skip Connection with Layer Normalization in Transformers and ResNetscited by 22
- 2021Transformers are Deep Infinite-Dimensional Non-Mercer Binary Kernel Machinescited by 22
- 2021VisuoSpatial Foresight for Physical Sequential Fabric Manipulationcited by 18
- 2021A Deep Adversarial Model for Suffix and Remaining Time Prediction of Event Sequencescited by 17
- 2021TranSmart: A Practical Interactive Machine Translation Systemcited by 17
- 2022Set Norm and Equivariant Skip Connections: Putting the Deep in Deep Setscited by 17
- 2022How to keep text private? A systematic review of deep learning methods for privacy-preserving natural language processingcited by 16
- 2022B2T Connection: Serving Stability and Performance in Deep Transformerscited by 16
- 2021TextBox: A Unified, Modularized, and Extensible Framework for Text Generationcited by 15
- 2021Benchmarking and scaling of deep learning models for land cover image classificationcited by 14
- 2021Billion-scale Pre-trained E-commerce Product Knowledge Graph Modelcited by 13
- 2021Capitalization and Punctuation Restoration: a Surveycited by 13
- 2022Hausa Visual Genome: A Dataset for Multi-Modal English to Hausa Machine Translationcited by 13
- 2023HaVQA: A Dataset for Visual Question Answering and Multimodal Research in Hausa Languagecited by 12
- 2021Extended Parallel Corpus for Amharic-English Machine Translationcited by 10
- 2022A Call for Clarity in Beam Search: How It Works and When It Stopscited by 10
- 2023Synthetically generated text for supervised text analysiscited by 10
- 2021Spelling Correction with Denoising Transformercited by 9
- 2021Compositional Generalization in Multilingual Semantic Parsing over Wikidatacited by 9
- 2023Mutation-Based Adversarial Attacks on Neural Text Detectorscited by 9
- 2023string2string: A Modern Python Library for String-to-String Algorithmscited by 9
- 2023CodeBPE: Investigating Subtokenization Options for Large Language Model Pretraining on Source Codecited by 9
- 2022NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialoguecited by 8
- 2021YANMTT: Yet Another Neural Machine Translation Toolkitcited by 7
- 2021Say What? Collaborative Pop Lyric Generation Using Multitask Transfer Learningcited by 7
- 2023Introducing Rhetorical Parallelism Detection: A New Task with Datasets, Metrics, and Baselinescited by 7
50 most cited of 85 All 85 (JSON)
- 2026Multi-Head Attention-Based Feature Extractor Integration with Soft Actor-Critic for Porosity Prediction and Process Parameter Optimization in Additive Manufacturing18 Jun 2026
- 2026Towards Privacy-Preserving Machine Translation at the Inference Stage: A New Task and Benchmark16 Mar 2026
- 2026Explicit Grammar Semantic Feature Fusion for Robust Text Classification24 Feb 2026
- 2025Large Language Models for the Summarization of Czech Documents: From History to the Present24 Nov 2025
- 2025A Multimodal Approach to Heritage Preservation in the Context of Climate Change15 Oct 2025
- 2025Facilitating Cognitive Accessibility with LLMs: A Multi-Task Approach to Easy-to-Read Text Generation1 Oct 2025
- 2025Large Language Models for Summarizing Czech Historical Documents and Beyond14 Aug 2025
- 2025Lightweight and Interpretable Transformer via Mixed Graph Algorithm Unrolling for Traffic Forecast19 May 2025
- 2025A Local Polyak-Lojasiewicz and Descent Lemma of Gradient Descent For Overparametrized Linear Models16 May 2025
- 2025Efficient Time Series Forecasting via Hyper-Complex Models and Frequency Aggregation27 Feb 2025
- 2025EVaDE : Event-Based Variational Thompson Sampling for Model-Based Reinforcement Learning16 Jan 2025
- 2024Domain adapted machine translation: What does catastrophic forgetting forget and why?23 Dec 2024
38 more
- 2024Building Dialogue Understanding Models for Low-resource Language Indonesian from Scratch24 Oct 2024
- 2024A survey of neural-network-based methods utilising comparable data for finding translation equivalents19 Oct 2024
- 2024Computational Approaches to Arabic-English Code-Switching17 Oct 2024
- 2024Do We Trust What They Say or What They Do? A Multimodal User Embedding Provides Personalized Explanations4 Sep 2024
- 2024Separable Physics-Informed Neural Networks for the solution of elasticity problems24 Jan 2024
- 2023Introducing Rhetorical Parallelism Detection: A New Task with Datasets, Metrics, and Baselines30 Nov 2023
- 2023CodeBPE: Investigating Subtokenization Options for Large Language Model Pretraining on Source Code1 Aug 2023
- 20233D Medical Image Segmentation based on multi-scale MPU-Net11 Jul 2023
- 2023HaVQA: A Dataset for Visual Question Answering and Multimodal Research in Hausa Language28 May 2023
- 2023Dynamic Context Pruning for Efficient and Interpretable Autoregressive Transformers25 May 2023
- 2023Exploring the Impact of Layer Normalization for Zero-shot Neural Machine Translation16 May 2023
- 2023AttentionViz: A Global View of Transformer Attention4 May 2023
- 2023string2string: A Modern Python Library for String-to-String Algorithms27 Apr 2023
- 2023Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decoder8 Apr 2023
- 2023About optimal loss function for training physics-informed neural networks under respecting causality5 Apr 2023
- 2023Synthetically generated text for supervised text analysis28 Mar 2023
- 2023Transformers in Speech Processing: A Survey21 Mar 2023
- 2023Mutation-Based Adversarial Attacks on Neural Text Detectors11 Feb 2023
- 2023ChatGPT or Human? Detect and Explain. Explaining Decisions of Machine Learning Model for Detecting Short ChatGPT-generated Text30 Jan 2023
- 2022CUNI Systems for the WMT22 Czech-Ukrainian Translation Task1 Dec 2022
- 2022QNet: A Quantum-native Sequence Encoder Architecture31 Oct 2022
- 2022Tools for Extracting Spatio-Temporal Patterns in Meteorological Image Sequences: From Feature Engineering to Attention-Based Neural Networks22 Oct 2022
- 2022On the Explainability of Natural Language Processing Deep Models13 Oct 2022
- 2022PARAGEN : A Parallel Generation Toolkit7 Oct 2022
- 2022A Deep Investigation of RNN and Self-attention for the Cyrillic-Traditional Mongolian Bidirectional Conversion24 Sep 2022
- 2022Set Norm and Equivariant Skip Connections: Putting the Deep in Deep Sets23 Jun 2022
- 2022B2T Connection: Serving Stability and Performance in Deep Transformers1 Jun 2022
- 2022How to keep text private? A systematic review of deep learning methods for privacy-preserving natural language processing20 May 2022
- 2022Optimizing Mixture of Experts using Dynamic Recompilations4 May 2022
- 2022Hausa Visual Genome: A Dataset for Multi-Modal English to Hausa Machine Translation2 May 2022
- 2022NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialogue27 Apr 2022
- 2022A Call for Clarity in Beam Search: How It Works and When It Stops11 Apr 2022
- 2022Scaling Up Models and Data with textttt5x and textttseqio31 Mar 2022
- 2022General-purpose, long-context autoregressive modeling with Perceiver AR15 Feb 2022
- 2021Capitalization and Punctuation Restoration: a Survey21 Nov 2021
- 2021Benchmarking and scaling of deep learning models for land cover image classification18 Nov 2021
- 2021Say What? Collaborative Pop Lyric Generation Using Multitask Transfer Learning15 Nov 2021
- 2021Leveraging redundancy in attention with Reuse Transformers13 Oct 2021
50 newest of 85 All 85 (JSON)
- 2021FastMoE: A Fast Mixture-of-Expert Training Systemcited by 112
- 2022Optimizing Mixture of Experts using Dynamic Recompilationscited by 4
- 2022Optimizing Mixture of Experts using Dynamic Recompilations4 May 2022
- 2021FastMoE: A Fast Mixture-of-Expert Training System24 Mar 2021
- 2021A Survey of Transformerscited by 401
- 2022Scaling Up Models and Data with textttt5x and textttseqiocited by 187
- 2021Hurdles to Progress in Long-form Question Answeringcited by 167
- 2021Primer: Searching for Efficient Transformers for Language Modelingcited by 164
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 109
- 2021Luna: Linear Unified Nested Attentioncited by 96
- 2021Do Transformer Modifications Transfer Across Implementations and Applications?cited by 87
- 2023ChatGPT or Human? Detect and Explain. Explaining Decisions of Machine Learning Model for Detecting Short ChatGPT-generated Textcited by 85
- 2023Dynamic Context Pruning for Efficient and Interpretable Autoregressive Transformerscited by 67
- 2022General-purpose, long-context autoregressive modeling with Perceiver ARcited by 60
- 2021Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Modelscited by 56
- 2023AttentionViz: A Global View of Transformer Attentioncited by 50
12 most cited of 81 All 81 (JSON)
- 2026Towards Privacy-Preserving Machine Translation at the Inference Stage: A New Task and Benchmark16 Mar 2026
- 2026Explicit Grammar Semantic Feature Fusion for Robust Text Classification24 Feb 2026
- 2025Large Language Models for the Summarization of Czech Documents: From History to the Present24 Nov 2025
- 2025A Multimodal Approach to Heritage Preservation in the Context of Climate Change15 Oct 2025
- 2025Facilitating Cognitive Accessibility with LLMs: A Multi-Task Approach to Easy-to-Read Text Generation1 Oct 2025
- 2025Large Language Models for Summarizing Czech Historical Documents and Beyond14 Aug 2025
- 2025Lightweight and Interpretable Transformer via Mixed Graph Algorithm Unrolling for Traffic Forecast19 May 2025
- 2025A Local Polyak-Lojasiewicz and Descent Lemma of Gradient Descent For Overparametrized Linear Models16 May 2025
- 2025Efficient Time Series Forecasting via Hyper-Complex Models and Frequency Aggregation27 Feb 2025
- 2024Domain adapted machine translation: What does catastrophic forgetting forget and why?23 Dec 2024
- 2024Building Dialogue Understanding Models for Low-resource Language Indonesian from Scratch24 Oct 2024
- 2024A survey of neural-network-based methods utilising comparable data for finding translation equivalents19 Oct 2024
12 newest of 81 All 81 (JSON)