Incremental Decoding and Training Methods for Simultaneous Translation in Neural Machine Translation
Not on the map. Why?
Abstract (arXiv)
We address the problem of simultaneous translation by modifying the Neural MT decoder to operate with dynamically built encoder and attention. We propose a tunable agent which decides the best segmentation strategy for a user-defined BLEU loss and Average Proportion (AP) constraint. Our agent outperforms previously proposed Wait-if-diff and Wait-if-worse agents (Cho and Esipova, 2016) on BLEU with a lower latency. Secondly we proposed data-driven changes to Neural MT training to better match the incremental decoding framework.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 18; 2022: 6; 2023: 12; 2024: 8; 2025: 5; 2026: 1.
51 papers.
Sort:
By area:
- 2021RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformercited by 39
- 2024TransLLaMa: LLM-based Simultaneous Translation Systemcited by 34
- 2021Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policycited by 32
- 2021Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASRcited by 31
- 2021Learning When to Translate for Streaming Speechcited by 30
- 2023Hidden Markov Transformer for Simultaneous Machine Translationcited by 24
- 2022Modeling Dual Read/Write Paths for Simultaneous Machine Translationcited by 21
- 2022Gaussian Multi-head Attention for Simultaneous Machine Translationcited by 17
- 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?cited by 17
- 2023Learning Optimal Policy for Simultaneous Machine Translation via Binary Searchcited by 15
- 2021An Empirical Study of End-to-end Simultaneous Speech Translation Decoding Strategiescited by 14
- 2022Turning Fixed to Adaptive: Integrating Post-Evaluation into Simultaneous Machine Translationcited by 14
38 more
- 2025Chronological Thinking in Full-Duplex Spoken Dialogue Language Modelscited by 13
- 2024Decoder-only Streaming Transformer for Simultaneous Translationcited by 11
- 2020Learning Coupled Policies for Simultaneous Machine Translation using Imitation Learningcited by 10
- 2021Direct Simultaneous Speech-to-Speech Translation with Variational Monotonic Multihead Attentioncited by 9
- 2022From Simultaneous to Streaming Machine Translation by Leveraging Streaming Historycited by 9
- 2023Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoffcited by 8
- 2023Adaptive Policy with Wait-k Model for Simultaneous Translationcited by 8
- 2023Efficient Monotonic Multihead Attentioncited by 8
- 2021Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translationcited by 7
- 2021SimulLR: Simultaneous Lip Reading Transducer with Attention-Guided Adaptive Memorycited by 7
- 2021Simultaneous Multi-Pivot Neural Machine Translationcited by 6
- 2023Tagged End-to-End Simultaneous Speech Translation Training using Simultaneous Interpretation Datacited by 6
- 2023Long-Form End-to-End Speech Translation via Latent Alignment Segmentationcited by 6
- 2022Anticipation-Free Training for Simultaneous Machine Translationcited by 5
- 2021Impact of Encoding and Segmentation Strategies on End-to-End Simultaneous Speech Translationcited by 4
- 2021Monotonic Simultaneous Translation with Chunk-wise Reordering and Refinementcited by 4
- 2023Efficient Encoders for Streaming Sequence Taggingcited by 4
- 2023LEAPT: Learning Adaptive Prefix-to-prefix Translation For Simultaneous Machine Translationcited by 4
- 2025Simulstream: Open-Source Toolkit for Evaluation and Demonstration of Streaming Speech-to-Text Translation Systemscited by 4
- 2021Optimizing Latency for Online Video CaptioningUsing Audio-Visual Transformerscited by 3
- 2021Simultaneous Neural Machine Translation with Constituent Label Predictioncited by 3
- 2023Long-form Simultaneous Speech Translation: Thesis Proposalcited by 3
- 2024Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Paircited by 3
- 2025Spatial Speech Translation: Translating Across Space With Binaural Hearablescited by 3
- 2021Visualization: the missing factor in Simultaneous Speech Translationcited by 2
- 2022Supervised Visual Attention for Simultaneous Multimodal Machine Translationcited by 2
- 2023Enhanced Simultaneous Machine Translation with Word-level Policiescited by 2
- 2024Agent-SiMT: Agent-assisted Simultaneous Machine Translation with Large Language Modelscited by 2
- 2024PsFuture: A Pseudo-Future-based Zero-Shot Adaptive Policy for Simultaneous Machine Translationcited by 2
- 2021Infusing Future Information into Monotonic Attention Through Language Modelscited by 1
- 2024R-BI: Regularized Batched Inputs enhance Incremental Decoding Framework for Low-Latency Simultaneous Speech Translationcited by 1
- 2024NAIST Simultaneous Speech Translation System for IWSLT 2024cited by 1
- 2025Non-Monotonic Attention-based Read/Write Policy Learning for Simultaneous Translationcited by 1
- 2021Recoding latent sentence representations -- Dynamic gradient-based activation modification in RNNscited by 0
- 2021Full-Sentence Models Perform Better in Simultaneous Translation Using the Information Enhanced Decoding Strategycited by 0
- 2021Reinforcement Learning for on-line Sequence Transformationcited by 0
- 2023Context Consistency between Training and Testing in Simultaneous Machine Translationcited by 0
- 2025Overcoming Latency Bottlenecks in On-Device Speech Translation: A Cascaded Approach with Alignment-Based Streaming MTcited by 0
50 most cited of 51 All 51 (JSON)
- 2026Dual-Stream Simultaneous Translation via 2D Grid Attention28 Sep 2026
- 2025Simulstream: Open-Source Toolkit for Evaluation and Demonstration of Streaming Speech-to-Text Translation Systems19 Dec 2025
- 2025Chronological Thinking in Full-Duplex Spoken Dialogue Language Models2 Oct 2025
- 2025Overcoming Latency Bottlenecks in On-Device Speech Translation: A Cascaded Approach with Alignment-Based Streaming MT18 Aug 2025
- 2025Spatial Speech Translation: Translating Across Space With Binaural Hearables25 Apr 2025
- 2025Non-Monotonic Attention-based Read/Write Policy Learning for Simultaneous Translation28 Mar 2025
- 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?24 Dec 2024
- 2024PsFuture: A Pseudo-Future-based Zero-Shot Adaptive Policy for Simultaneous Machine Translation5 Oct 2024
- 2024NAIST Simultaneous Speech Translation System for IWSLT 202430 Jun 2024
- 2024Agent-SiMT: Agent-assisted Simultaneous Machine Translation with Large Language Models11 Jun 2024
- 2024Decoder-only Streaming Transformer for Simultaneous Translation6 Jun 2024
- 2024Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Pair18 Apr 2024
38 more
- 2024TransLLaMa: LLM-based Simultaneous Translation System7 Feb 2024
- 2024R-BI: Regularized Batched Inputs enhance Incremental Decoding Framework for Low-Latency Simultaneous Speech Translation11 Jan 2024
- 2023Efficient Monotonic Multihead Attention7 Dec 2023
- 2023Context Consistency between Training and Testing in Simultaneous Machine Translation13 Nov 2023
- 2023Enhanced Simultaneous Machine Translation with Word-level Policies25 Oct 2023
- 2023Adaptive Policy with Wait-k Model for Simultaneous Translation23 Oct 2023
- 2023Long-form Simultaneous Speech Translation: Thesis Proposal17 Oct 2023
- 2023Long-Form End-to-End Speech Translation via Latent Alignment Segmentation20 Sep 2023
- 2023Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoff20 Sep 2023
- 2023Tagged End-to-End Simultaneous Speech Translation Training using Simultaneous Interpretation Data14 Jun 2023
- 2023Learning Optimal Policy for Simultaneous Machine Translation via Binary Search22 May 2023
- 2023LEAPT: Learning Adaptive Prefix-to-prefix Translation For Simultaneous Machine Translation21 Mar 2023
- 2023Hidden Markov Transformer for Simultaneous Machine Translation1 Mar 2023
- 2023Efficient Encoders for Streaming Sequence Tagging23 Jan 2023
- 2022Turning Fixed to Adaptive: Integrating Post-Evaluation into Simultaneous Machine Translation21 Oct 2022
- 2022Modeling Dual Read/Write Paths for Simultaneous Machine Translation17 Mar 2022
- 2022Gaussian Multi-head Attention for Simultaneous Machine Translation17 Mar 2022
- 2022From Simultaneous to Streaming Machine Translation by Leveraging Streaming History4 Mar 2022
- 2022Anticipation-Free Training for Simultaneous Machine Translation30 Jan 2022
- 2022Supervised Visual Attention for Simultaneous Multimodal Machine Translation23 Jan 2022
- 2021Visualization: the missing factor in Simultaneous Speech Translation31 Oct 2021
- 2021Simultaneous Neural Machine Translation with Constituent Label Prediction26 Oct 2021
- 2021Monotonic Simultaneous Translation with Chunk-wise Reordering and Refinement18 Oct 2021
- 2021Direct Simultaneous Speech-to-Speech Translation with Variational Monotonic Multihead Attention15 Oct 2021
- 2021Learning When to Translate for Streaming Speech15 Sep 2021
- 2021Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy11 Sep 2021
- 2021Infusing Future Information into Monotonic Attention Through Language Models7 Sep 2021
- 2021SimulLR: Simultaneous Lip Reading Transducer with Attention-Guided Adaptive Memory31 Aug 2021
- 2021Optimizing Latency for Online Video CaptioningUsing Audio-Visual Transformers4 Aug 2021
- 2021Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASR11 Jun 2021
- 2021RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformer9 Jun 2021
- 2021Reinforcement Learning for on-line Sequence Transformation28 May 2021
- 2021Full-Sentence Models Perform Better in Simultaneous Translation Using the Information Enhanced Decoding Strategy5 May 2021
- 2021Impact of Encoding and Segmentation Strategies on End-to-End Simultaneous Speech Translation29 Apr 2021
- 2021Simultaneous Multi-Pivot Neural Machine Translation15 Apr 2021
- 2021An Empirical Study of End-to-end Simultaneous Speech Translation Decoding Strategies4 Mar 2021
- 2021Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation22 Feb 2021
- 2021Recoding latent sentence representations -- Dynamic gradient-based activation modification in RNNs3 Jan 2021
50 newest of 51 All 51 (JSON)
- 2021RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformercited by 39
- 2024TransLLaMa: LLM-based Simultaneous Translation Systemcited by 34
- 2021Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASRcited by 31
- 2021Learning When to Translate for Streaming Speechcited by 30
- 2023Hidden Markov Transformer for Simultaneous Machine Translationcited by 24
- 2022Modeling Dual Read/Write Paths for Simultaneous Machine Translationcited by 21
- 2022Gaussian Multi-head Attention for Simultaneous Machine Translationcited by 17
- 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?cited by 17
- 2023Learning Optimal Policy for Simultaneous Machine Translation via Binary Searchcited by 15
- 2021An Empirical Study of End-to-end Simultaneous Speech Translation Decoding Strategiescited by 14
- 2022Turning Fixed to Adaptive: Integrating Post-Evaluation into Simultaneous Machine Translationcited by 14
- 2024Decoder-only Streaming Transformer for Simultaneous Translationcited by 11
12 most cited of 47 All 47 (JSON)
- 2026Dual-Stream Simultaneous Translation via 2D Grid Attention28 Sep 2026
- 2025Simulstream: Open-Source Toolkit for Evaluation and Demonstration of Streaming Speech-to-Text Translation Systems19 Dec 2025
- 2025Overcoming Latency Bottlenecks in On-Device Speech Translation: A Cascaded Approach with Alignment-Based Streaming MT18 Aug 2025
- 2025Spatial Speech Translation: Translating Across Space With Binaural Hearables25 Apr 2025
- 2025Non-Monotonic Attention-based Read/Write Policy Learning for Simultaneous Translation28 Mar 2025
- 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?24 Dec 2024
- 2024PsFuture: A Pseudo-Future-based Zero-Shot Adaptive Policy for Simultaneous Machine Translation5 Oct 2024
- 2024NAIST Simultaneous Speech Translation System for IWSLT 202430 Jun 2024
- 2024Decoder-only Streaming Transformer for Simultaneous Translation6 Jun 2024
- 2024Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Pair18 Apr 2024
- 2024TransLLaMa: LLM-based Simultaneous Translation System7 Feb 2024
- 2024R-BI: Regularized Batched Inputs enhance Incremental Decoding Framework for Low-Latency Simultaneous Speech Translation11 Jan 2024
12 newest of 47 All 47 (JSON)