Turning Fixed to Adaptive: Integrating Post-Evaluation into Simultaneous Machine Translation
Not on the map. Why?
Abstract (arXiv)
Simultaneous machine translation (SiMT) starts its translation before reading the whole source sentence and employs either fixed or adaptive policy to generate the target sentence. Compared to the fixed policy, the adaptive policy achieves better latency-quality tradeoffs by adopting a flexible translation policy. If the policy can evaluate rationality before taking action, the probability of incorrect actions will also decrease. However, previous methods lack evaluation of actions before taking them. In this paper, we propose a method of performing the adaptive policy via integrating post-evaluation into the fixed policy. Specifically, whenever a candidate token is generated, our model will evaluate the rationality of the next action by measuring the change in the source content. Our model will then take different actions based on the evaluation results. Experiments on three translation tasks show that our method can exceed strong baselines under all latency.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 21 of its 32 references that are in the map. First posted on arXiv 21 Oct 2022.
Builds on
21 of 32 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
- 2017Dynamic Routing Between Capsulescited by 689
- 2019Monotonic Infinite Lookback Attention for Simultaneous Machine Translationcited by 103
- 2016Learning to Translate in Real-time with Neural Machine Translationcited by 97
- 2019Monotonic Multihead Attentioncited by 91
- 2020Efficient Wait-k Models for Simultaneous Machine Translationcited by 59
- 2018Incremental Decoding and Training Methods for Simultaneous Translation in Neural Machine Translationcited by 51
- 2020Simultaneous Translation Policies: From Fixed to Adaptivecited by 42
- 2019Simpler and Faster Learning of Adaptive Policies for Simultaneous Translationcited by 36
- 2021Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policycited by 32
9 more
- 2020Future-Guided Incremental Transformer for Simultaneous Translationcited by 30
- 2022Modeling Dual Read/Write Paths for Simultaneous Machine Translationcited by 21
- 2021Modeling Concentrated Cross-Attention for Neural Machine Translation with Gaussian Mixture Modelcited by 18
- 2022Gaussian Multi-head Attention for Simultaneous Machine Translationcited by 17
- 2022Reducing Position Bias in Simultaneous Machine Translation with Length-Aware Frameworkcited by 16
- 2022Wait-info Policy: Balancing Source and Target at Information Level for Simultaneous Machine Translationcited by 16
- 2019Dynamic Layer Aggregation for Neural Machine Translation with Routing-by-Agreementcited by 11
- 2019Dynamic Past and Future for Neural Machine Translationcited by 5
- 2018Towards Linear Time Neural Machine Translation with Capsule Networkscited by 4
Built on by
Citing papers per year: 2022: 1; 2023: 9; 2024: 4.
14 papers.
Sort:
By area:
- 2022Information-Transport-based Policy for Simultaneous Translationcited by 40
- 2023Hidden Markov Transformer for Simultaneous Machine Translationcited by 24
- 2023End-to-End Simultaneous Speech Translation with Differentiable Segmentationcited by 22
- 2024StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learningcited by 20
- 2023Learning Optimal Policy for Simultaneous Machine Translation via Binary Searchcited by 15
- 2024Decoder-only Streaming Transformer for Simultaneous Translationcited by 11
- 2023Glancing Future for Simultaneous Machine Translationcited by 10
- 2023Simultaneous Machine Translation with Tailored Referencecited by 9
- 2023Unified Segment-to-Segment Framework for Simultaneous Sequence Generationcited by 6
- 2023TAPIR: Learning Adaptive Revision for Incremental Natural Language Understanding with a Two-Pass Modelcited by 5
- 2023Enhanced Simultaneous Machine Translation with Word-level Policiescited by 2
- 2024Agent-SiMT: Agent-assisted Simultaneous Machine Translation with Large Language Modelscited by 2
- 2024On the Hallucination in Simultaneous Machine Translation11 Jun 2024
- 2024Agent-SiMT: Agent-assisted Simultaneous Machine Translation with Large Language Models11 Jun 2024
- 2024Decoder-only Streaming Transformer for Simultaneous Translation6 Jun 2024
- 2024StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learning5 Jun 2024
- 2023Context Consistency between Training and Testing in Simultaneous Machine Translation13 Nov 2023
- 2023Unified Segment-to-Segment Framework for Simultaneous Sequence Generation27 Oct 2023
- 2023Enhanced Simultaneous Machine Translation with Word-level Policies25 Oct 2023
- 2023Simultaneous Machine Translation with Tailored Reference20 Oct 2023
- 2023Glancing Future for Simultaneous Machine Translation12 Sep 2023
- 2023End-to-End Simultaneous Speech Translation with Differentiable Segmentation25 May 2023
- 2023Learning Optimal Policy for Simultaneous Machine Translation via Binary Search22 May 2023
- 2023TAPIR: Learning Adaptive Revision for Incremental Natural Language Understanding with a Two-Pass Model18 May 2023
2 more
- 2022Information-Transport-based Policy for Simultaneous Translationcited by 40
- 2023Hidden Markov Transformer for Simultaneous Machine Translationcited by 24
- 2023End-to-End Simultaneous Speech Translation with Differentiable Segmentationcited by 22
- 2024StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learningcited by 20
- 2023Learning Optimal Policy for Simultaneous Machine Translation via Binary Searchcited by 15
- 2024Decoder-only Streaming Transformer for Simultaneous Translationcited by 11
- 2023Glancing Future for Simultaneous Machine Translationcited by 10
- 2023Simultaneous Machine Translation with Tailored Referencecited by 9
- 2023Unified Segment-to-Segment Framework for Simultaneous Sequence Generationcited by 6
- 2023TAPIR: Learning Adaptive Revision for Incremental Natural Language Understanding with a Two-Pass Modelcited by 5
- 2023Enhanced Simultaneous Machine Translation with Word-level Policiescited by 2
- 2024On the Hallucination in Simultaneous Machine Translationcited by 1
12 most cited of 13 All 13 (JSON)
- 2024On the Hallucination in Simultaneous Machine Translation11 Jun 2024
- 2024Decoder-only Streaming Transformer for Simultaneous Translation6 Jun 2024
- 2024StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learning5 Jun 2024
- 2023Context Consistency between Training and Testing in Simultaneous Machine Translation13 Nov 2023
- 2023Unified Segment-to-Segment Framework for Simultaneous Sequence Generation27 Oct 2023
- 2023Enhanced Simultaneous Machine Translation with Word-level Policies25 Oct 2023
- 2023Simultaneous Machine Translation with Tailored Reference20 Oct 2023
- 2023Glancing Future for Simultaneous Machine Translation12 Sep 2023
- 2023End-to-End Simultaneous Speech Translation with Differentiable Segmentation25 May 2023
- 2023Learning Optimal Policy for Simultaneous Machine Translation via Binary Search22 May 2023
- 2023TAPIR: Learning Adaptive Revision for Incremental Natural Language Understanding with a Two-Pass Model18 May 2023
- 2023Hidden Markov Transformer for Simultaneous Machine Translation1 Mar 2023
12 newest of 13 All 13 (JSON)