mlsanityData to 7 Oct 2026

Turning Fixed to Adaptive: Integrating Post-Evaluation into Simultaneous Machine Translation

arXiv 2210.11900 ↗First posted 21 Oct 2022cs.CL cs.AIcited by 14

Not on the map. Why?

Abstract (arXiv)

Simultaneous machine translation (SiMT) starts its translation before reading the whole source sentence and employs either fixed or adaptive policy to generate the target sentence. Compared to the fixed policy, the adaptive policy achieves better latency-quality tradeoffs by adopting a flexible translation policy. If the policy can evaluate rationality before taking action, the probability of incorrect actions will also decrease. However, previous methods lack evaluation of actions before taking them. In this paper, we propose a method of performing the adaptive policy via integrating post-evaluation into the fixed policy. Specifically, whenever a candidate token is generated, our model will evaluate the rationality of the next action by measuring the change in the source content. Our model will then take different actions based on the evaluation results. Experiments on three translation tasks show that our method can exceed strong baselines under all latency.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 21 of its 32 references that are in the map. First posted on arXiv 21 Oct 2022.

Builds on

21 of 32 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  3. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  4. 2017Dynamic Routing Between Capsulescited by 689
  5. 2019Monotonic Infinite Lookback Attention for Simultaneous Machine Translationcited by 103
  6. 2016Learning to Translate in Real-time with Neural Machine Translationcited by 97
  7. 2019Monotonic Multihead Attentioncited by 91
  8. 2020Efficient Wait-k Models for Simultaneous Machine Translationcited by 59
  9. 2018Incremental Decoding and Training Methods for Simultaneous Translation in Neural Machine Translationcited by 51
  10. 2020Simultaneous Translation Policies: From Fixed to Adaptivecited by 42
  11. 2019Simpler and Faster Learning of Adaptive Policies for Simultaneous Translationcited by 36
  12. 2021Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policycited by 32
9 more
  1. 2020Future-Guided Incremental Transformer for Simultaneous Translationcited by 30
  2. 2022Modeling Dual Read/Write Paths for Simultaneous Machine Translationcited by 21
  3. 2021Modeling Concentrated Cross-Attention for Neural Machine Translation with Gaussian Mixture Modelcited by 18
  4. 2022Gaussian Multi-head Attention for Simultaneous Machine Translationcited by 17
  5. 2022Reducing Position Bias in Simultaneous Machine Translation with Length-Aware Frameworkcited by 16
  6. 2022Wait-info Policy: Balancing Source and Target at Information Level for Simultaneous Machine Translationcited by 16
  7. 2019Dynamic Layer Aggregation for Neural Machine Translation with Routing-by-Agreementcited by 11
  8. 2019Dynamic Past and Future for Neural Machine Translationcited by 5
  9. 2018Towards Linear Time Neural Machine Translation with Capsule Networkscited by 4

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 9; 2024: 4.

14 papers.

Sort:

By area: