mlsanityData to 14 Oct 2026

Information-Transport-based Policy for Simultaneous Translation

arXiv 2210.12357 ↗First posted 22 Oct 2022cs.CL cs.AI cs.SDcited by 40

Not on the map. Why?

Abstract (arXiv)

Simultaneous translation (ST) outputs translation while receiving the source inputs, and hence requires a policy to determine whether to translate a target token or wait for the next source token. The major challenge of ST is that each target token can only be translated based on the current received source tokens, where the received source information will directly affect the translation quality. So naturally, how much source information is received for the translation of the current target token is supposed to be the pivotal evidence for the ST policy to decide between translating and waiting. In this paper, we treat the translation as information transport from source to target and accordingly propose an Information-Transport-based Simultaneous Translation (ITST). ITST quantifies the transported information weight from each source token to the current target token, and then decides whether to translate the target token according to its accumulated received information. Experiments on both text-to-text ST and speech-to-text ST (a.k.a., streaming speech translation) tasks show that ITST outperforms strong baselines and achieves state-of-the-art performance.

Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Builds on 35 of its 50 references that are in the map. First posted on arXiv 22 Oct 2022.

Builds on

35 of 50 references.

References · 35

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  3. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  4. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
  5. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  6. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,488
  7. 2020Quantifying Attention Flow in Transformerscited by 775
  8. 2019Attention is not not Explanationcited by 636
  9. 2020fairseq S2T: Fast Speech-to-Text Modeling with fairseqcited by 176
  10. 2019Monotonic Infinite Lookback Attention for Simultaneous Machine Translationcited by 104
  11. 2016Learning to Translate in Real-time with Neural Machine Translationcited by 97
  12. 2020SimulEval: An Evaluation Toolkit for Simultaneous Translationcited by 94
23 more
  1. 2019Monotonic Multihead Attentioncited by 93
  2. 2016Can neural machine translation do simultaneous translation?cited by 86
  3. 2017Online and Linear-Time Attention by Enforcing Monotonic Alignmentscited by 85
  4. 2020ESPnet-ST: All-in-One Speech Translation Toolkitcited by 82
  5. 2020SimulMT to SimulST: Adapting Simultaneous Text Translation to End-to-End Simultaneous Speech Translationcited by 81
  6. 2020Efficient Wait-k Models for Simultaneous Machine Translationcited by 61
  7. 2018Tied Multitask Learning for Neural Speech Translationcited by 54
  8. 2020Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translationcited by 54
  9. 2020Simultaneous Translation Policies: From Fixed to Adaptivecited by 43
  10. 2021RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformercited by 40
  11. 2019Simpler and Faster Learning of Adaptive Policies for Simultaneous Translationcited by 37
  12. 2020Accurate Word Alignment Induction from Neural Machine Translationcited by 32
  13. 2021Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policycited by 32
  14. 2020Future-Guided Incremental Transformer for Simultaneous Translationcited by 30
  15. 2021Learning When to Translate for Streaming Speechcited by 30
  16. 2020Adaptive Feature Selection for End-to-End Speech Translationcited by 25
  17. 2019Simultaneous Translation with Flexible Policy via Restricted Imitation Learningcited by 22
  18. 2022Modeling Dual Read/Write Paths for Simultaneous Machine Translationcited by 21
  19. 2021Modeling Concentrated Cross-Attention for Neural Machine Translation with Gaussian Mixture Modelcited by 18
  20. 2022Gaussian Multi-head Attention for Simultaneous Machine Translationcited by 17
  21. 2022Reducing Position Bias in Simultaneous Machine Translation with Length-Aware Frameworkcited by 16
  22. 2022Wait-info Policy: Balancing Source and Target at Information Level for Simultaneous Machine Translationcited by 16
  23. 2022Turning Fixed to Adaptive: Integrating Post-Evaluation into Simultaneous Machine Translationcited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 13; 2024: 16; 2025: 8; 2026: 1.

40 papers.

Sort:

By area:

  1. 2024TransLLaMa: LLM-based Simultaneous Translation Systemcited by 34
  2. 2022Attention as a Guide for Simultaneous Speech Translationcited by 32
  3. 2023Hidden Markov Transformer for Simultaneous Machine Translationcited by 25
  4. 2023End-to-End Simultaneous Speech Translation with Differentiable Segmentationcited by 22
  5. 2024StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learningcited by 21
  6. 2024StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selectioncited by 19
  7. 2024BESTOW: Efficient and Streamable Speech Language Model with the Best of Two Worlds in GPT and T5cited by 19
  8. 2025Stream-Omni: Simultaneous Multimodal Interactions with Large Language-Vision-Speech Modelcited by 18
  9. 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?cited by 17
  10. 2023Learning Optimal Policy for Simultaneous Machine Translation via Binary Searchcited by 15
  11. 2022Improving Simultaneous Machine Translation with Monolingual Datacited by 13
  12. 2024SiLLM: Large Language Models for Simultaneous Machine Translationcited by 13
28 more
  1. 2025SeqPO-SiMT: Sequential Policy Optimization for Simultaneous Machine Translationcited by 13
  2. 2025Efficient and Adaptive Simultaneous Speech Translation with Fully Unidirectional Architecturecited by 12
  3. 2024Decoder-only Streaming Transformer for Simultaneous Translationcited by 11
  4. 2023Glancing Future for Simultaneous Machine Translationcited by 10
  5. 2023Simultaneous Machine Translation with Tailored Referencecited by 9
  6. 2023Adaptive Policy with Wait-k Model for Simultaneous Translationcited by 9
  7. 2024Simul-Whisper: Attention-Guided Streaming Whisper with Truncation Detectioncited by 7
  8. 2024FASST: Fast LLM-based Simultaneous Speech Translationcited by 7
  9. 2025SimulPL: Aligning Human Preferences in Simultaneous Machine Translationcited by 7
  10. 2023Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inferencecited by 6
  11. 2023Direct Models for Simultaneous Translation and Automatic Subtitling: FBK@IWSLT2023cited by 6
  12. 2023Unified Segment-to-Segment Framework for Simultaneous Sequence Generationcited by 6
  13. 2024Self-Modifying State Modeling for Simultaneous Machine Translationcited by 5
  14. 2025Large Language Models Are Read/Write Policy-Makers for Simultaneous Generationcited by 5
  15. 2025LLMs Can Achieve High-quality Simultaneous Machine Translation as Efficiently as Offlinecited by 5
  16. 2024Conversational SimulMT: Efficient Simultaneous Translation with Large Language Modelscited by 4
  17. 2023Enhanced Simultaneous Machine Translation with Word-level Policiescited by 2
  18. 2023Language Model is a Branch Predictor for Simultaneous Machine Translationcited by 2
  19. 2024Agent-SiMT: Agent-assisted Simultaneous Machine Translation with Large Language Modelscited by 2
  20. 2024Fixed and Adaptive Simultaneous Machine Translation Strategies Using Adapterscited by 2
  21. 2024PsFuture: A Pseudo-Future-based Zero-Shot Adaptive Policy for Simultaneous Machine Translationcited by 2
  22. 2025SASST: Leveraging Syntax-Aware Chunking and LLMs for Simultaneous Speech Translationcited by 2
  23. 2025SimulMEGA: MoE Routers are Advanced Policy Makers for Simultaneous Speech Translationcited by 2
  24. 2023CBSiMT: Mitigating Hallucination in Simultaneous Machine Translation with Weighted Prefix-to-Prefix Trainingcited by 1
  25. 2024On the Hallucination in Simultaneous Machine Translationcited by 1
  26. 2024Anticipating Future with Large Language Model for Simultaneous Machine Translationcited by 1
  27. 2023Context Consistency between Training and Testing in Simultaneous Machine Translationcited by 0
  28. 2026When to Use Extra Context: Evidence-Grounded Terminology Adaptation for Simultaneous Speech Translationcited by 0