mlsanityData to 7 Oct 2026

Exploring Continuous Integrate-and-Fire for Adaptive Simultaneous Speech Translation

arXiv 2204.09595 ↗First posted 22 Mar 2022cs.CL cs.SD eess.AScited by 14

Not on the map. Why?

Abstract (arXiv)

Simultaneous speech translation (SimulST) is a challenging task aiming to translate streaming speech before the complete input is observed. A SimulST system generally includes two components: the pre-decision that aggregates the speech information and the policy that decides to read or write. While recent works had proposed various strategies to improve the pre-decision, they mainly adopt the fixed wait-k policy, leaving the adaptive policies rarely explored. This paper proposes to model the adaptive policy by adapting the Continuous Integrate-and-Fire (CIF). Compared with monotonic multihead attention (MMA), our method has the advantage of simpler computation, superior quality at low latency, and better generalization to long utterances. We conduct experiments on the MuST-C V2 dataset and show the effectiveness of our approach.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 27 of its 39 references that are in the map. First posted on arXiv 22 Mar 2022.

Builds on

27 of 39 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Layer Normalizationcited by 5,579
  3. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  4. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  5. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  6. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  7. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  8. 2016Sequence-Level Knowledge Distillationcited by 761
  9. 2020fairseq S2T: Fast Speech-to-Text Modeling with fairseqcited by 174
  10. 2020Emformer: Efficient Memory Transformer Based Acoustic Model For Low Latency Streaming Speech Recognitioncited by 111
  11. 2019Monotonic Infinite Lookback Attention for Simultaneous Machine Translationcited by 103
  12. 2020SimulEval: An Evaluation Toolkit for Simultaneous Translationcited by 94
15 more
  1. 2019Monotonic Multihead Attentioncited by 91
  2. 2016Can neural machine translation do simultaneous translation?cited by 85
  3. 2017Online and Linear-Time Attention by Enforcing Monotonic Alignmentscited by 85
  4. 2020SimulMT to SimulST: Adapting Simultaneous Text Translation to End-to-End Simultaneous Speech Translationcited by 80
  5. 2020Speech Translation and the End-to-End Promise: Taking Stock of Where We Arecited by 77
  6. 2019CIF: Continuous Integrate-and-Fire for End-to-End Speech Recognitioncited by 76
  7. 2019Transformers with convolutional context for ASRcited by 44
  8. 2021RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformercited by 39
  9. 2021Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASRcited by 31
  10. 2020Streaming Simultaneous Speech Translation with Augmented Memory Transformercited by 30
  11. 2021Learning When to Translate for Streaming Speechcited by 30
  12. 2019Thinking Slow about Latency Evaluation for Simultaneous Machine Translationcited by 28
  13. 2021Efficiently Fusing Pretrained Acoustic and Linguistic Encoders for Low-resource Speech Recognitioncited by 17
  14. 2020A Comparison of Label-Synchronous and Frame-Synchronous End-to-End Models for Speech Recognitioncited by 8
  15. 2021Impact of Encoding and Segmentation Strategies on End-to-End Simultaneous Speech Translationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 5; 2024: 4; 2025: 2; 2026: 1.

14 papers.

Sort:

  1. 2022Attention as a Guide for Simultaneous Speech Translationcited by 32
  2. 2023Hybrid Transducer and Attention based Encoder-Decoder Modeling for Speech-to-Text Taskscited by 20
  3. 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?cited by 17
  4. 2023Recent Advances in Direct Speech-to-text Translationcited by 15
  5. 2023End-to-End Speech-to-Text Translation: A Surveycited by 9
  6. 2023Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inferencecited by 6
  7. 2023Direct Models for Simultaneous Translation and Automatic Subtitling: FBK@IWSLT2023cited by 6
  8. 2024Recent Advances in End-to-End Simultaneous Speech Translationcited by 5
  9. 2024Label-Synchronous Neural Transducer for E2E Simultaneous Speech Translationcited by 5
  10. 2022AdaTranS: Adapting with Boundary-based Shrinking for End-to-End Speech Translationcited by 3
  11. 2025SimulS2S-LLM: Unlocking Simultaneous Inference of Speech LLMs for Speech-to-Speech Translationcited by 3
  12. 2024Streaming Sequence Transduction through Dynamic Compressioncited by 2
2 more
  1. 2025SimulSense: Sense-Driven Interpreting for Efficient Simultaneous Speech Translationcited by 0
  2. 2026Streaming Speech-to-Text Translation with a SpeechLLMcited by 0