mlsanityData to 14 Oct 2026

SlowFast Network for Continuous Sign Language Recognition

arXiv 2309.12304 ↗First posted 21 Sep 2023cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

The objective of this work is the effective extraction of spatial and dynamic features for Continuous Sign Language Recognition (CSLR). To accomplish this, we utilise a two-pathway SlowFast network, where each pathway operates at distinct temporal resolutions to separately capture spatial (hand shapes, facial expressions) and dynamic (movements) information. In addition, we introduce two distinct feature fusion methods, carefully designed for the characteristics of CSLR: (1) Bi-directional Feature Fusion (BFF), which facilitates the transfer of dynamic semantics into spatial semantics and vice versa; and (2) Pathway Feature Enhancement (PFE), which enriches dynamic and spatial representations through auxiliary subnetworks, while avoiding the need for extra inference time. As a result, our model further strengthens spatial and dynamic representations in parallel. We demonstrate that the proposed framework outperforms the current state-of-the-art performance on popular CSLR datasets, including PHOENIX14, PHOENIX14-T, and CSL-Daily.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 21 Sep 2023.

Builds on

20 of 35 references.

References · 20

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  3. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  4. 2018SlowFast Networks for Video Recognitioncited by 1,867
  5. 2018A Short Note about Kinetics-600cited by 333
  6. 2020Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translationcited by 256
  7. 2021Improving Sign Language Translation with Monolingual Data by Sign Back-Translationcited by 179
  8. 2022Two-Stream Network for Sign Language Recognition and Translationcited by 123
  9. 2018Video-based Sign Language Recognition without Temporal Segmentationcited by 88
  10. 2021Visual Alignment Constraint for Continuous Sign Language Recognitioncited by 80
  11. 2022A Simple Multi-Modality Transfer Learning Baseline for Sign Language Translationcited by 80
  12. 2020Spatial-Temporal Multi-Cue Network for Continuous Sign Language Recognitioncited by 74
8 more
  1. 2016Connectionist Temporal Modeling for Weakly Supervised Action Labelingcited by 70
  2. 2020Fully Convolutional Networks for Continuous Sign Language Recognitioncited by 58
  3. 2023Continuous Sign Language Recognition with Correlation Networkcited by 56
  4. 2020Boosting Continuous Sign Language Recognition via Cross Modality Augmentationcited by 40
  5. 2022Self-Emphasizing Network for Continuous Sign Language Recognitioncited by 33
  6. 2022Temporal Lift Pooling for Continuous Sign Language Recognitioncited by 26
  7. 2023Self-Sufficient Framework for Continuous Sign Language Recognitioncited by 11
  8. 2022Signing Outside the Studio: Benchmarking Background Robustness for Continuous Sign Language Recognitioncited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 8; 2026: 1.

10 papers.