mlsanityData to 14 Oct 2026

Hands-On: Segmenting Individual Signs from Continuous Sequences

arXiv 2504.08593 ↗First posted 11 Apr 2025cs.CV cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

This work tackles the challenge of continuous sign language segmentation, a key task with huge implications for sign language translation and data annotation. We propose a transformer-based architecture that models the temporal dynamics of signing and frames segmentation as a sequence labeling problem using the Begin-In-Out (BIO) tagging scheme. Our method leverages the HaMeR hand features, and is complemented with 3D Angles. Extensive experiments show that our model achieves state-of-the-art results on the DGS Corpus, while our features surpass prior benchmarks on BSLCorpus.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 16 of its 34 references that are in the map. First posted on arXiv 11 Apr 2025.

Builds on

16 of 34 references.

References · 16

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  4. 2019MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentationcited by 373
  5. 2023Reconstructing Hands in 3D with Transformerscited by 306
  6. 2022Two-Stream Network for Sign Language Recognition and Translationcited by 123
  7. 2023Gloss-free Sign Language Translation: Improving from Visual-Language Pretrainingcited by 105
  8. 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Productioncited by 61
  9. 2024Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translationcited by 57
  10. 2023SLTUNET: A Simple Unified Model for Sign Language Translationcited by 35
  11. 2021Aligning Subtitles in Sign Language Videoscited by 26
  12. 2023Improving 3D Pose Estimation for Sign Languagecited by 16
4 more
  1. 2020Sign language segmentation with temporal convolutional networkscited by 14
  2. 2023Linguistically Motivated Sign Language Segmentationcited by 11
  3. 2021Sign Segmentation with Changepoint-Modulated Pseudo-Labellingcited by 10
  4. 2024Multi-Stream Keypoint Attention Network for Sign Language Recognition and Translationcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 6.

10 papers.

  1. 2025Beyond Gloss: A Hand-Centric Framework for Gloss-Free Sign Language Translationcited by 7
  2. 2025Segment, Embed, and Align: A Universal Recipe for Aligning Subtitles to Signingcited by 2
  3. 2026SignSparK: Efficient Multilingual Sign Language Production via Sparse Keyframe Learningcited by 2
  4. 2025Sign Spotting Disambiguation using Large Language Modelscited by 1
  5. 2025SAGE: Segment-Aware Gloss-Free Encoding for Token-Efficient Sign Language Translationcited by 1
  6. 2026SignAgent: Agentic LLMs for Linguistically-Grounded Sign Language Annotation and Dataset Curationcited by 1
  7. 2026BackTranslation2.0 -- A Linguistically Motivated Metric to Assess Sign Language Productioncited by 1
  8. 2026Recognising BSL Fingerspelling in Continuous Signing Sequencescited by 0
  9. 2026Gloss-Free Representation Learning for Cross-Dataset Sign Spottingcited by 0
  10. 2026Machine Translation for Sign Languagescited by 0