mlsanityData to 7 Oct 2026

Topic Detection in Continuous Sign Language Videos

arXiv 2209.02402 ↗First posted 1 Sep 2022cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Significant progress has been made recently on challenging tasks in automatic sign language understanding, such as sign language recognition, translation and production. However, these works have focused on datasets with relatively few samples, short recordings and limited vocabulary and signing space. In this work, we introduce the novel task of sign language topic detection. We base our experiments on How2Sign, a large-scale video dataset spanning multiple semantic domains. We provide strong baselines for the task of topic detection and present a comparison between different visual features commonly used in the domain of sign language.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 37 of its 48 references that are in the map. First posted on arXiv 1 Sep 2022.

Builds on

37 of 48 references.

References · 37

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  4. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  5. 2021ViViT: A Video Vision Transformercited by 1,610
  6. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
  7. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  8. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
  9. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  10. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  11. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
  12. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
25 more
  1. 2021VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Textcited by 427
  2. 2020Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translationcited by 254
  3. 2019Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparisoncited by 217
  4. 2020How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Languagecited by 172
  5. 2018Monocular Total Capture: Posing Face, Body, and Hands in the Wildcited by 162
  6. 2022Multiview Transformers for Video Recognitioncited by 148
  7. 2020Deep Learning Based Text Classification: A Comprehensive Reviewcited by 140
  8. 2018How2: A Large-scale Dataset for Multimodal Language Understandingcited by 137
  9. 2021TokenLearner: What Can 8 Learned Tokens Do for Images and Videos?cited by 127
  10. 2020BSL-1K: Scaling up co-articulated sign language recognition using mouthing cuescited by 106
  11. 2021Skeleton Aware Multi-modal Sign Language Recognitioncited by 101
  12. 2021Visual Alignment Constraint for Continuous Sign Language Recognitioncited by 79
  13. 2020AUTSL: A Large Scale Multi-modal Turkish Sign Language Dataset and Baseline Methodscited by 75
  14. 2022Open-Domain Sign Language Translation Learned from Online Videocited by 72
  15. 2020Multi-channel Transformers for Multi-articulatory Sign Language Translationcited by 71
  16. 2018Neural Sign Language Translation based on Human Keypoint Estimationcited by 65
  17. 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Productioncited by 61
  18. 2021Continuous 3D Multi-Channel Sign Language Production via Progressive Transformers and Mixture Density Networkscited by 50
  19. 2021Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitivescited by 50
  20. 2021VPN++: Rethinking Video-Pose embeddings for understanding Activities of Daily Livingcited by 35
  21. 2021UNIK: A Unified Framework for Real-world Skeleton-based Action Recognitioncited by 35
  22. 2020Body2Hands: Learning to Infer 3D Hands from Conversational Gesture Body Dynamicscited by 34
  23. 2020Everybody Sign Now: Translating Spoken Language to Photo Realistic Sign Language Videocited by 34
  24. 2022Sign Language Video Retrieval with Free-Form Textual Queriescited by 21
  25. 2021Skeletal Graph Self-Attention: Embedding a Skeleton Inductive Bias into Sign Language Productioncited by 11

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.

  1. 2023Sign Language Translation from Instructional Videoscited by 39