mlsanityData to 14 Oct 2026

TF-CADE: Foreground-Concentrated Text-Video Alignment for Zero-Shot Temporal Action Detection

arXiv 2608.17422 ↗First posted 18 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Zero-Shot Temporal Action Detection (ZSTAD) aims to lo- calize and recognize action instances from unseen action categories in untrimmed videos. Although existing meth- ods have shown effectiveness by advancing architectural text-video alignment, they still struggle with capturing se- mantic distinctions between action classes, resulting in text- irrelevant predictions. To address this issue, we propose a Text-Foreground Concentrated Alignment for zero-shot temporal action DEtector (TF-CADE) that explicitly aligns textual information with action-relevant foreground regions. Specifically, we introduce Action Concentrate Aggregation (ACA), which extracts action concentrate scores to aggregate temporally informative video segments into a foreground- weighted video embedding. This foreground concentrated alignment enhances the semantic consistency between text and video features and improves inter-class discriminabil- ity. In addition, a Certainty-based Confidence Re-weighting (CCR) strategy refines per-snippet confidence scores by lever- aging foreground-aware similarity, effectively suppressing irrelevant action classes during inference. Extensive evalua- tions show that our TF-CADE not only achieves state-of-the- art performance under in-distribution settings but also excels in cross-dataset generalization to unseen action classes.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 35 references that are in the map. First posted on arXiv 18 Aug 2026.

Builds on

28 of 35 references.

References · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  3. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  4. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  6. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
  7. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,274
  8. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
  9. 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 459
  10. 2017Soft-NMS -- Improving Object Detection With One Line of Codecited by 382
  11. 2022Expanding Language-Image Pretrained Models for General Video Recognitioncited by 321
  12. 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
16 more
  1. 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 311
  2. 2021Prompting Visual-Language Models for Efficient Video Understandingcited by 310
  3. 2016The THUMOS Challenge on Action Recognition for Videos "in the Wild"cited by 213
  4. 2021Learning Salient Boundary Feature for Anchor-free Temporal Action Localizationcited by 156
  5. 2023TriDet: Temporal Action Detection with Relative Boundary Modelingcited by 142
  6. 2017UntrimmedNets for Weakly Supervised Action Recognition and Detectioncited by 130
  7. 2018Diagnosing Error in Temporal Action Detectorscited by 71
  8. 2022Revisiting Classifier: Transferring Vision-Language Models for Video Recognitioncited by 71
  9. 2022Zero-Shot Temporal Action Detection via Vision-Language Promptingcited by 65
  10. 2023VicTR: Video-conditioned Text Representations for Activity Recognitioncited by 28
  11. 2024Test-Time Zero-Shot Temporal Action Localizationcited by 19
  12. 2024TE-TAD: Towards Full End-to-End Temporal Action Detection via Time-Aligned Coordinate Expressioncited by 14
  13. 2023ZEETAD: Adapting Pretrained Vision-Language Model for Zero-Shot End-to-End Temporal Action Detectioncited by 12
  14. 2024Open-Vocabulary Temporal Action Localization using Multimodal Guidancecited by 7
  15. 2024Exploring Scalability of Self-Training for Open-Vocabulary Temporal Action Localizationcited by 6
  16. 2024Zero-shot Action Localization via the Confidence of Large Vision-Language Modelscited by 4

Built on by

Not cited yet.