mlsanityData to 13 Oct 2026

Towards Adaptive Pseudo-label Learning for Semi-Supervised Temporal Action Localization

arXiv 2407.07673 ↗First posted 10 Jul 2024cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Alleviating noisy pseudo labels remains a key challenge in Semi-Supervised Temporal Action Localization (SS-TAL). Existing methods often filter pseudo labels based on strict conditions, but they typically assess classification and localization quality separately, leading to suboptimal pseudo-label ranking and selection. In particular, there might be inaccurate pseudo labels within selected positives, alongside reliable counterparts erroneously assigned to negatives. To tackle these problems, we propose a novel Adaptive Pseudo-label Learning (APL) framework to facilitate better pseudo-label selection. Specifically, to improve the ranking quality, Adaptive Label Quality Assessment (ALQA) is proposed to jointly learn classification confidence and localization reliability, followed by dynamically selecting pseudo labels based on the joint score. Additionally, we propose an Instance-level Consistency Discriminator (ICD) for eliminating ambiguous positives and mining potential positives simultaneously based on inter-instance intrinsic consistency, thereby leading to a more precise selection. We further introduce a general unsupervised Action-aware Contrastive Pre-training (ACP) to enhance the discrimination both within actions and between actions and backgrounds, which benefits SS-TAL. Extensive experiments on THUMOS14 and ActivityNet v1.3 demonstrate that our method achieves state-of-the-art performance under various semi-supervised settings.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 55 of its 69 references that are in the map. First posted on arXiv 10 Jul 2024.

Builds on

55 of 69 references.

References · 55

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,625
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,712
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,492
  5. 2020End-to-End Object Detection with Transformerscited by 7,396
  6. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,170
  7. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,840
  8. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,264
  9. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,082
  10. 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,575
  11. 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
  12. 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,055
38 more
  1. 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 919
  2. 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 899
  3. 2020Rescaling Egocentric Visioncited by 532
  4. 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 455
  5. 2020Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detectioncited by 408
  6. 2017Soft-NMS -- Improving Object Detection With One Line of Codecited by 381
  7. 2020Semi-Supervised Semantic Segmentation with Cross-Consistency Trainingcited by 375
  8. 2019BMN: Boundary-Matching Network for Temporal Action Proposal Generationcited by 327
  9. 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 308
  10. 2018BSN: Boundary Sensitive Network for Temporal Action Proposal Generationcited by 271
  11. 2019Graph Convolutional Networks for Temporal Action Localizationcited by 208
  12. 2021DetCo: Unsupervised Contrastive Learning for Object Detectioncited by 205
  13. 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 177
  14. 2021Learning Salient Boundary Feature for Anchor-free Temporal Action Localizationcited by 156
  15. 2021Efficient Visual Pretraining with Contrastive Detectioncited by 150
  16. 2023TriDet: Temporal Action Detection with Relative Boundary Modelingcited by 141
  17. 2017Single Shot Temporal Action Detectioncited by 123
  18. 2021Humble Teachers Teach Better Students for Semi-Supervised Object Detectioncited by 115
  19. 2021Temporal Context Aggregation Network for Temporal Action Proposal Refinementcited by 111
  20. 2018Iterative Learning with Open-set Noisy Labelscited by 108
  21. 2020Video Self-Stitching Graph Network for Temporal Action Localizationcited by 104
  22. 2019Fast Learning of Temporal Action Proposal via Dense Boundary Generatorcited by 89
  23. 2020Boundary Content Graph Neural Network for Temporal Action Proposal Generationcited by 88
  24. 2022SVFormer: Semi-supervised Video Transformer for Action Recognitioncited by 67
  25. 2021Enriching Local and Global Contexts for Temporal Action Localizationcited by 64
  26. 2022Class-Aware Contrastive Semi-Supervised Learningcited by 62
  27. 2023Contrastive Mean Teacher for Domain Adaptive Object Detectorscited by 52
  28. 2021Semi-Supervised Action Recognition with Temporal Contrastive Learningcited by 50
  29. 2022ReAct: Temporal Action Detection with Relational Queriescited by 47
  30. 2018CTAP: Complementary Temporal Action Proposal Generationcited by 46
  31. 2022Label Matching Semi-Supervised Object Detectioncited by 44
  32. 2021Self-Supervised Learning for Semi-Supervised Temporal Action Proposalcited by 39
  33. 2022Dense Learning based Semi-Supervised Object Detectioncited by 32
  34. 2023Action Sensitivity Learning for Temporal Action Localizationcited by 28
  35. 2019Learning Temporal Action Proposals With Fewer Labelscited by 17
  36. 2021Temporal Action Proposal Generation with Background Constraintcited by 16
  37. 2022An Efficient Spatio-Temporal Pyramid Transformer for Action Detectioncited by 16
  38. 2023Ambiguity-Resistant Semi-Supervised Learning for Dense Object Detectioncited by 14

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.