Towards Adaptive Pseudo-label Learning for Semi-Supervised Temporal Action Localization
Not on the map. Why?
Abstract (arXiv)
Alleviating noisy pseudo labels remains a key challenge in Semi-Supervised Temporal Action Localization (SS-TAL). Existing methods often filter pseudo labels based on strict conditions, but they typically assess classification and localization quality separately, leading to suboptimal pseudo-label ranking and selection. In particular, there might be inaccurate pseudo labels within selected positives, alongside reliable counterparts erroneously assigned to negatives. To tackle these problems, we propose a novel Adaptive Pseudo-label Learning (APL) framework to facilitate better pseudo-label selection. Specifically, to improve the ranking quality, Adaptive Label Quality Assessment (ALQA) is proposed to jointly learn classification confidence and localization reliability, followed by dynamically selecting pseudo labels based on the joint score. Additionally, we propose an Instance-level Consistency Discriminator (ICD) for eliminating ambiguous positives and mining potential positives simultaneously based on inter-instance intrinsic consistency, thereby leading to a more precise selection. We further introduce a general unsupervised Action-aware Contrastive Pre-training (ACP) to enhance the discrimination both within actions and between actions and backgrounds, which benefits SS-TAL. Extensive experiments on THUMOS14 and ActivityNet v1.3 demonstrate that our method achieves state-of-the-art performance under various semi-supervised settings.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 55 of its 69 references that are in the map. First posted on arXiv 10 Jul 2024.
Builds on
55 of 69 references.
References · 55
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,625
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,712
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,492
- 2020End-to-End Object Detection with Transformerscited by 7,396
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,170
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,840
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,264
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,082
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,575
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,055
38 more
- 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 919
- 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 899
- 2020Rescaling Egocentric Visioncited by 532
- 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 455
- 2020Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detectioncited by 408
- 2017Soft-NMS -- Improving Object Detection With One Line of Codecited by 381
- 2020Semi-Supervised Semantic Segmentation with Cross-Consistency Trainingcited by 375
- 2019BMN: Boundary-Matching Network for Temporal Action Proposal Generationcited by 327
- 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 308
- 2018BSN: Boundary Sensitive Network for Temporal Action Proposal Generationcited by 271
- 2019Graph Convolutional Networks for Temporal Action Localizationcited by 208
- 2021DetCo: Unsupervised Contrastive Learning for Object Detectioncited by 205
- 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 177
- 2021Learning Salient Boundary Feature for Anchor-free Temporal Action Localizationcited by 156
- 2021Efficient Visual Pretraining with Contrastive Detectioncited by 150
- 2023TriDet: Temporal Action Detection with Relative Boundary Modelingcited by 141
- 2017Single Shot Temporal Action Detectioncited by 123
- 2021Humble Teachers Teach Better Students for Semi-Supervised Object Detectioncited by 115
- 2021Temporal Context Aggregation Network for Temporal Action Proposal Refinementcited by 111
- 2018Iterative Learning with Open-set Noisy Labelscited by 108
- 2020Video Self-Stitching Graph Network for Temporal Action Localizationcited by 104
- 2019Fast Learning of Temporal Action Proposal via Dense Boundary Generatorcited by 89
- 2020Boundary Content Graph Neural Network for Temporal Action Proposal Generationcited by 88
- 2022SVFormer: Semi-supervised Video Transformer for Action Recognitioncited by 67
- 2021Enriching Local and Global Contexts for Temporal Action Localizationcited by 64
- 2022Class-Aware Contrastive Semi-Supervised Learningcited by 62
- 2023Contrastive Mean Teacher for Domain Adaptive Object Detectorscited by 52
- 2021Semi-Supervised Action Recognition with Temporal Contrastive Learningcited by 50
- 2022ReAct: Temporal Action Detection with Relational Queriescited by 47
- 2018CTAP: Complementary Temporal Action Proposal Generationcited by 46
- 2022Label Matching Semi-Supervised Object Detectioncited by 44
- 2021Self-Supervised Learning for Semi-Supervised Temporal Action Proposalcited by 39
- 2022Dense Learning based Semi-Supervised Object Detectioncited by 32
- 2023Action Sensitivity Learning for Temporal Action Localizationcited by 28
- 2019Learning Temporal Action Proposals With Fewer Labelscited by 17
- 2021Temporal Action Proposal Generation with Background Constraintcited by 16
- 2022An Efficient Spatio-Temporal Pyramid Transformer for Action Detectioncited by 16
- 2023Ambiguity-Resistant Semi-Supervised Learning for Dense Object Detectioncited by 14
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2024: 1.
1 paper.