CUHK & ETHZ & SIAT Submission to ActivityNet Challenge 2016
Not on the map. Why?
Abstract (arXiv)
This paper presents the method that underlies our submission to the untrimmed video classification task of ActivityNet Challenge 2016. We follow the basic pipeline of temporal segment networks and further raise the performance via a number of other techniques. Specifically, we use the latest deep model architecture, e.g., ResNet and Inception V3, and introduce new aggregation schemes (top-k and attention-weighted pooling). Additionally, we incorporate the audio as a complementary channel, extracting relevant information via a CNN applied to the spectrograms. With these techniques, we derive an ensemble of deep models, which, together, attains a high classification accuracy (mAP 93.23%) on the testing set and secured the first place in the challenge.
Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Aug 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 21; 2023: 9; 2024: 4; 2025: 1.
53 papers.
Sort:
- 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 308
- 2021End-to-end Temporal Action Detection with Transformercited by 150
- 2023VideoLLM: Modeling Video Sequence with Large Language Modelscited by 116
- 2021Temporal Context Aggregation Network for Temporal Action Proposal Refinementcited by 111
- 2022TALLFormer: Temporal Action Localization with a Long-memory Transformercited by 78
- 2022ReAct: Temporal Action Detection with Relational Queriescited by 47
- 2023End-to-End Temporal Action Detection with 1B Parameters Across 1000 Framescited by 47
- 2022An Empirical Study of End-to-End Temporal Action Detectioncited by 40
- 2021Self-Supervised Learning for Semi-Supervised Temporal Action Proposalcited by 39
- 2021Class Semantics-based Attention for Action Detectioncited by 36
- 2021DCAN: Improving Temporal Action Detection via Dual Context Aggregationcited by 36
- 2021Deep Learning-based Action Detection in Untrimmed Videos: A Surveycited by 32
38 more
- 2021Graph Convolutional Module for Temporal Action Localization in Videoscited by 29
- 2023Action Sensitivity Learning for Temporal Action Localizationcited by 28
- 2021Augmented Transformer with Adaptive Graph for Temporal Action Proposal Generationcited by 25
- 2023Self-Feedback DETR for Temporal Action Detectioncited by 22
- 2021Hear Me Out: Fusional Approaches for Audio Augmented Temporal Action Localizationcited by 21
- 2022Colar: Effective and Efficient Online Action Detection by Consulting Exemplarscited by 21
- 2021Low-Fidelity End-to-End Video Encoder Pre-training for Temporal Action Localizationcited by 20
- 2022Learning to Refactor Action and Co-occurrence Features for Temporal Action Localizationcited by 18
- 2021Temporal Action Proposal Generation with Transformerscited by 17
- 2023Adapting Short-Term Transformers for Action Detection in Untrimmed Videoscited by 16
- 2023Deep Learning for Video-Text Retrieval: a Reviewcited by 15
- 2022AOE-Net: Entities Interactions Modeling with Adaptive Attention Mechanism for Temporal Action Proposals Generationcited by 14
- 2021Temporally smooth online action detection using cycle-consistent future anticipationcited by 13
- 2021Winning the CVPR'2021 Kinetics-GEBD Challenge: Contrastive Learning Approachcited by 13
- 2021Relational Graph Learning for Grounded Video Description Generationcited by 12
- 2021AEI: Actors-Environment Interaction with Adaptive Attention for Temporal Action Proposals Generationcited by 11
- 2023A Survey on Deep Learning Techniques for Action Anticipationcited by 11
- 2022Faster-TAD: Towards Temporal Action Detection with Proposal Generation and Classification in a Unified Networkcited by 10
- 2022ETAD: Training Action Detection End to End on a Laptopcited by 10
- 2022Semi-Supervised Temporal Action Detection with Proposal-Free Maskingcited by 10
- 2022LocATe: End-to-end Localization of Actions in 3D with Transformerscited by 8
- 2024Harnessing Temporal Causality for Advanced Temporal Action Detectioncited by 8
- 2022Structured Attention Composition for Temporal Action Localizationcited by 7
- 2022ABN: Agent-Aware Boundary Networks for Temporal Action Proposal Generationcited by 6
- 2022Video-based Human Action Recognition using Deep Learning: A Reviewcited by 6
- 2022Open-Vocabulary Temporal Action Detection with Off-the-Shelf Image-Text Featurescited by 6
- 2023Temporally-Adaptive Models for Efficient Video Understandingcited by 6
- 2024UniAV: Unified Audio-Visual Perception for Multi-Task Video Event Localizationcited by 4
- 2022TVNet: Temporal Voting Network for Action Localizationcited by 3
- 2025DiGIT: Multi-Dilated Gated Encoder and Central-Adjacent Region Integrated Decoder for Temporal Action Detection Transformercited by 3
- 2022Semantic-Aware Pretraining for Dense Video Captioningcited by 2
- 2022Pyramid Region-based Slot Attention Network for Temporal Action Proposal Generationcited by 2
- 2024MALT: Multi-scale Action Learning Transformer for Online Action Detectioncited by 2
- 2021PcmNet: Position-Sensitive Context Modeling Network for Temporal Action Localizationcited by 1
- 2021Transferable Knowledge-Based Multi-Granularity Aggregation Network for Temporal Action Localization: Submission to ActivityNet Challenge 2021cited by 1
- 2022MVP: Robust Multi-View Practice for Driving Action Localizationcited by 1
- 2022Temporal Action Localization with Multi-temporal Scalescited by 1
- 2024Boosting Semi-Supervised Temporal Action Localization by Learning from Non-Target Classescited by 1
50 most cited of 53 All 53 (JSON)
- 2025DiGIT: Multi-Dilated Gated Encoder and Central-Adjacent Region Integrated Decoder for Temporal Action Detection Transformer9 May 2025
- 2024Harnessing Temporal Causality for Advanced Temporal Action Detection25 Jul 2024
- 2024MALT: Multi-scale Action Learning Transformer for Online Action Detection31 May 2024
- 2024UniAV: Unified Audio-Visual Perception for Multi-Task Video Event Localization4 Apr 2024
- 2024Boosting Semi-Supervised Temporal Action Localization by Learning from Non-Target Classes17 Mar 2024
- 2023Adapting Short-Term Transformers for Action Detection in Untrimmed Videos4 Dec 2023
- 2023End-to-End Temporal Action Detection with 1B Parameters Across 1000 Frames28 Nov 2023
- 2023A Survey on Deep Learning Techniques for Action Anticipation29 Sep 2023
- 2023Self-Feedback DETR for Temporal Action Detection21 Aug 2023
- 2023Progression-Guided Temporal Action Detection in Videos18 Aug 2023
- 2023Temporally-Adaptive Models for Efficient Video Understanding10 Aug 2023
- 2023Action Sensitivity Learning for Temporal Action Localization25 May 2023
38 more
- 2023VideoLLM: Modeling Video Sequence with Large Language Models22 May 2023
- 2023Deep Learning for Video-Text Retrieval: a Review24 Feb 2023
- 2022Open-Vocabulary Temporal Action Detection with Off-the-Shelf Image-Text Features20 Dec 2022
- 2022Prior-enhanced Temporal Action Localization using Subject-aware Spatial Attention10 Nov 2022
- 2022AOE-Net: Entities Interactions Modeling with Adaptive Attention Mechanism for Temporal Action Proposals Generation5 Oct 2022
- 2022Temporal Action Localization with Multi-temporal Scales16 Aug 2022
- 2022Video-based Human Action Recognition using Deep Learning: A Review7 Aug 2022
- 2022ReAct: Temporal Action Detection with Relational Queries14 Jul 2022
- 2022Semi-Supervised Temporal Action Detection with Proposal-Free Masking14 Jul 2022
- 2022MVP: Robust Multi-View Practice for Driving Action Localization5 Jul 2022
- 2022Learning to Refactor Action and Co-occurrence Features for Temporal Action Localization23 Jun 2022
- 2022Pyramid Region-based Slot Attention Network for Temporal Action Proposal Generation21 Jun 2022
- 2022Structured Attention Composition for Temporal Action Localization20 May 2022
- 2022ETAD: Training Action Detection End to End on a Laptop14 May 2022
- 2022Semantic-Aware Pretraining for Dense Video Captioning13 Apr 2022
- 2022An Empirical Study of End-to-End Temporal Action Detection6 Apr 2022
- 2022Faster-TAD: Towards Temporal Action Detection with Proposal Generation and Classification in a Unified Network6 Apr 2022
- 2022TALLFormer: Temporal Action Localization with a Long-memory Transformer4 Apr 2022
- 2022LocATe: End-to-end Localization of Actions in 3D with Transformers21 Mar 2022
- 2022ABN: Agent-Aware Boundary Networks for Temporal Action Proposal Generation16 Mar 2022
- 2022Colar: Effective and Efficient Online Action Detection by Consulting Exemplars2 Mar 2022
- 2022ActionFormer: Localizing Moments of Actions with Transformers16 Feb 2022
- 2022TVNet: Temporal Voting Network for Action Localization2 Jan 2022
- 2021DCAN: Improving Temporal Action Detection via Dual Context Aggregation7 Dec 2021
- 2021Relational Graph Learning for Grounded Video Description Generation2 Dec 2021
- 2021Graph Convolutional Module for Temporal Action Localization in Videos1 Dec 2021
- 2021AEI: Actors-Environment Interaction with Adaptive Attention for Temporal Action Proposals Generation21 Oct 2021
- 2021Deep Learning-based Action Detection in Untrimmed Videos: A Survey30 Sep 2021
- 2021Information Elevation Network for Fast Online Action Detection28 Sep 2021
- 2021Class Semantics-based Attention for Action Detection6 Sep 2021
- 2021Transferable Knowledge-Based Multi-Granularity Aggregation Network for Temporal Action Localization: Submission to ActivityNet Challenge 202127 Jul 2021
- 2021Hear Me Out: Fusional Approaches for Audio Augmented Temporal Action Localization27 Jun 2021
- 2021Winning the CVPR'2021 Kinetics-GEBD Challenge: Contrastive Learning Approach22 Jun 2021
- 2021End-to-end Temporal Action Detection with Transformer18 Jun 2021
- 2021Temporal Action Proposal Generation with Transformers25 May 2021
- 2021Temporally smooth online action detection using cycle-consistent future anticipation16 Apr 2021
- 2021Self-Supervised Learning for Semi-Supervised Temporal Action Proposal7 Apr 2021
- 2021Augmented Transformer with Adaptive Graph for Temporal Action Proposal Generation30 Mar 2021
50 newest of 53 All 53 (JSON)
- 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 308
- 2021End-to-end Temporal Action Detection with Transformercited by 150
- 2023VideoLLM: Modeling Video Sequence with Large Language Modelscited by 116
- 2021Temporal Context Aggregation Network for Temporal Action Proposal Refinementcited by 111
- 2022TALLFormer: Temporal Action Localization with a Long-memory Transformercited by 78
- 2022ReAct: Temporal Action Detection with Relational Queriescited by 47
- 2023End-to-End Temporal Action Detection with 1B Parameters Across 1000 Framescited by 47
- 2022An Empirical Study of End-to-End Temporal Action Detectioncited by 40
- 2021Self-Supervised Learning for Semi-Supervised Temporal Action Proposalcited by 39
- 2021Class Semantics-based Attention for Action Detectioncited by 36
- 2021DCAN: Improving Temporal Action Detection via Dual Context Aggregationcited by 36
- 2021Deep Learning-based Action Detection in Untrimmed Videos: A Surveycited by 32
12 most cited of 53 All 53 (JSON)
- 2025DiGIT: Multi-Dilated Gated Encoder and Central-Adjacent Region Integrated Decoder for Temporal Action Detection Transformer9 May 2025
- 2024Harnessing Temporal Causality for Advanced Temporal Action Detection25 Jul 2024
- 2024MALT: Multi-scale Action Learning Transformer for Online Action Detection31 May 2024
- 2024UniAV: Unified Audio-Visual Perception for Multi-Task Video Event Localization4 Apr 2024
- 2024Boosting Semi-Supervised Temporal Action Localization by Learning from Non-Target Classes17 Mar 2024
- 2023Adapting Short-Term Transformers for Action Detection in Untrimmed Videos4 Dec 2023
- 2023End-to-End Temporal Action Detection with 1B Parameters Across 1000 Frames28 Nov 2023
- 2023A Survey on Deep Learning Techniques for Action Anticipation29 Sep 2023
- 2023Self-Feedback DETR for Temporal Action Detection21 Aug 2023
- 2023Progression-Guided Temporal Action Detection in Videos18 Aug 2023
- 2023Temporally-Adaptive Models for Efficient Video Understanding10 Aug 2023
- 2023Action Sensitivity Learning for Temporal Action Localization25 May 2023
12 newest of 53 All 53 (JSON)