Temporal Gaussian Mixture Layer for Videos
Not on the map. Why?
Abstract (arXiv)
We introduce a new convolutional layer named the Temporal Gaussian Mixture (TGM) layer and present how it can be used to efficiently capture longer-term temporal information in continuous activity videos. The TGM layer is a temporal convolutional layer governed by a much smaller set of parameters (e.g., location/variance of Gaussians) that are fully differentiable. We present our fully convolutional video models with multiple TGM layers for activity detection. The extensive experiments on multiple datasets, including Charades and MultiTHUMOS, confirm the effectiveness of TGM layers, significantly outperforming the state-of-the-arts.
Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 7; 2023: 10; 2024: 6; 2025: 3; 2026: 1.
40 papers.
Sort:
By area:
- 2024Language Repository for Long Video Understandingcited by 55
- 2021Activity Graph Transformer for Temporal Action Localizationcited by 48
- 2021MS-TCT: Multi-Scale Temporal ConvTransformer for Action Detectioncited by 42
- 2022An Empirical Study of End-to-End Temporal Action Detectioncited by 40
- 2021Modeling Multi-Label Action Dependencies for Temporal Action Localizationcited by 32
- 2021Learning an Augmented RGB Representation with Cross-Modal Knowledge Distillation for Action Detectioncited by 32
- 2021Graph Convolutional Module for Temporal Action Localization in Videoscited by 29
- 2021Coarse-Fine Networks for Temporal Activity Detection in Videoscited by 28
- 2023VicTR: Video-conditioned Text Representations for Activity Recognitioncited by 28
- 2023Action Sensitivity Learning for Temporal Action Localizationcited by 28
- 2022Token Turing Machinescited by 25
- 2022PointTAD: Multi-Label Temporal Action Detection with Learnable Query Pointscited by 22
28 more
- 2024Dual DETRs for Multi-Label Temporal Action Detectioncited by 20
- 2021SVIP: Sequence VerIfication for Procedures in Videoscited by 16
- 2024UniMD: Towards Unifying Moment Retrieval and Temporal Action Detectioncited by 16
- 2021CTRN: Class-Temporal Relational Network for Action Detectioncited by 15
- 2023LAC: Latent Action Composition for Skeleton-based Action Segmentationcited by 15
- 2021UnweaveNet: Unweaving Activity Storiescited by 14
- 2024Benchmarking the Robustness of Temporal Action Detection Models Against Temporal Corruptionscited by 12
- 2023Gaussian Mixture Proposals with Pull-Push Learning Scheme to Capture Diverse Events for Weakly Supervised Temporal Video Groundingcited by 10
- 2023PAT: Position-Aware Transformer for Dense Multi-Label Action Detectioncited by 6
- 2021Weakly-guided Self-supervised Pretraining for Temporal Activity Detectioncited by 5
- 2022Weakly-Supervised Temporal Action Localization by Progressive Complementary Learningcited by 5
- 2025Temporal Action Detection Model Compression by Progressive Block Dropcited by 5
- 2021Image Modeling with Deep Convolutional Gaussian Mixture Modelscited by 4
- 2023CNN-Based Action Recognition and Pose Estimation for Classifying Animal Behavior from Videos: A Surveycited by 4
- 2024Animal Behavior Analysis Methods Using Deep Learning: A Surveycited by 4
- 2023Transform-Equivariant Consistency Learning for Temporal Sentence Groundingcited by 3
- 2022PAMI-AD: An Activity Detector Exploiting Part-attention and Motion Information in Surveillance Videoscited by 2
- 2025MS-Temba: Multi-Scale Temporal Mamba for Understanding Long Untrimmed Videoscited by 2
- 2021NAS-TC: Neural Architecture Search on Temporal Convolutions for Complex Action Recognitioncited by 1
- 2022Bringing Online Egocentric Action Recognition into the wildcited by 1
- 2023Enhancing Multivariate Time Series Classifiers through Self-Attention and Relative Positioning Infusioncited by 1
- 2023Co-Occurrence Matters: Learning Action Relation for Temporal Action Localizationcited by 1
- 2023AAN: Attributes-Aware Network for Temporal Action Detectioncited by 1
- 2021Low Pass Filter for Anti-aliasing in Temporal Action Localizationcited by 0
- 2022Semantic Video Moments Retrieval at Scale: A New Task and a Baselinecited by 0
- 2024An Effective-Efficient Approach for Dense Multi-Label Action Detectioncited by 0
- 2025Reframing Dense Action Detection (RefDense): A Paradigm Shift in Problem Solving & a Novel Optimization Strategycited by 0
- 2026T-MOR: Learning Motion-Aware Skeleton Representations for Human Action Recognitioncited by 0
- 2026T-MOR: Learning Motion-Aware Skeleton Representations for Human Action Recognition19 Jun 2026
- 2025Temporal Action Detection Model Compression by Progressive Block Drop21 Mar 2025
- 2025Reframing Dense Action Detection (RefDense): A Paradigm Shift in Problem Solving & a Novel Optimization Strategy30 Jan 2025
- 2025MS-Temba: Multi-Scale Temporal Mamba for Understanding Long Untrimmed Videos10 Jan 2025
- 2024An Effective-Efficient Approach for Dense Multi-Label Action Detection10 Jun 2024
- 2024Animal Behavior Analysis Methods Using Deep Learning: A Survey22 May 2024
- 2024UniMD: Towards Unifying Moment Retrieval and Temporal Action Detection7 Apr 2024
- 2024Dual DETRs for Multi-Label Temporal Action Detection31 Mar 2024
- 2024Benchmarking the Robustness of Temporal Action Detection Models Against Temporal Corruptions29 Mar 2024
- 2024Language Repository for Long Video Understanding21 Mar 2024
- 2023Gaussian Mixture Proposals with Pull-Push Learning Scheme to Capture Diverse Events for Weakly Supervised Temporal Video Grounding27 Dec 2023
- 2023AAN: Attributes-Aware Network for Temporal Action Detection1 Sep 2023
28 more
- 2023LAC: Latent Action Composition for Skeleton-based Action Segmentation28 Aug 2023
- 2023PAT: Position-Aware Transformer for Dense Multi-Label Action Detection9 Aug 2023
- 2023Action Sensitivity Learning for Temporal Action Localization25 May 2023
- 2023Transform-Equivariant Consistency Learning for Temporal Sentence Grounding6 May 2023
- 2023VicTR: Video-conditioned Text Representations for Activity Recognition5 Apr 2023
- 2023Co-Occurrence Matters: Learning Action Relation for Temporal Action Localization15 Mar 2023
- 2023Enhancing Multivariate Time Series Classifiers through Self-Attention and Relative Positioning Infusion13 Feb 2023
- 2023CNN-Based Action Recognition and Pose Estimation for Classifying Animal Behavior from Videos: A Survey15 Jan 2023
- 2022Token Turing Machines16 Nov 2022
- 2022Bringing Online Egocentric Action Recognition into the wild6 Nov 2022
- 2022PointTAD: Multi-Label Temporal Action Detection with Learnable Query Points20 Oct 2022
- 2022Semantic Video Moments Retrieval at Scale: A New Task and a Baseline15 Oct 2022
- 2022Weakly-Supervised Temporal Action Localization by Progressive Complementary Learning22 Jun 2022
- 2022An Empirical Study of End-to-End Temporal Action Detection6 Apr 2022
- 2022PAMI-AD: An Activity Detector Exploiting Part-attention and Motion Information in Surveillance Videos8 Mar 2022
- 2021UnweaveNet: Unweaving Activity Stories19 Dec 2021
- 2021SVIP: Sequence VerIfication for Procedures in Videos13 Dec 2021
- 2021MS-TCT: Multi-Scale Temporal ConvTransformer for Action Detection7 Dec 2021
- 2021Graph Convolutional Module for Temporal Action Localization in Videos1 Dec 2021
- 2021Weakly-guided Self-supervised Pretraining for Temporal Activity Detection26 Nov 2021
- 2021CTRN: Class-Temporal Relational Network for Action Detection26 Oct 2021
- 2021Learning an Augmented RGB Representation with Cross-Modal Knowledge Distillation for Action Detection8 Aug 2021
- 2021Low Pass Filter for Anti-aliasing in Temporal Action Localization23 Apr 2021
- 2021Image Modeling with Deep Convolutional Gaussian Mixture Models19 Apr 2021
- 2021NAS-TC: Neural Architecture Search on Temporal Convolutions for Complex Action Recognition17 Mar 2021
- 2021Modeling Multi-Label Action Dependencies for Temporal Action Localization4 Mar 2021
- 2021Coarse-Fine Networks for Temporal Activity Detection in Videos1 Mar 2021
- 2021Activity Graph Transformer for Temporal Action Localization21 Jan 2021
- 2024Language Repository for Long Video Understandingcited by 55
- 2021Activity Graph Transformer for Temporal Action Localizationcited by 48
- 2021MS-TCT: Multi-Scale Temporal ConvTransformer for Action Detectioncited by 42
- 2022An Empirical Study of End-to-End Temporal Action Detectioncited by 40
- 2021Modeling Multi-Label Action Dependencies for Temporal Action Localizationcited by 32
- 2021Graph Convolutional Module for Temporal Action Localization in Videoscited by 29
- 2021Coarse-Fine Networks for Temporal Activity Detection in Videoscited by 28
- 2023Action Sensitivity Learning for Temporal Action Localizationcited by 28
- 2022Token Turing Machinescited by 25
- 2022PointTAD: Multi-Label Temporal Action Detection with Learnable Query Pointscited by 22
- 2024Dual DETRs for Multi-Label Temporal Action Detectioncited by 20
- 2021SVIP: Sequence VerIfication for Procedures in Videoscited by 16
12 most cited of 36 All 36 (JSON)
- 2025Temporal Action Detection Model Compression by Progressive Block Drop21 Mar 2025
- 2025Reframing Dense Action Detection (RefDense): A Paradigm Shift in Problem Solving & a Novel Optimization Strategy30 Jan 2025
- 2024An Effective-Efficient Approach for Dense Multi-Label Action Detection10 Jun 2024
- 2024Animal Behavior Analysis Methods Using Deep Learning: A Survey22 May 2024
- 2024UniMD: Towards Unifying Moment Retrieval and Temporal Action Detection7 Apr 2024
- 2024Dual DETRs for Multi-Label Temporal Action Detection31 Mar 2024
- 2024Benchmarking the Robustness of Temporal Action Detection Models Against Temporal Corruptions29 Mar 2024
- 2024Language Repository for Long Video Understanding21 Mar 2024
- 2023Gaussian Mixture Proposals with Pull-Push Learning Scheme to Capture Diverse Events for Weakly Supervised Temporal Video Grounding27 Dec 2023
- 2023AAN: Attributes-Aware Network for Temporal Action Detection1 Sep 2023
- 2023LAC: Latent Action Composition for Skeleton-based Action Segmentation28 Aug 2023
- 2023PAT: Position-Aware Transformer for Dense Multi-Label Action Detection9 Aug 2023
12 newest of 36 All 36 (JSON)