mlsanityData to 7 Oct 2026

Learning to track for spatio-temporal action localization

arXiv 1506.01929 ↗First posted 5 Jun 2015cs.CVcited by 44

Not on the map. Why?

Abstract (arXiv)

We propose an effective approach for spatio-temporal action localization in realistic videos. The approach first detects proposals at the frame-level and scores them with a combination of static and motion CNN features. It then tracks high-scoring proposals throughout the video using a tracking-by-detection approach. Our tracker relies simultaneously on instance-level and class-level detectors. The tracks are scored using a spatio-temporal motion histogram, a descriptor at the track level, in combination with the CNN features. Finally, we perform temporal localization of the action using a sliding-window approach at the track level. We present experimental results for spatio-temporal localization on the UCF-Sports, J-HMDB and UCF-101 action localization datasets, where our approach outperforms the state of the art with a margin of 15%, 7% and 12% respectively in mAP.

Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Jun 2015.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 12; 2022: 13; 2023: 6; 2024: 7; 2025: 6.

44 papers.

Sort:

By area:

  1. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
  2. 2021Keeping Your Eye on the Ball: Trajectory Attention in Video Transformerscited by 224
  3. 2025Baichuan-Omni-1.5 Technical Reportcited by 107
  4. 2021MultiSports: A Multi-Person Video Dataset of Spatio-Temporally Localized Sports Actionscited by 82
  5. 2021TubeR: Tubelet Transformer for Video Action Detectioncited by 55
  6. 2021ROAD: The ROad event Awareness Dataset for Autonomous Drivingcited by 54
  7. 2022RGB-Event Fusion for Moving Object Detection in Autonomous Drivingcited by 39
  8. 2021Deep Learning-based Action Detection in Untrimmed Videos: A Surveycited by 32
  9. 2022C2F-TCN: A Framework for Semi and Fully Supervised Temporal Action Segmentationcited by 23
  10. 2023STMixer: A One-Stage Sparse Action Detectorcited by 22
  11. 2021Personal Privacy Protection via Irrelevant Faces Tracking and Pixelation in Video Live Streamingcited by 17
  12. 2022Spatio-Temporal Action Detection Under Large Motioncited by 14
32 more
  1. 2022Video Action Detection: Analysing Limitations and Challengescited by 12
  2. 2024Computer Vision for Primate Behavior Analysis in the Wildcited by 10
  3. 2023Survey of Action Recognition, Spotting and Spatio-Temporal Localization in Soccer -- Current Trends and Research Perspectivescited by 7
  4. 2024CorrNet+: Sign Language Recognition and Translation via Spatial-Temporal Correlationcited by 7
  5. 2023MINOTAUR: Multi-task Video Grounding From Multimodal Queriescited by 6
  6. 2024MM-WLAuslan: Multi-View Multi-Modal Word-Level Australian Sign Language Recognition Datasetcited by 6
  7. 2025Game State and Spatio-temporal Action Detection in Soccer using Graph Neural Networks and 3D Convolutional Networkscited by 6
  8. 2023A Survey on Deep Learning-based Spatio-temporal Action Detectioncited by 5
  9. 2021Online recognition of unsegmented actions with hierarchical SOM architecturecited by 3
  10. 2021Actor-centered Representations for Action Localization in Streaming Videoscited by 3
  11. 2023CycleACR: Cycle Modeling of Actor-Context Relations for Video Action Detectioncited by 3
  12. 2022Exploiting Instance-based Mixed Sampling via Auxiliary Source Domain Supervision for Domain-adaptive Action Detectioncited by 2
  13. 2022Point3D: tracking actions as moving points with 3D CNNscited by 1
  14. 2022MM-SEAL: A Large-scale Video Dataset of Multi-person Multi-grained Spatio-temporally Action Localizationcited by 1
  15. 2022Real-Time Cattle Interaction Recognition via Triple-stream Networkcited by 1
  16. 2024A Semantic and Motion-Aware Spatiotemporal Transformer Network for Action Detectioncited by 1
  17. 2021Single Run Action Detector over Video Stream -- A Privacy Preserving Approachcited by 0
  18. 2021Finding a Needle in a Haystack: Tiny Flying Object Detection in 4K Videos using a Joint Detection-and-Tracking Approachcited by 0
  19. 2021Spot What Matters: Learning Context Using Graph Convolutional Networks for Weakly-Supervised Action Detectioncited by 0
  20. 2021KORSAL: Key-point Detection based Online Real-Time Spatio-Temporal Action Localizationcited by 0
  21. 2022Tragedy Plus Time: Capturing Unintended Human Activities from Weakly-labeled Videoscited by 0
  22. 2022RADNet: A Deep Neural Network Model for Robust Perception in Moving Autonomous Systemscited by 0
  23. 2022Weakly-Supervised Action Detection Guided by Audio Narrationcited by 0
  24. 2022Action parsing using context featurescited by 0
  25. 2022Actor-identified Spatiotemporal Action Detection -- Detecting Who Is Doing What in Videoscited by 0
  26. 2024STMixer: A One-Stage Sparse Action Detectorcited by 0
  27. 2024Vessel Re-identification and Activity Detection in Thermal Domain for Maritime Surveillancecited by 0
  28. 2024Classification Matters: Improving Video Action Detection with Class-Specific Attentioncited by 0
  29. 2025Action tube generation by person query matching for spatio-temporal action detectioncited by 0
  30. 2025VideoGEM: Training-free Action Grounding in Videoscited by 0
  31. 2025Towards Precise Action Spotting: Addressing Temporal Misalignment in Labels with Dynamic Label Assignmentcited by 0
  32. 2025Dual Guidance Semi-Supervised Action Detectioncited by 0