Panoramic Human Activity Recognition
Not on the map. Why?
Abstract (arXiv)
To obtain a more comprehensive activity understanding for a crowded scene, in this paper, we propose a new problem of panoramic human activity recognition (PAR), which aims to simultaneous achieve the individual action, social group activity, and global activity recognition. This is a challenging yet practical problem in real-world applications. For this problem, we develop a novel hierarchical graph neural network to progressively represent and model the multi-granularity human activities and mutual social relations for a crowd of people. We further build a benchmark to evaluate the proposed method and other existing related methods. Experimental results verify the rationality of the proposed PAR problem, the effectiveness of our method and the usefulness of the benchmark. We will release the source code and benchmark to the public for promoting the study on this problem.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 25 of its 57 references that are in the map. First posted on arXiv 8 Mar 2022.
Builds on
25 of 57 references.
References · 25
- 2017Mask R-CNNcited by 7,259
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2018SlowFast Networks for Video Recognitioncited by 1,862
- 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 899
- 2017AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actionscited by 449
- 2020Actor-Context-Actor Relation Network for Spatio-Temporal Action Localizationcited by 91
- 2016Hierarchical Deep Temporal Models for Group Activity Recognitioncited by 89
- 2020Actor-Transformers for Group Activity Recognitioncited by 84
- 2019Learning Actor Relation Graphs for Group Activity Recognitioncited by 83
- 2021MultiSports: A Multi-Person Video Dataset of Spatio-Temporally Localized Sports Actionscited by 82
- 2020Asynchronous Interaction Aggregation for Action Detectioncited by 65
- 2020SF-Net: Single-Frame Supervision for Temporal Action Localizationcited by 62
13 more
- 2018Skeleton-Based Action Recognition with Spatial Reasoning and Temporal Stack Learningcited by 47
- 2020PANDA: A Gigapixel-level Human-centric Video Datasetcited by 45
- 2016Deep Learning on Lie Groups for Skeleton-based Action Recognitioncited by 42
- 2020Joint Learning of Social Groups, Individuals Action and Sub-group Activities in Videoscited by 39
- 2018Spatio-Temporal Channel Correlation Networks for Action Classificationcited by 38
- 2021JRDB-Act: A Large-scale Dataset for Spatio-temporal Action, Social Group and Activity Detectioncited by 38
- 2020Context-Aware RCNN: A Baseline for Action Detection in Videoscited by 33
- 2017CERN: Confidence-Energy Recurrent Network for Group Activity Recognitioncited by 24
- 2018Consensus-Driven Propagation in Massive Unlabeled Data for Face Recognitioncited by 20
- 2016Spot On: Action Localization from Pointly-Supervised Proposalscited by 17
- 2018GD-GAN: Generative Adversarial Networks for Trajectory Prediction and Group Detection in Crowdscited by 15
- 2016Human Action Localization with Sparse Spatial Supervisioncited by 8
- 2018Interaction-aware Spatio-temporal Pyramid Attention Networks for Action Classificationcited by 6
Built on by
Citing papers per year: 2023: 5; 2024: 4; 2025: 4.
13 papers.
Sort:
- 2025Omnidirectional Multi-Object Trackingcited by 12
- 2023Towards More Practical Group Activity Detection: A New Benchmark and Modelcited by 11
- 2023SoGAR: Self-supervised Spatiotemporal Attention-based Social Group Activity Recognitioncited by 8
- 2023REACT: Recognize Every Action Everywhere All At Oncecited by 5
- 2023Real-time Trajectory-based Social Group Detectioncited by 4
- 2025Dynamic Group Detection using VLM-augmented Temporal Groupness Graphcited by 3
- 2023Boundary Discretization and Reliable Classification Network for Temporal Action Detectioncited by 2
- 2025OmniTrack++: Omnidirectional Multi-Object Tracking by Learning Large-FoV Trajectory Feedbackcited by 2
- 2024Spatio-Temporal Proximity-Aware Dual-Path Model for Panoramic Activity Recognitioncited by 1
- 2024LiGAR: LiDAR-Guided Hierarchical Transformer for Multi-Modal Group Activity Recognitioncited by 1
- 2025Structured Relational Reasoning for Group Activity Assessmentcited by 1
- 2024Social-MAE: Social Masked Autoencoder for Multi-person Motion Representation Learningcited by 0
1 more
- 2025OmniTrack++: Omnidirectional Multi-Object Tracking by Learning Large-FoV Trajectory Feedback1 Nov 2025
- 2025Dynamic Group Detection using VLM-augmented Temporal Groupness Graph5 Sep 2025
- 2025Structured Relational Reasoning for Group Activity Assessment11 Aug 2025
- 2025Omnidirectional Multi-Object Tracking6 Mar 2025
- 2024LiGAR: LiDAR-Guided Hierarchical Transformer for Multi-Modal Group Activity Recognition28 Oct 2024
- 2024MPT-PAR:Mix-Parameters Transformer for Panoramic Activity Recognition1 Aug 2024
- 2024Social-MAE: Social Masked Autoencoder for Multi-person Motion Representation Learning8 Apr 2024
- 2024Spatio-Temporal Proximity-Aware Dual-Path Model for Panoramic Activity Recognition21 Mar 2024
- 2023Towards More Practical Group Activity Detection: A New Benchmark and Model5 Dec 2023
- 2023REACT: Recognize Every Action Everywhere All At Once27 Nov 2023
- 2023Boundary Discretization and Reliable Classification Network for Temporal Action Detection10 Oct 2023
- 2023SoGAR: Self-supervised Spatiotemporal Attention-based Social Group Activity Recognition27 Apr 2023
1 more
- 2023Real-time Trajectory-based Social Group Detection12 Apr 2023
- 2025Omnidirectional Multi-Object Trackingcited by 12
- 2023Towards More Practical Group Activity Detection: A New Benchmark and Modelcited by 11
- 2023SoGAR: Self-supervised Spatiotemporal Attention-based Social Group Activity Recognitioncited by 8
- 2023REACT: Recognize Every Action Everywhere All At Oncecited by 5
- 2023Real-time Trajectory-based Social Group Detectioncited by 4
- 2025Dynamic Group Detection using VLM-augmented Temporal Groupness Graphcited by 3
- 2023Boundary Discretization and Reliable Classification Network for Temporal Action Detectioncited by 2
- 2025OmniTrack++: Omnidirectional Multi-Object Tracking by Learning Large-FoV Trajectory Feedbackcited by 2
- 2024Spatio-Temporal Proximity-Aware Dual-Path Model for Panoramic Activity Recognitioncited by 1
- 2024LiGAR: LiDAR-Guided Hierarchical Transformer for Multi-Modal Group Activity Recognitioncited by 1
- 2025Structured Relational Reasoning for Group Activity Assessmentcited by 1
- 2024Social-MAE: Social Masked Autoencoder for Multi-person Motion Representation Learningcited by 0
12 most cited of 13 All 13 (JSON)
- 2025OmniTrack++: Omnidirectional Multi-Object Tracking by Learning Large-FoV Trajectory Feedback1 Nov 2025
- 2025Dynamic Group Detection using VLM-augmented Temporal Groupness Graph5 Sep 2025
- 2025Structured Relational Reasoning for Group Activity Assessment11 Aug 2025
- 2025Omnidirectional Multi-Object Tracking6 Mar 2025
- 2024LiGAR: LiDAR-Guided Hierarchical Transformer for Multi-Modal Group Activity Recognition28 Oct 2024
- 2024MPT-PAR:Mix-Parameters Transformer for Panoramic Activity Recognition1 Aug 2024
- 2024Social-MAE: Social Masked Autoencoder for Multi-person Motion Representation Learning8 Apr 2024
- 2024Spatio-Temporal Proximity-Aware Dual-Path Model for Panoramic Activity Recognition21 Mar 2024
- 2023Towards More Practical Group Activity Detection: A New Benchmark and Model5 Dec 2023
- 2023REACT: Recognize Every Action Everywhere All At Once27 Nov 2023
- 2023Boundary Discretization and Reliable Classification Network for Temporal Action Detection10 Oct 2023
- 2023SoGAR: Self-supervised Spatiotemporal Attention-based Social Group Activity Recognition27 Apr 2023
12 newest of 13 All 13 (JSON)