SHD360: A Benchmark Dataset for Salient Human Detection in 360deg Videos
Not on the map. Why?
Abstract (arXiv)
Salient human detection (SHD) in dynamic 360deg immersive videos is of great importance for various applications such as robotics, inter-human and human-object interaction in augmented reality. However, 360deg video SHD has been seldom discussed in the computer vision community due to a lack of datasets with large-scale omnidirectional videos and rich annotations. To this end, we propose SHD360, the first 360deg video SHD dataset which contains various real-life daily scenes. Since so far there is no method proposed for 360deg image/video SHD, we systematically benchmark 11 representative state-of-the-art salient object detection (SOD) approaches on our SHD360, and explore key issues derived from extensive experimenting results. We hope our proposed dataset and benchmark could serve as a good starting point for advancing human-centric researches towards 360deg panoramic data. The dataset is available at https://github.com/PanoAsh/SHD360.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 35 of its 71 references that are in the map. First posted on arXiv 24 May 2021.
Builds on
35 of 71 references.
References · 35
- 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
- 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
- 2013DeepPose: Human Pose Estimation via Deep Neural Networkscited by 305
- 2019EGNet:Edge Guidance Network for Salient Object Detectioncited by 237
- 2019Cascaded Partial Decoder for Fast and Accurate Salient Object Detectioncited by 216
- 2019A Simple Pooling-Based Design for Real-Time Salient Object Detectioncited by 212
- 2020Multi-scale Interactive Network for Salient Object Detectioncited by 212
- 2014The Secrets of Salient Object Segmentationcited by 200
- 2015Visual Saliency Based on Multiscale Deep Featurescited by 185
- 2019F3Net: Fusion, Feedback and Focus for Salient Object Detectioncited by 176
- 2019Salient Object Detection in the Deep Learning Era: An In-Depth Surveycited by 164
- 2020See More, Know More: Unsupervised Video Object Segmentation with Co-Attention Siamese Networkscited by 138
23 more
- 2019Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarkscited by 133
- 2020Suppress and Balance: A Simple Gated Network for Salient Object Detectioncited by 126
- 2020Label Decoupling Framework for Salient Object Detectioncited by 111
- 2017Look into Person: Self-supervised Structure-sensitive Learning and A New Benchmark for Human Parsingcited by 109
- 2020Global Context-Aware Progressive Aggregation Network for Salient Object Detectioncited by 109
- 2014Salient Object Detection: A Surveycited by 98
- 2020Highly Efficient Salient Object Detection with 100K Parameterscited by 79
- 2019Motion Guided Attention for Video Salient Object Detectioncited by 72
- 2018Cube Padding for Weakly-Supervised Saliency Prediction in 360deg Videoscited by 66
- 2019Semi-Supervised Video Salient Object Detection Using Pseudo-Labelscited by 54
- 2018Salient Objects in Clutter: Bringing Salient Object Detection to the Foregroundcited by 47
- 2020PANDA: A Gigapixel-level Human-centric Video Datasetcited by 45
- 2017Instance-Level Salient Object Segmentationcited by 38
- 2016Gated Siamese Convolutional Neural Network Architecture for Human Re-Identificationcited by 34
- 2017Predicting Head Movement in Panoramic Video: A Deep Reinforcement Learning Approachcited by 34
- 2019360-Indoor: Towards Learning Real-World Objects in 360deg Indoor Equirectangular Imagescited by 26
- 2020TENet: Triple Excitation Network for Video Salient Object Detectioncited by 26
- 2017Deep 360 Pilot: Learning a Deep Agent for Piloting through 360deg Sports Videocited by 22
- 2018Object Detection in Equirectangular Panoramacited by 20
- 2016A Benchmark Dataset and Saliency-guided Stacked Autoencoders for Video-based Salient Object Detectioncited by 19
- 2018Bridge the Gap Between VQA and Human Behavior on Omnidirectional Video: A Large-Scale Dataset and a Deep Learning Modelcited by 19
- 2019Distortion-adaptive Salient Object Detection in 360^circ Omnidirectional Imagescited by 15
- 2020A Fixation-based 360deg Benchmark Dataset for Salient Object Detectioncited by 8
Built on by
Citing papers per year: 2022: 2; 2023: 2.
4 papers.
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
- 2023PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video Segmentationcited by 18
- 2022View-aware Salient Object Detection for 360deg Omnidirectional Imagecited by 6
- 2023A Spatial-Temporal Dual-Mode Mixed Flow Network for Panoramic Video Salient Object Detectioncited by 0
- 2023A Spatial-Temporal Dual-Mode Mixed Flow Network for Panoramic Video Salient Object Detection13 Oct 2023
- 2023PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video Segmentation21 Sep 2023
- 2022View-aware Salient Object Detection for 360deg Omnidirectional Image27 Sep 2022
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectives21 May 2022