Saliency-based Multiple Region of Interest Detection from a Single 360deg image
Not on the map. Why?
Abstract (arXiv)
360deg images are informative -- it contains omnidirectional visual information around the camera. However, the areas that cover a 360deg image is much larger than the human's field of view, therefore important information in different view directions is easily overlooked. To tackle this issue, we propose a method for predicting the optimal set of Region of Interest (RoI) from a single 360deg image using the visual saliency as a clue. To deal with the scarce, strongly biased training data of existing single 360deg image saliency prediction dataset, we also propose a data augmentation method based on the spherical random data rotation. From the predicted saliency map and redundant candidate regions, we obtain the optimal set of RoIs considering both the saliency within a region and the Interaction-Over-Union (IoU) between regions. We conduct the subjective evaluation to show that the proposed method can select regions that properly summarize the input 360deg image.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 35 references that are in the map. First posted on arXiv 8 Sep 2022.
Builds on
10 of 35 references.
References · 10
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2018Cube Padding for Weakly-Supervised Saliency Prediction in 360deg Videoscited by 66
- 2017SalGAN: Visual Saliency Prediction with Generative Adversarial Networkscited by 63
- 2018A Memory Network Approach for Story-based Temporal Summarization of 360deg Videoscited by 29
- 2016Pano2Vid: Automatic Cinematography for Watching 360circ Videoscited by 22
- 2017Deep 360 Pilot: Learning a Deep Agent for Piloting through 360deg Sports Videocited by 22
- 2017SalNet360: Saliency Maps for omni-directional images with CNNcited by 21
- 2017Making 360circ Video Watchable in 2D: Learning Videography for Click Free Viewingcited by 13
Built on by
Not cited yet.