mlsanityData to 14 Oct 2026

From Sight to Insight: Unleashing Eye-Tracking in Weakly Supervised Video Salient Object Detection

arXiv 2506.23519 ↗First posted 30 Jun 2025cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

The eye-tracking video saliency prediction (VSP) task and video salient object detection (VSOD) task both focus on the most attractive objects in video and show the result in the form of predictive heatmaps and pixel-level saliency masks, respectively. In practical applications, eye tracker annotations are more readily obtainable and align closely with the authentic visual patterns of human eyes. Therefore, this paper aims to introduce fixation information to assist the detection of video salient objects under weak supervision. On the one hand, we ponder how to better explore and utilize the information provided by fixation, and then propose a Position and Semantic Embedding (PSE) module to provide location and semantic guidance during the feature learning process. On the other hand, we achieve spatiotemporal feature modeling under weak supervision from the aspects of feature selection and feature contrast. A Semantics and Locality Query (SLQ) Competitor with semantic and locality constraints is designed to effectively select the most matching and accurate object query for spatiotemporal modeling. In addition, an Intra-Inter Mixed Contrastive (IIMC) model improves the spatiotemporal modeling capabilities under weak supervision by forming an intra-video and inter-video contrastive learning paradigm. Experimental results on five popular VSOD benchmarks indicate that our model outperforms other competitors on various evaluation metrics.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 41 of its 72 references that are in the map. First posted on arXiv 30 Jun 2025.

Builds on

41 of 72 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  5. 2020End-to-End Object Detection with Transformerscited by 7,414
  6. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  7. 2020Supervised Contrastive Learningcited by 2,829
  8. 2017Non-local Neural Networkscited by 2,293
  9. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
  10. 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
  11. 2019EGNet:Edge Guidance Network for Salient Object Detectioncited by 237
  12. 2020Self-supervised Co-training for Video Representation Learningcited by 232
29 more
  1. 2020Quasi-Dense Similarity Learning for Multiple Object Trackingcited by 220
  2. 2019A Simple Pooling-Based Design for Real-Time Salient Object Detectioncited by 212
  3. 2019Salient Object Detection in the Deep Learning Era: An In-Depth Surveycited by 164
  4. 2022In Defense of Online Models for Video Instance Segmentationcited by 97
  5. 2020Weakly-Supervised Salient Object Detection via Scribble Annotationscited by 96
  6. 2021Full-Duplex Strategy for Video Object Segmentationcited by 78
  7. 2019Motion Guided Attention for Video Salient Object Detectioncited by 72
  8. 2021Points as Queries: Weakly Semi-supervised Object Detection by Pointscited by 60
  9. 2019TASED-Net: Temporally-Aggregating Spatial Encoder-Decoder Network for Video Saliency Detectioncited by 59
  10. 2019Semi-Supervised Video Salient Object Detection Using Pseudo-Labelscited by 54
  11. 2022A Unified Transformer Framework for Group-based Segmentation: Co-Segmentation, Co-Saliency Detection and Video Salient Object Detectioncited by 51
  12. 2018Deep Unsupervised Saliency Detection: A Multiple Noisy Labeling Perspectivecited by 50
  13. 2019Multi-source weak supervision for saliency detectioncited by 43
  14. 2021Saliency-Associated Object Trackingcited by 30
  15. 2021Weakly Supervised Video Salient Object Detectioncited by 28
  16. 2021MFNet: Multi-filter Directive Network for Weakly Supervised Salient Object Detectioncited by 27
  17. 2020TENet: Triple Excitation Network for Video Salient Object Detectioncited by 26
  18. 2022Weakly-Supervised Salient Object Detection Using Point Supervisioncited by 25
  19. 2020Hierarchical Domain-Adapted Feature Learning for Video Saliency Predictioncited by 24
  20. 2022Global-and-Local Collaborative Learning for Co-Salient Object Detectioncited by 24
  21. 2022Texture-guided Saliency Distilling for Unsupervised Salient Object Detectioncited by 24
  22. 2022A Weakly Supervised Learning Framework for Salient Object Detection via Hybrid Labelscited by 20
  23. 2016A Benchmark Dataset and Saliency-guided Stacked Autoencoders for Video-based Salient Object Detectioncited by 19
  24. 2022Unsupervised Domain Adaptive Salient Object Detection Through Uncertainty-Aware Pseudo-Label Learningcited by 17
  25. 2022BCS-Net: Boundary, Context and Semantic for Automatic COVID-19 Lung Infection Segmentation from CT Imagescited by 16
  26. 2022Weakly Supervised Video Salient Object Detection via Point Supervisioncited by 13
  27. 2022PSNet: Parallel Symmetric Network for Video Salient Object Detectioncited by 12
  28. 2024Query-guided Prototype Evolution Network for Few-Shot Segmentationcited by 12
  29. 2020A Novel Video Salient Object Detection Method via Semi-supervised Motion Quality Perceptioncited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

  1. 2026RDNet: Region Proportion-Aware Dynamic Adaptive Salient Object Detection Network in Optical Remote Sensing Imagescited by 1
  2. 2026G2HFNet: GeoGran-Aware Hierarchical Feature Fusion Network for Salient Object Detection in Optical Remote Sensing Imagescited by 0
  3. 2026RSONet: Region-guided Selective Optimization Network for RGB-T Salient Object Detectioncited by 0