mlsanityData to 7 Oct 2026

SemiPL: A Semi-supervised Method for Event Sound Source Localization

arXiv 2404.19615 ↗First posted 30 Apr 2024cs.CV cs.MM cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

In recent years, Event Sound Source Localization has been widely applied in various fields. Recent works typically relying on the contrastive learning framework show impressive performance. However, all work is based on large relatively simple datasets. It's also crucial to understand and analyze human behaviors (actions and interactions of people), voices, and sounds in chaotic events in many applications, e.g., crowd management, and emergency response services. In this paper, we apply the existing model to a more complex dataset, explore the influence of parameters on the model, and propose a semi-supervised improvement method SemiPL. With the increase in data quantity and the influence of label quality, self-supervised learning will be an unstoppable trend. The experiment shows that the parameter adjustment will positively affect the existing model. In particular, SSPL achieved an improvement of 12.2% cIoU and 0.56% AUC in Chaotic World compared to the results provided. The code is available at: https://github.com/ly245422/SSPL

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 22 references that are in the map. First posted on arXiv 30 Apr 2024.

Builds on

13 of 22 references.

References · 13

  1. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  2. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  3. 2020VGGSound: A Large-scale Audio-Visual Datasetcited by 641
  4. 2019S4L: Self-Supervised Semi-Supervised Learningcited by 335
  5. 2020Whitening for Self-Supervised Representation Learningcited by 278
  6. 2018Cooperative Learning of Audio and Video Models from Self-Supervised Synchronizationcited by 246
  7. 2016SoundNet: Learning Sound Representations from Unlabeled Videocited by 244
  8. 2018Learning to Localize Sound Source in Visual Scenescited by 188
  9. 2020Multiple Sound Sources Localization from Coarse to Finecited by 118
  10. 2017Learning Sight from Sound: Ambient Sound Provides Supervision for Visual Learningcited by 67
  11. 2022Self-Supervised Predictive Learning: A Negative-Free Method for Sound Source Localization in Visual Scenescited by 31
  12. 2023Interactive Spatiotemporal Token Attention Network for Skeleton-based General Interactive Action Recognitioncited by 23
1 more
  1. 2024Explore Human Parsing Modality for Action Recognitioncited by 8

Built on by

Not cited yet.