Bearings: Self-Supervised Soundfield Embeddings from First-Order Ambisonics
Not on the map. Why?
Abstract (arXiv)
Recently proposed self-supervised audio encoders learn powerful general-purpose representations of sound scenes, yet they are spatially blind. To supply the missing spatial representation of sound scenes, we introduce Bearings. Bearings is a self-supervised framework that learns soundfield embeddings from unlabeled first-order Ambisonics. We pre-train a masked auto-encoder paired with a decoder conditioned on frozen acoustic embeddings from an off-the-shelf single-channel audio encoder. Our results show that the resulting soundfield embeddings form a reusable stream that can be attached to frozen acoustic encoders with a lightweight trainable fusion head. On sound event localization and detection, concatenating our soundfield embeddings with acoustic representations provides the missing spatial information and enables joint detection and localization, raising the location-dependent F-score from below 4 to 50 on TAU-NIGENS 2021 and 39 on STARSS23. To our knowledge, Bearings is the first self-supervised soundfield encoder whose embeddings plug into frozen acoustic encoders without retraining either model.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 20 references that are in the map. First posted on arXiv 19 Sep 2026.
Builds on
16 of 20 references.
References · 16
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 608
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 506
- 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 388
- 2022Masked Autoencoders that Listencited by 273
- 2018Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networkscited by 85
- 2024Scaling up masked audio encoder learning for general audio classificationcited by 44
- 2023STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Eventscited by 41
- 2024BAT: Learning to Reason about Spatial Sounds with Large Language Modelscited by 36
- 2023Self-supervised Audio Teacher-Student Transformer for Both Clip-level and Frame-level Taskscited by 25
- 2021A Dataset of Dynamic Reverberant Sound Scenes with Directional Interferers for Sound Event Localization and Detectioncited by 21
4 more
- 2024Learning Spatially-Aware Language and Audio Embeddingscited by 17
- 2025SPEAR: A Unified SSL Framework for Learning Speech and Audio Representationscited by 10
- 2025Sci-Phi: A Large Language Model Spatial Audio Descriptorcited by 5
- 2023w2v-SELD: A Sound Event Localization and Detection Framework for Self-Supervised Spatial Audio Pre-Trainingcited by 2
Built on by
Not cited yet.