Structure Across Voices: Comparing acoustic-event type accumulation and sequence dependence across four vocal repertoires using frozen audio encoders
Not on the map. Why?
Abstract (arXiv)
Vocal repertoires can differ in acoustic-event type accumulation and temporal organization, yet direct comparison is difficult because corpora use different native events and unequal amounts of sequence. We compare sperm whale codas, human speech phones, Bengalese finch syllables, and common marmoset calls using the same frozen-audio-encoder procedure while matching event count and local sequence opportunity. Whale shows the fastest type accumulation; Finch shows the strongest immediate dependence and repeated-subsequence recurrence. Physically interpretable acoustics recover complementary parts of this profile, continuous analyses without clustering support broad Whale acoustic coverage, and source- and position-preserving nulls retain both Finch order effects. Extending predictive context shifts the comparison toward Whale. Thus repertoire differences depend on the acoustic property and temporal scale measured rather than forming a single hierarchy.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 26 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
6 of 26 references.
References · 6
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2023VampNet: Music Generation via Masked Acoustic Token Modelingcited by 57
- 2022AVES: Animal Vocalization Encoder based on Self-Supervisioncited by 53
- 2025OpenBEATs: A Fully Open-Source General-Purpose Audio Encodercited by 4
- 2016Automatic recognition of element classes and boundaries in the birdsong with variable sequencescited by 2
Built on by
Not cited yet.