A Strength-Monotonic Law for Domain Alignment in Frozen-Embedding Bioacoustic Classification
Not on the map. Why?
Abstract (arXiv)
When does distribution alignment help a frozen foundation-model embedding generalize across acoustic domains? For cross-domain mosquito-species classification we report a strength-monotonic law: the stronger an encoder is on the target task, the more its unseen-domain generalization relies on a distribution-alignment (MMD) term, and the more it is harmed by domain-rebalanced sampling. Across four encoder families and a within-encoder HuBERT layer sweep (n=8), the rebalancing leg orders exactly with encoder strength (Spearman -1.000), while the MMD-benefit leg is monotonic within each stream and -0.857 pooled; fixing architecture and varying only representation strength flips the rebalancing effect from benefit to collapse. The law is actionable: a single MMD term is the sole lever on a strong encoder, so we reduce the field's default recipe to a frozen Perch 2.0 embedding, a lightweight probe, cross-entropy, one MMD, and input augmentation. The reduced recipe stays within seed noise of the full composite (BA_unseen 0.299+/-0.006 vs. 0.307+/-0.014). As boundary conditions of the same law, three community defaults (backbone fine-tuning, multi-modal fusion, and domain rebalancing) each hurt unseen-domain accuracy under a leave-domain protocol, shown with single-variable, multi-seed evidence. We present a mechanism and the recipe it explains, not a leaderboard entry.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 30 references that are in the map. First posted on arXiv 7 Oct 2026.
Builds on
27 of 30 references.
References · 27
- 2020Supervised Contrastive Learningcited by 2,803
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,323
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
- 2021Robust fine-tuning of zero-shot modelscited by 785
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
- 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 597
- 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 378
- 2022Surgical Fine-Tuning Improves Adaptation to Distribution Shiftscited by 205
- 2022AVES: Animal Vocalization Encoder based on Self-Supervisioncited by 53
- 2024BirdSet: A Large-Scale Dataset for Audio Classification in Avian Bioacousticscited by 36
- 2024NatureLM-audio: an Audio-Language Foundation Model for Bioacousticscited by 32
15 more
- 2025Can Masked Autoencoders Also Listen to Birds?cited by 26
- 2025Perch 2.0: The Bittern Lesson for Bioacousticscited by 25
- 2023Transferable Models for Bioacoustics with Human Language Supervisioncited by 20
- 2023BIRB: A Generalization Benchmark for Information Retrieval in Bioacousticscited by 19
- 2025Foundation Models for Bioacoustics -- a Comparative Reviewcited by 11
- 2023Device-Robust Acoustic Scene Classification via Impulse Response Augmentationcited by 10
- 2024Mind the Domain Gap: a Systematic Analysis on Bioacoustic Sound Event Detectioncited by 7
- 2024Leveraging tropical reef, bird and unrelated sounds for superior transfer learning in marine bioacousticscited by 7
- 2024Data-Efficient Low-Complexity Acoustic Scene Classification in the DCASE 2024 Challengecited by 7
- 2025AVEX: What Matters for Animal Vocalization Encodingcited by 5
- 2026Linear probing enables Ship-Radiated Noise recognition with pretrained audio embeddingscited by 2
- 2025Feature-Weighted MMD-CORAL for Domain Adaptation in Power Transformer Fault Diagnosiscited by 1
- 2025Learning Domain-Robust Bioacoustic Representations for Mosquito Species Classification with Contrastive Learning and Distribution Alignmentcited by 1
- 2026BioDCASE 2026 Challenge Baseline for Cross-Domain Mosquito Species Classificationcited by 1
- 2026Is Domain Adaptation Always Helpful? A Frozen-Backbone Study of Cross-Domain Sentiment Transfercited by 1
Built on by
Not cited yet.