mlsanityData to 7 Oct 2026

A Strength-Monotonic Law for Domain Alignment in Frozen-Embedding Bioacoustic Classification

arXiv 2610.09737 ↗First posted 7 Oct 2026eess.AS cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

When does distribution alignment help a frozen foundation-model embedding generalize across acoustic domains? For cross-domain mosquito-species classification we report a strength-monotonic law: the stronger an encoder is on the target task, the more its unseen-domain generalization relies on a distribution-alignment (MMD) term, and the more it is harmed by domain-rebalanced sampling. Across four encoder families and a within-encoder HuBERT layer sweep (n=8), the rebalancing leg orders exactly with encoder strength (Spearman -1.000), while the MMD-benefit leg is monotonic within each stream and -0.857 pooled; fixing architecture and varying only representation strength flips the rebalancing effect from benefit to collapse. The law is actionable: a single MMD term is the sole lever on a strong encoder, so we reduce the field's default recipe to a frozen Perch 2.0 embedding, a lightweight probe, cross-entropy, one MMD, and input augmentation. The reduced recipe stays within seed noise of the full composite (BA_unseen 0.299+/-0.006 vs. 0.307+/-0.014). As boundary conditions of the same law, three community defaults (backbone fine-tuning, multi-modal fusion, and domain rebalancing) each hurt unseen-domain accuracy under a leave-domain protocol, shown with single-variable, multi-seed evidence. We present a mechanism and the recipe it explains, not a leaderboard entry.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 30 references that are in the map. First posted on arXiv 7 Oct 2026.

Builds on

27 of 30 references.

References · 27

  1. 2020Supervised Contrastive Learningcited by 2,803
  2. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  3. 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,323
  4. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
  5. 2021Robust fine-tuning of zero-shot modelscited by 785
  6. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
  7. 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 597
  8. 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 378
  9. 2022Surgical Fine-Tuning Improves Adaptation to Distribution Shiftscited by 205
  10. 2022AVES: Animal Vocalization Encoder based on Self-Supervisioncited by 53
  11. 2024BirdSet: A Large-Scale Dataset for Audio Classification in Avian Bioacousticscited by 36
  12. 2024NatureLM-audio: an Audio-Language Foundation Model for Bioacousticscited by 32
15 more
  1. 2025Can Masked Autoencoders Also Listen to Birds?cited by 26
  2. 2025Perch 2.0: The Bittern Lesson for Bioacousticscited by 25
  3. 2023Transferable Models for Bioacoustics with Human Language Supervisioncited by 20
  4. 2023BIRB: A Generalization Benchmark for Information Retrieval in Bioacousticscited by 19
  5. 2025Foundation Models for Bioacoustics -- a Comparative Reviewcited by 11
  6. 2023Device-Robust Acoustic Scene Classification via Impulse Response Augmentationcited by 10
  7. 2024Mind the Domain Gap: a Systematic Analysis on Bioacoustic Sound Event Detectioncited by 7
  8. 2024Leveraging tropical reef, bird and unrelated sounds for superior transfer learning in marine bioacousticscited by 7
  9. 2024Data-Efficient Low-Complexity Acoustic Scene Classification in the DCASE 2024 Challengecited by 7
  10. 2025AVEX: What Matters for Animal Vocalization Encodingcited by 5
  11. 2026Linear probing enables Ship-Radiated Noise recognition with pretrained audio embeddingscited by 2
  12. 2025Feature-Weighted MMD-CORAL for Domain Adaptation in Power Transformer Fault Diagnosiscited by 1
  13. 2025Learning Domain-Robust Bioacoustic Representations for Mosquito Species Classification with Contrastive Learning and Distribution Alignmentcited by 1
  14. 2026BioDCASE 2026 Challenge Baseline for Cross-Domain Mosquito Species Classificationcited by 1
  15. 2026Is Domain Adaptation Always Helpful? A Frozen-Backbone Study of Cross-Domain Sentiment Transfercited by 1

Built on by

Not cited yet.