mlsanityData to 14 Oct 2026

Ecologically-Constrained Task Arithmetic for Multi-Taxa Bioacoustic Classifiers Without Shared Data

arXiv 2605.03914 ↗First posted 5 May 2026cs.SD cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Training data for bioacoustics is scattered across taxa, regions, and institutions. Centralizing it all is often infeasible. We show that independently fine-tuned BEATs encoders can be composed into a unified 661-species classifier via task vector arithmetic without sharing data. We find that bioacoustic task vectors are near-orthogonal (cosine 0.01-0.09). Their separation aligns closely with spectral distribution distance, a gradient consistent with the acoustic niche hypothesis. This geometry makes simple averaging optimal while sign-conflict methods reduce accuracy by one to six percentage points. Composition also creates an asymmetric gap: species-rich groups lose accuracy relative to joint training while underrepresented taxa gain, a redistribution useful for equitable biodiversity monitoring. We verify linear mode connectivity across all taxonomic pairs, demonstrate zero-shot transfer to new regions, and identify domain negation as a boundary condition where composition fails. These results enable a collaborative paradigm for bioacoustics where institutions share only task vectors to assemble multi-taxa classifiers, preserving data privacy.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 26 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

15 of 26 references.

References · 15

  1. 2022Editing Models with Task Arithmeticcited by 1,120
  2. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
  3. 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 694
  4. 2019Linear Mode Connectivity and the Lottery Ticket Hypothesiscited by 637
  5. 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 388
  6. 2024DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Samplingcited by 81
  7. 2021Computational bioacoustics with deep learning: a review and roadmapcited by 78
  8. 2024BirdSet: A Large-Scale Dataset for Audio Classification in Avian Bioacousticscited by 36
  9. 2025Perch 2.0: The Bittern Lesson for Bioacousticscited by 26
  10. 2024Task Arithmetic Through The Lens Of One-Shot Federated Learningcited by 12
  11. 2023AnuraSet: A dataset for benchmarking Neotropical anuran calls identification in passive acoustic monitoringcited by 10
  12. 2025The Search for Squawk: Agile Modeling in Bioacousticscited by 8
3 more
  1. 2025Distilling a speech and music encoder with task arithmeticcited by 6
  2. 2025Model Merging Improves Zero-Shot Generalization in Bioacoustic Foundation Modelscited by 2
  3. 2025Weakly Supervised Detection and Temporal Localization of Whale Calls in Long-Duration Bioacoustic Datacited by 1

Built on by

Not cited yet.