Training-Free Model Selection and Domain-Aware Score Calibration for First-Shot Anomalous Sound Detection
Not on the map. Why?
Abstract (arXiv)
First-shot anomalous sound detection in DCASE Challenge Task 2 must flag anomalies of unseen machine types with a single threshold, without knowing whether a test clip comes from the data-rich source domain (990 normal training clips) or the data-scarce target domain (10). Two organizer-reported problems remain open: source- and target-domain AUC are negatively correlated across systems, and development-set performance does not predict evaluation-set performance. We address both with a training-free post-hoc layer over frozen audio embeddings: (i) per-domain quantile calibration shrunk toward a pooled map by a prior strength m, tracing a source/target balance frontier, and (ii) a label-free cross-validated domain-balance criterion that ranks candidate configurations from training normals only, paired with a coarse development-labeled viability veto. On DCASE 2025, the criterion rank-predicts the official evaluation score across a 45-configuration grid (Spearman rho = +0.91; family-block bootstrap 95% CI [+0.83, +0.95]) while development score is uninformative (+0.06). Criterion-based selection raises the evaluation score from 55.83 to 59.34 (jackknife CI [2.2, 4.8]) and, on an extended grid, to 61.05 -- retrospectively fourth of 35 teams. Replicating on DCASE 2023 and 2024 bounds the claim: development score is uninformative in all three years and degenerate configurations recur (vetoed every time), but under family-clustered uncertainty the criterion's predictive evidence survives only in 2025; in both replication years a fixed full-equalization default matches or beats criterion-based selection. A DCASE 2026 forward test is frozen before the 2026 evaluation ground truth is released; all headline numbers are reproduced by the official evaluator.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 38 references that are in the map. First posted on arXiv 5 Jul 2026.
Builds on
22 of 38 references.
References · 22
- 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
- 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 378
- 2023Conformal Prediction With Conditional Guaranteescited by 146
- 2021Localized Conformal Prediction: A Generalized Inference Framework for Conformal Predictioncited by 112
- 2023Class-Conditional Conformal Prediction with Many Classescited by 109
- 2024EAT: Self-Supervised Pre-Training with Efficient Audio Transformercited by 52
- 2023Conformal prediction with local weights: randomization enables local guaranteescited by 47
- 2021Tune it the Right Way: Unsupervised Validation of Domain Adaptation via Soft Neighborhood Densitycited by 44
- 2021ToyADMOS2: Another dataset of miniature-machine operating sounds for anomalous sound detection under domain shift conditionscited by 26
- 2022MIMII DG: Sound Dataset for Malfunctioning Industrial Machine Investigation and Inspection for Domain Generalization Taskcited by 23
- 2023First-shot anomaly sound detection for machine condition monitoring: A domain generalization baselinecited by 15
- 2025Description and Discussion on DCASE 2025 Challenge Task 2: First-shot Unsupervised Anomalous Sound Detection for Machine Condition Monitoringcited by 9
10 more
- 2025Local Density-Based Anomaly Score Normalization for Domain Generalizationcited by 5
- 2024Deep Generic Representations for Domain-Generalized Anomalous Sound Detectioncited by 4
- 2026Between Resolution Collapse and Variance Inflation: Weighted Conformal Anomaly Detection in Low-Data Regimescited by 4
- 2025Handling Domain Shifts for Anomalous Sound Detection: A Review of DCASE-Related Workcited by 3
- 2026Adaptive Conformal Anomaly Detection with Time Series Foundation Models for Signal Monitoringcited by 3
- 2026Towards Accurate Model Selection in Deep Unsupervised Domain Adaptationcited by 3
- 2026Description and Discussion on DCASE 2026 Challenge Task 2: Noise-aware Unsupervised Anomalous Sound Detection for Machine Condition Monitoringcited by 2
- 2024AdaProj: Adaptively Scaled Angular Margin Subspace Projections for Anomalous Sound Detection with Auxiliary Classification Taskscited by 1
- 2025Set Valued Predictions For Robust Domain Generalizationcited by 1
- 2026Scoring Backends Matter More Than Pooling: A Systematic Study of Training-Free Anomalous Sound Detection under Domain Shiftcited by 1
Built on by
Not cited yet.