How Far Do Foundation Models Transfer to Infant Signals? A Cross-Dataset Transfer Audit with a Unified Need Ontology
Not on the map. Why?
Abstract (arXiv)
Public infant cry corpora are small, label-incompatible, and almost always evaluated one corpus at a time. We ask what this practice hides and what fixes it. Across four cry corpora screened by a multi-level leakage audit (byte-level and embedding-level deduplication plus a within-corpus train-test near-duplicate audit), we probe four frozen encoders and a handcrafted baseline under a unified five-class need ontology and shared task formulations. The audit exposes what single-corpus evaluation conceals: within-domain macro-F1 swings by 0.57-0.80 for the same encoder, cross-corpus transfer is negative on average (negative-transfer ratio 0.19-0.35, significant in 18 of 30 directed cells, BH-FDR), and 349 content-identical clip groups carry conflicting metadata labels across corpus distributions. The same audit, however, reveals a consistent way forward. Transfer into the noisiest corpus is consistently positive in effect size at matched training size and after near-duplicate removal, offering a practical recipe for small, noisy corpora. Frozen probes saturate at modest label budgets, while stabilized fine-tuning wins with full labels; domain-adaptive pretraining significantly beats stabilized fine-tuning at 5-10-shot (the 1-shot advantage is not robust to optimization-seed variance) but shows no significant advantage at 50-shot or beyond. In the tested binary, shared-label settings, ontology-mapped joint training wins in all four encoder-by-target combinations, whereas naively merging unmapped labels costs up to 37 F1 points. We release the ontology, mapping code, and audit pipeline, turning incompatible cry corpora into a usable joint-training resource.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 50 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
22 of 50 references.
References · 22
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2021Robust fine-tuning of zero-shot modelscited by 785
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
- 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
- 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 652
- 2021AST: Audio Spectrogram Transformercited by 634
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 631
- 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 388
- 2021Layer-wise Analysis of a Self-supervised Speech Representation Modelcited by 293
10 more
- 2021Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Trainingcited by 148
- 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
- 2019Towards Universal Object Detection by Domain Attentioncited by 89
- 2022Vocalsound: A Dataset for Improving Human Vocal Sounds Recognitioncited by 62
- 2023Detecting Everything in the Open World: Towards Universal Object Detectioncited by 62
- 2021Camera Measurement of Physiological Vital Signscited by 49
- 2022A cross-corpus study on speech emotion recognitioncited by 7
- 2022A study on cross-corpus speech emotion recognition and data augmentationcited by 5
- 2023Self-supervised learning for infant cry analysiscited by 4
- 2023CryCeleb: A Speaker Verification Dataset Based on Infant Cry Soundscited by 3
Built on by
Not cited yet.