mlsanityData to 7 Oct 2026

How Far Do Foundation Models Transfer to Infant Signals? A Cross-Dataset Transfer Audit with a Unified Need Ontology

arXiv 2608.08989 ↗First posted 10 Aug 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Public infant cry corpora are small, label-incompatible, and almost always evaluated one corpus at a time. We ask what this practice hides and what fixes it. Across four cry corpora screened by a multi-level leakage audit (byte-level and embedding-level deduplication plus a within-corpus train-test near-duplicate audit), we probe four frozen encoders and a handcrafted baseline under a unified five-class need ontology and shared task formulations. The audit exposes what single-corpus evaluation conceals: within-domain macro-F1 swings by 0.57-0.80 for the same encoder, cross-corpus transfer is negative on average (negative-transfer ratio 0.19-0.35, significant in 18 of 30 directed cells, BH-FDR), and 349 content-identical clip groups carry conflicting metadata labels across corpus distributions. The same audit, however, reveals a consistent way forward. Transfer into the noisiest corpus is consistently positive in effect size at matched training size and after near-duplicate removal, offering a practical recipe for small, noisy corpora. Frozen probes saturate at modest label budgets, while stabilized fine-tuning wins with full labels; domain-adaptive pretraining significantly beats stabilized fine-tuning at 5-10-shot (the 1-shot advantage is not robust to optimization-seed variance) but shows no significant advantage at 50-shot or beyond. In the tested binary, shared-label settings, ontology-mapped joint training wins in all four encoder-by-target combinations, whereas naively merging unmapped labels costs up to 37 F1 points. We release the ontology, mapping code, and audit pipeline, turning incompatible cry corpora into a usable joint-training resource.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 50 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

22 of 50 references.

References · 22

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  3. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  4. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  5. 2021Robust fine-tuning of zero-shot modelscited by 785
  6. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
  7. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
  8. 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 652
  9. 2021AST: Audio Spectrogram Transformercited by 634
  10. 2018Taskonomy: Disentangling Task Transfer Learningcited by 631
  11. 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 388
  12. 2021Layer-wise Analysis of a Self-supervised Speech Representation Modelcited by 293
10 more
  1. 2021Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Trainingcited by 148
  2. 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
  3. 2019Towards Universal Object Detection by Domain Attentioncited by 89
  4. 2022Vocalsound: A Dataset for Improving Human Vocal Sounds Recognitioncited by 62
  5. 2023Detecting Everything in the Open World: Towards Universal Object Detectioncited by 62
  6. 2021Camera Measurement of Physiological Vital Signscited by 49
  7. 2022A cross-corpus study on speech emotion recognitioncited by 7
  8. 2022A study on cross-corpus speech emotion recognition and data augmentationcited by 5
  9. 2023Self-supervised learning for infant cry analysiscited by 4
  10. 2023CryCeleb: A Speaker Verification Dataset Based on Infant Cry Soundscited by 3

Built on by

Not cited yet.