mlsanityData to 7 Oct 2026

A quest through interconnected datasets: lessons from highly-cited ICASSP papers

arXiv 2410.03676 ↗First posted 19 Sep 2024cs.SD cs.LG eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

As audio machine learning outcomes are deployed in societally impactful applications, it is important to have a sense of the quality and origins of the data used. Noticing that being explicit about this sense is not trivially rewarded in academic publishing in applied machine learning domains, and neither is included in typical applied machine learning curricula, we present a study into dataset usage connected to the top-5 cited papers at the International Conference on Acoustics, Speech, and Signal Processing (ICASSP). In this, we conduct thorough depth-first analyses towards origins of used datasets, often leading to searches that had to go beyond what was reported in official papers, and ending into unclear or entangled origins. Especially in the current pull towards larger, and possibly generative AI models, awareness of the need for accountability on data provenance is increasing. With this, we call on the community to not only focus on engineering larger models, but create more room and reward for explicitizing the foundations on which such models should be built.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 87 references that are in the map. First posted on arXiv 19 Sep 2024.

Builds on

32 of 87 references.

References · 32

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  4. 2018Datasheets for Datasetscited by 1,371
  5. 2018Model Cards for Model Reportingcited by 1,068
  6. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  7. 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 364
  8. 2021AI and the Everything in the Whole Wide World Benchmarkcited by 340
  9. 2019Measurement and Fairnesscited by 299
  10. 2018TED-LIUM 3: twice as much data and corpus repartition for experiments on speaker adaptationcited by 224
  11. 2015Deep clustering: Discriminative embeddings for segmentation and separationcited by 211
  12. 2020Attention is All You Need in Speech Separationcited by 184
20 more
  1. 2021The Values Encoded in Machine Learning Researchcited by 172
  2. 2020End-to-end anti-spoofing with RawNet2cited by 160
  3. 2020FastPitch: Parallel Text-to-speech with Pitch Predictioncited by 150
  4. 2020Recent Developments on ESPnet Toolkit Boosted by Conformercited by 132
  5. 2018AISHELL-2: Transforming Mandarin ASR Research Into Industrial Scalecited by 125
  6. 2019Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learningcited by 116
  7. 2017Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learningcited by 67
  8. 2019Garbage In, Garbage Out? Do Machine Learning Application Papers in Social Computing Report Where Human-Labeled Training Data Comes From?cited by 64
  9. 2017JSUT corpus: free large-scale Japanese speech corpus for end-to-end speech synthesiscited by 57
  10. 2021ASVspoof 2019: spoofing countermeasures for the detection of synthesized, converted and replayed speechcited by 56
  11. 2021SA-Net: Shuffle Attention for Deep Convolutional Neural Networkscited by 54
  12. 2023Into the LAIONs Den: Investigating Hate in Multimodal Datasetscited by 54
  13. 2021Just What do You Think You're Doing, Dave?' A Checklist for Responsible Data Use in NLPcited by 47
  14. 2021"Garbage In, Garbage Out" Revisited: What Do Machine Learning Application Papers Report About Human-Labeled Training Data?cited by 24
  15. 2023Position: Key Claims in LLM Research Have a Long Tail of Footnotescited by 20
  16. 2023Annotation Sensitivity: Training Data Collection Methods Affect Model Performancecited by 14
  17. 2019Metrology for AI: From Benchmarks to Instrumentscited by 12
  18. 2022Identifying Incorrect Annotations in Multi-Label Classification Datacited by 12
  19. 2013The GTZAN dataset: Its contents, its faults, their effects on evaluation, and its future usecited by 11
  20. 2023The Biased Journey of MSD_AUDIO.ZIPcited by 2

Built on by

Not cited yet.