mlsanityData to 7 Oct 2026

CNN Architectures for Large-Scale Audio Classification

arXiv 1609.09430 ↗First posted 29 Sep 2016cs.SD cs.LG stat.MLcited by 701

Not on the map. Why?

Cited by 46 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Convolutional Neural Networks (CNNs) have proven very effective in image classification and show promise for audio. We use various CNN architectures to classify the soundtracks of a dataset of 70M training videos (5.24 million hours) with 30,871 video-level labels. We examine fully connected Deep Neural Networks (DNNs), AlexNet [1], VGG [2], Inception [3], and ResNet [4]. We investigate varying the size of both training set and label vocabulary, finding that analogs of the CNNs used in image classification do well on our audio classification task, and larger training and label sets help up to a point. A model using embeddings from these classifiers does much better than raw features on the Audio Set [5] Acoustic Event Detection (AED) classification task.

Key facts. Cited by 701 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Sep 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 128; 2022: 125; 2023: 116; 2024: 133; 2025: 129; 2026: 70.

701 papers.

Sort:

By area:

  1. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
  2. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
  3. 2023MusicLM: Generating Music From Textcited by 442
  4. 2021Attention Bottlenecks for Multimodal Fusioncited by 361
  5. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
  6. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
  7. 2022Masked Autoencoders that Listencited by 271
  8. 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 178
  9. 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
  10. 2022Audio-Visual Segmentationcited by 148
  11. 2021Taming Visually Guided Sound Generationcited by 136
  12. 2022Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motioncited by 125
38 more
  1. 2024Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuningcited by 117
  2. 2021T2VLAD: Global-Local Sequence Alignment for Text-Video Retrievalcited by 103
  3. 2022Inducing Neural Collapse in Imbalanced Learning: Do We Really Need a Learnable Classifier at the End of Deep Neural Network?cited by 100
  4. 2023MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategiescited by 94
  5. 2021Voice2Series: Reprogramming Acoustic Models for Time Series Classificationcited by 91
  6. 2023Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generationcited by 90
  7. 2021HiT: Hierarchical Transformer with Momentum Contrast for Video-Text Retrievalcited by 87
  8. 2023Data Distillation: A Surveycited by 86
  9. 2022MuLan: A Joint Embedding of Music Audio and Natural Languagecited by 85
  10. 2023Hierarchical Video-Moment Retrieval and Step-Captioningcited by 83
  11. 2021TEACHTEXT: CrossModal Generalized Distillation for Text-Video Retrievalcited by 81
  12. 2021MDMMT: Multidomain Multimodal Transformer for Video Retrievalcited by 78
  13. 2022HEAR: Holistic Evaluation of Audio Representationscited by 77
  14. 2025Ovi: Twin Backbone Cross-Modal Fusion for Audio-Video Generationcited by 76
  15. 2023Audio-Visual Segmentation with Semanticscited by 73
  16. 2024DITTO: Diffusion Inference-Time T-Optimization for Music Generationcited by 73
  17. 2022Vision Transformers are Parameter-Efficient Audio-Visual Learnerscited by 72
  18. 2021Cross Modal Retrieval with Querybank Normalisationcited by 71
  19. 2021LEAF: A Learnable Frontend for Audio Classificationcited by 69
  20. 2021Positive Sample Propagation along the Audio-Visual Event Linecited by 69
  21. 2023AVSegFormer: Audio-Visual Segmentation with Transformercited by 66
  22. 2023V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Modelscited by 65
  23. 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separationcited by 63
  24. 2023GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restorationcited by 58
  25. 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversioncited by 58
  26. 2021Slow-Fast Auditory Streams For Audio Recognitioncited by 56
  27. 2022MAViL: Masked Audio-Video Learnerscited by 56
  28. 2023SingSong: Generating musical accompaniments from singingcited by 54
  29. 2023Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentationcited by 54
  30. 2024Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generationcited by 54
  31. 2021Procedure Planning in Instructional Videos via Contextual Modeling and Model-based Policy Learningcited by 53
  32. 2023Conditional Generation of Audio from Video via Foley Analogiescited by 52
  33. 2023CATR: Combinatorial-Dependence Audio-Queried Transformer for Audio-Visual Video Segmentationcited by 52
  34. 2021ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learningcited by 50
  35. 2022Contrastive Positive Sample Propagation along the Audio-Visual Event Linecited by 50
  36. 2023Efficient Neural Music Generationcited by 50
  37. 2023A-JEPA: Joint-Embedding Predictive Architecture Can Listencited by 50
  38. 2024Video-Guided Foley Sound Generation with Multimodal Controlscited by 49

50 most cited of 701 All 701 (JSON)