Computer Audition: From Task-Specific Machine Learning to Foundation Models
Not on the map. Why?
Abstract (arXiv)
Foundation models (FMs) are increasingly spearheading recent advances on a variety of tasks that fall under the purview of computer audition -- the use of machines to understand sounds. They feature several advantages over traditional pipelines: among others, the ability to consolidate multiple tasks in a single model, the option to leverage knowledge from other modalities, and the readily-available interaction with human users. Naturally, these promises have created substantial excitement in the audio community, and have led to a wave of early attempts to build new, general-purpose foundation models for audio. In the present contribution, we give an overview of computational audio analysis as it transitions from traditional pipelines towards auditory foundation models. Our work highlights the key operating principles that underpin those models, and showcases how they can accommodate multiple tasks that the audio community previously tackled separately.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Jul 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 3; 2025: 1; 2026: 4.
8 papers.
- 2024Foundation Models for Music: A Surveycited by 34
- 2025Mellow: a small audio language model for reasoningcited by 27
- 2024Affective Computing Has Changed: The Foundation Model Disruptioncited by 7
- 2024autrainer: A Modular and Extensible Deep Learning Toolkit for Computer Audition Taskscited by 1
- 2026How Class Ontology and Data Scale Affect Audio Transfer Learningcited by 0
- 2026CoarseSoundNet: Building a reliable model for ecological soundscape analysiscited by 0
- 2026A Pilot Study on Curator-Guided Multilingual Art Description for Blind and Low-Vision Audiences with Small Vision-Language Modelscited by 0
- 2026Acoustic Cue Alignment in Audio Language Models for Speech Emotion Recognitioncited by 0
- 2026Acoustic Cue Alignment in Audio Language Models for Speech Emotion Recognition5 Jun 2026
- 2026A Pilot Study on Curator-Guided Multilingual Art Description for Blind and Low-Vision Audiences with Small Vision-Language Models29 May 2026
- 2026CoarseSoundNet: Building a reliable model for ecological soundscape analysis20 May 2026
- 2026How Class Ontology and Data Scale Affect Audio Transfer Learning26 Mar 2026
- 2025Mellow: a small audio language model for reasoning11 Mar 2025
- 2024autrainer: A Modular and Extensible Deep Learning Toolkit for Computer Audition Tasks16 Dec 2024
- 2024Affective Computing Has Changed: The Foundation Model Disruption13 Sep 2024
- 2024Foundation Models for Music: A Survey26 Aug 2024