Audio Spectrogram Representations for Processing with Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
One of the decisions that arise when designing a neural network for any application is how the data should be represented in order to be presented to, and possibly generated by, a neural network. For audio, the choice is less obvious than it seems to be for visual images, and a variety of representations have been used for different applications including the raw digitized sample stream, hand-crafted features, machine discovered features, MFCCs and variants that include deltas, and a variety of spectral representations. This paper reviews some of these representations and issues that arise, focusing particularly on spectrograms for generating audio using neural networks for style transfer.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 4; 2023: 0; 2024: 3; 2025: 2; 2026: 1.
15 papers.
Sort:
- 2024animal2vec and MeerKAT: A self-supervised transformer for rare-event raw audio input and a large-scale reference dataset for bioacousticscited by 14
- 2022Multi-modal Fusion Technology based on Vehicle Information: A Surveycited by 13
- 2021When are Deep Networks really better than Decision Forests at small sample sizes, and how?cited by 6
- 2021Environmental Sound Classification on the Edge: A Pipeline for Deep Acoustic Networks on Extremely Resource-Constrained Devicescited by 5
- 2021Leveraging Image-based Generative Adversarial Networks for Time Series Generationcited by 4
- 2022HarmoF0: Logarithmic Scale Dilated Convolution For Pitch Estimationcited by 4
- 2021Pruning vs XNOR-Net: A Comprehensive Study of Deep Learning for Audio Classification on Edge-devicescited by 3
- 2022Urban Rhapsody: Large-scale exploration of urban soundscapescited by 3
- 2021AMSS-Net: Audio Manipulation on User-Specified Sources with Textual Queriescited by 2
- 2024Audio-visual cross-modality knowledge transfer for machine learning-based in-situ monitoring in laser additive manufacturingcited by 2
- 2025DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillationcited by 2
- 2025A Bird Song Detector for improving bird identification through Deep Learning: a case study from Do~nanacited by 1
3 more
- 2022Financial Time Series Data Augmentation with Generative Adversarial Networks and Extended Intertemporal Return Plotscited by 0
- 2024Tuning In: Analysis of Audio Classifier Performance in Clinical Settings with Limited Datacited by 0
- 2026SpecRegMatch: Robust Semi-Supervised Regression for Vehicle Interior Noise Predictioncited by 0
- 2026SpecRegMatch: Robust Semi-Supervised Regression for Vehicle Interior Noise Prediction28 Sep 2026
- 2025DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillation15 Oct 2025
- 2025A Bird Song Detector for improving bird identification through Deep Learning: a case study from Do~nana19 Mar 2025
- 2024Audio-visual cross-modality knowledge transfer for machine learning-based in-situ monitoring in laser additive manufacturing9 Aug 2024
- 2024animal2vec and MeerKAT: A self-supervised transformer for rare-event raw audio input and a large-scale reference dataset for bioacoustics3 Jun 2024
- 2024Tuning In: Analysis of Audio Classifier Performance in Clinical Settings with Limited Data7 Feb 2024
- 2022Multi-modal Fusion Technology based on Vehicle Information: A Survey11 Nov 2022
- 2022Urban Rhapsody: Large-scale exploration of urban soundscapes25 May 2022
- 2022Financial Time Series Data Augmentation with Generative Adversarial Networks and Extended Intertemporal Return Plots18 May 2022
- 2022HarmoF0: Logarithmic Scale Dilated Convolution For Pitch Estimation2 May 2022
- 2021Leveraging Image-based Generative Adversarial Networks for Time Series Generation15 Dec 2021
- 2021When are Deep Networks really better than Decision Forests at small sample sizes, and how?31 Aug 2021
3 more
- 2021Pruning vs XNOR-Net: A Comprehensive Study of Deep Learning for Audio Classification on Edge-devices13 Aug 2021
- 2021AMSS-Net: Audio Manipulation on User-Specified Sources with Textual Queries28 Apr 2021
- 2021Environmental Sound Classification on the Edge: A Pipeline for Deep Acoustic Networks on Extremely Resource-Constrained Devices5 Mar 2021
- 2024animal2vec and MeerKAT: A self-supervised transformer for rare-event raw audio input and a large-scale reference dataset for bioacousticscited by 14
- 2022Multi-modal Fusion Technology based on Vehicle Information: A Surveycited by 13
- 2021When are Deep Networks really better than Decision Forests at small sample sizes, and how?cited by 6
- 2021Environmental Sound Classification on the Edge: A Pipeline for Deep Acoustic Networks on Extremely Resource-Constrained Devicescited by 5
- 2021Leveraging Image-based Generative Adversarial Networks for Time Series Generationcited by 4
- 2022HarmoF0: Logarithmic Scale Dilated Convolution For Pitch Estimationcited by 4
- 2021Pruning vs XNOR-Net: A Comprehensive Study of Deep Learning for Audio Classification on Edge-devicescited by 3
- 2022Urban Rhapsody: Large-scale exploration of urban soundscapescited by 3
- 2021AMSS-Net: Audio Manipulation on User-Specified Sources with Textual Queriescited by 2
- 2024Audio-visual cross-modality knowledge transfer for machine learning-based in-situ monitoring in laser additive manufacturingcited by 2
- 2025DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillationcited by 2
- 2025A Bird Song Detector for improving bird identification through Deep Learning: a case study from Do~nanacited by 1
12 most cited of 15 All 15 (JSON)
- 2026SpecRegMatch: Robust Semi-Supervised Regression for Vehicle Interior Noise Prediction28 Sep 2026
- 2025DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillation15 Oct 2025
- 2025A Bird Song Detector for improving bird identification through Deep Learning: a case study from Do~nana19 Mar 2025
- 2024Audio-visual cross-modality knowledge transfer for machine learning-based in-situ monitoring in laser additive manufacturing9 Aug 2024
- 2024animal2vec and MeerKAT: A self-supervised transformer for rare-event raw audio input and a large-scale reference dataset for bioacoustics3 Jun 2024
- 2024Tuning In: Analysis of Audio Classifier Performance in Clinical Settings with Limited Data7 Feb 2024
- 2022Multi-modal Fusion Technology based on Vehicle Information: A Survey11 Nov 2022
- 2022Urban Rhapsody: Large-scale exploration of urban soundscapes25 May 2022
- 2022Financial Time Series Data Augmentation with Generative Adversarial Networks and Extended Intertemporal Return Plots18 May 2022
- 2022HarmoF0: Logarithmic Scale Dilated Convolution For Pitch Estimation2 May 2022
- 2021Leveraging Image-based Generative Adversarial Networks for Time Series Generation15 Dec 2021
- 2021When are Deep Networks really better than Decision Forests at small sample sizes, and how?31 Aug 2021
12 newest of 15 All 15 (JSON)