# Audio Spectrogram Representations for Processing with Convolutional Neural Networks

arXiv: https://arxiv.org/abs/1706.09559 · HTML: https://mlsanity.com/paper/1706.09559/

## Key facts

- Cited by 15 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 29 Jun 2017.

## Built on by (most cited first, 15 of 15)

- [animal2vec and MeerKAT: A self-supervised transformer for rare-event raw audio input and a large-scale reference dataset for bioacoustics](https://mlsanity.com/paper/2406.01253/) (2024)
- [Multi-modal Fusion Technology based on Vehicle Information: A Survey](https://mlsanity.com/paper/2211.06080/) (2022)
- [When are Deep Networks really better than Decision Forests at small sample sizes, and how?](https://mlsanity.com/paper/2108.13637/) (2021)
- [Environmental Sound Classification on the Edge: A Pipeline for Deep Acoustic Networks on Extremely Resource-Constrained Devices](https://mlsanity.com/paper/2103.03483/) (2021)
- [Leveraging Image-based Generative Adversarial Networks for Time Series Generation](https://mlsanity.com/paper/2112.08060/) (2021)
- [HarmoF0: Logarithmic Scale Dilated Convolution For Pitch Estimation](https://mlsanity.com/paper/2205.01019/) (2022)
- [Pruning vs XNOR-Net: A Comprehensive Study of Deep Learning for Audio Classification on Edge-devices](https://mlsanity.com/paper/2108.06128/) (2021)
- [Urban Rhapsody: Large-scale exploration of urban soundscapes](https://mlsanity.com/paper/2205.13064/) (2022)
- [AMSS-Net: Audio Manipulation on User-Specified Sources with Textual Queries](https://mlsanity.com/paper/2104.13553/) (2021)
- [Audio-visual cross-modality knowledge transfer for machine learning-based in-situ monitoring in laser additive manufacturing](https://mlsanity.com/paper/2408.05307/) (2024)
- [DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillation](https://mlsanity.com/paper/2510.13497/) (2025)
- [A Bird Song Detector for improving bird identification through Deep Learning: a case study from Do~nana](https://mlsanity.com/paper/2503.15576/) (2025)
- [Financial Time Series Data Augmentation with Generative Adversarial Networks and Extended Intertemporal Return Plots](https://mlsanity.com/paper/2205.08924/) (2022)
- [Tuning In: Analysis of Audio Classifier Performance in Clinical Settings with Limited Data](https://mlsanity.com/paper/2402.10100/) (2024)
- [SpecRegMatch: Robust Semi-Supervised Regression for Vehicle Interior Noise Prediction](https://mlsanity.com/paper/2609.34111/) (2026)

## Abstract (arXiv)

One of the decisions that arise when designing a neural network for any application is how the data should be represented in order to be presented to, and possibly generated by, a neural network. For audio, the choice is less obvious than it seems to be for visual images, and a variety of representations have been used for different applications including the raw digitized sample stream, hand-crafted features, machine discovered features, MFCCs and variants that include deltas, and a variety of spectral representations. This paper reviews some of these representations and issues that arise, focusing particularly on spectrograms for generating audio using neural networks for style transfer.