# Neural Style Transfer for Audio Spectograms

arXiv: https://arxiv.org/abs/1801.01589 · HTML: https://mlsanity.com/paper/1801.01589/

## Key facts

- Cited by 18 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 Jan 2018.

## Built on by (most cited first, 18 of 18)

- [Conditional Generation of Audio from Video via Foley Analogies](https://mlsanity.com/paper/2304.08490/) (2023)
- [Audio Transformers](https://mlsanity.com/paper/2105.00335/) (2021)
- [A Generative Model for Raw Audio Using Transformer Architectures](https://mlsanity.com/paper/2106.16036/) (2021)
- [Self-Supervised Audio-Visual Soundscape Stylization](https://mlsanity.com/paper/2409.14340/) (2024)
- [Synthesized Speech Detection Using Convolutional Transformer-Based Spectrogram Analysis](https://mlsanity.com/paper/2205.01800/) (2022)
- [ENACT-Heart -- ENsemble-based Assessment Using CNN and Transformer on Heart Sounds](https://mlsanity.com/paper/2502.16914/) (2025)
- [AC-Foley: Reference-Audio-Guided Video-to-Audio Synthesis with Acoustic Transfer](https://mlsanity.com/paper/2603.15597/) (2026)
- [Pruning vs XNOR-Net: A Comprehensive Study of Deep Learning for Audio Classification on Edge-devices](https://mlsanity.com/paper/2108.06128/) (2021)
- [Frequency Domain-Based Detection of Generated Audio](https://mlsanity.com/paper/2205.01806/) (2022)
- [Attention is All You Need? Good Embeddings with Statistics are enough:Large Scale Audio Understanding without Transformers/ Convolutions/ BERTs/ Mixers/ Attention/ RNNs or ....](https://mlsanity.com/paper/2110.03183/) (2021)
- [IndieFake Dataset: A Benchmark Dataset for Audio Deepfake Detection](https://mlsanity.com/paper/2506.19014/) (2025)
- [Voice Aging with Audio-Visual Style Transfer](https://mlsanity.com/paper/2110.02411/) (2021)
- [Actions Speak Louder than Listening: Evaluating Music Style Transfer based on Editing Experience](https://mlsanity.com/paper/2110.12855/) (2021)
- [One-Shot Acoustic Matching Of Audio Signals -- Learning to Hear Music In Any Room/ Concert Hall](https://mlsanity.com/paper/2210.15750/) (2022)
- [GAS-NeXt: Few-Shot Cross-Lingual Font Generator](https://mlsanity.com/paper/2212.02886/) (2022)
- [Content Adaptive Front End For Audio Classification](https://mlsanity.com/paper/2303.10446/) (2023)
- [Neural Architectures Learning Fourier Transforms, Signal Processing and Much More....](https://mlsanity.com/paper/2308.10388/) (2023)
- [Speech to Speech Synthesis for Voice Impersonation](https://mlsanity.com/paper/2602.16721/) (2026)

## Abstract (arXiv)

There has been fascinating work on creating artistic transformations of images by Gatys. This was revolutionary in how we can in some sense alter the 'style' of an image while generally preserving its 'content'. In our work, we present a method for creating new sounds using a similar approach, treating it as a style-transfer problem, starting from a random-noise input signal and iteratively using back-propagation to optimize the sound to conform to filter-outputs from a pre-trained neural architecture of interest. For demonstration, we investigate two different tasks, resulting in bandwidth expansion/compression, and timbral transfer from singing voice to musical instruments. A feature of our method is that a single architecture can generate these different audio-style-transfer types using the same set of parameters which otherwise require different complex hand-tuned diverse signal processing pipelines.