# A High Fidelity and Low Complexity Neural Audio Coding

arXiv: https://arxiv.org/abs/2310.10992 · HTML: https://mlsanity.com/paper/2310.10992/

## Key facts

- Cited by 2 papers in the map (data through 19 Oct 2026).
- First posted on arXiv 17 Oct 2023.

## Built on by (most cited first, 2 of 2)

- [ESPnet-Codec: Comprehensive Training and Evaluation of Neural Codecs for Audio, Music, and Speech](https://mlsanity.com/paper/2409.15897/) (2024)
- [Neural Speech Coding for Real-time Communications using Constant Bitrate Scalar Quantization](https://mlsanity.com/paper/2405.08417/) (2024)

## Abstract (arXiv)

Audio coding is an essential module in the real-time communication system. Neural audio codecs can compress audio samples with a low bitrate due to the strong modeling and generative capabilities of deep neural networks. To address the poor high-frequency expression and high computational cost and storage consumption, we proposed an integrated framework that utilizes a neural network to model wide-band components and adopts traditional signal processing to compress high-band components according to psychological hearing knowledge. Inspired by auditory perception theory, a perception-based loss function is designed to improve harmonic modeling. Besides, generative adversarial network (GAN) compression is proposed for the first time for neural audio codecs. Our method is superior to prior advanced neural codecs across subjective and objective metrics and allows real-time inference on desktop and mobile.