# Codec-Based Deepfake Source Tracing via Neural Audio Codec Taxonomy

arXiv: https://arxiv.org/abs/2505.12994 · HTML: https://mlsanity.com/paper/2505.12994/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 May 2025.

## Built on by (most cited first, 6 of 6)

- [Open-Set Source Tracing as Compositional Factors via Structured Prototypes](https://mlsanity.com/paper/2607.03134/) (2026)
- [Towards Generalized Source Tracing for Codec-Based Deepfake Speech](https://mlsanity.com/paper/2506.07294/) (2025)
- [Audio Deepfake Detection in the Age of Advanced Text-to-Speech models](https://mlsanity.com/paper/2601.20510/) (2026)
- [Quantizer-Aware Hierarchical Neural Codec Modeling for Speech Deepfake Detection](https://mlsanity.com/paper/2603.16914/) (2026)
- [Time-Frequency Consistency Learning for Robust Speech Deepfake Detection](https://mlsanity.com/paper/2607.17761/) (2026)
- [Clean Accuracy Does Not Guarantee Provenance Robustness: A Prospective Codec-Stress Evaluation of Audio Attribution](https://mlsanity.com/paper/2609.07981/) (2026)

## Abstract (arXiv)

Recent advances in neural audio codec-based speech generation (CoSG) models have produced remarkably realistic audio deepfakes. We refer to deepfake speech generated by CoSG systems as codec-based deepfake, or CodecFake. Although existing anti-spoofing research on CodecFake predominantly focuses on verifying the authenticity of audio samples, almost no attention was given to tracing the CoSG used in generating these deepfakes. In CodecFake generation, processes such as speech-to-unit encoding, discrete unit modeling, and unit-to-speech decoding are fundamentally based on neural audio codecs. Motivated by this, we introduce source tracing for CodecFake via neural audio codec taxonomy, which dissects neural audio codecs to trace CoSG. Our experimental results on the CodecFake+ dataset provide promising initial evidence for the feasibility of CodecFake source tracing while also highlighting several challenges that warrant further investigation.