Trajectory Dynamics in Self-Supervised Learning Latent Space for Audio Deepfake Detection
Not on the map. Why?
Abstract (arXiv)
Human speech production is constrained by physiology, giving rise to characteristic temporal structure on acoustic signals. We hypothesise that these constraints manifest as structured trajectory dynamics in the latent space of Self-Supervised Learning (SSL) models, and that synthetic speech violates them detectably. To test this hypothesis, we train a causal Long Short-Term Memory (LSTM) next-frame predictor on bonafide speech only (Stage 1), using the deepfake-specialised SSL backbone Wav2Vec2-Large-AntiDeepfake, and compare against a static global-average-pooling baseline using identical features, thus isolating the contribution of temporal modelling. A supervised Stage 2, which trains a Multi-Layer Perceptron on the frozen LSTM internal states using labelled data, is included to characterise the role of spoof supervision. Our system achieves competitive or state-of-the-art performance across six benchmarks: ASVspoof 2019/2021, Codecfake, In-the-Wild, MLAAD-EN, and Deepfake-Eval-2024, including best published EER on ASVspoof 2021 (0.75%) and, notably, Stage 1 trained on bonafide speech only surpasses the published supervised baseline from the same backbone on DE2024 (30.35%). On near-domain benchmarks, static and dynamic approaches perform comparably. On harder cross-corpus benchmarks with diverse synthesis methods, trajectory dynamics provide substantial gains, confirming that temporal physiological constraints carry detection signal beyond utterance-level statistics.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 24 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
19 of 24 references.
References · 19
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
- 2022Does Audio Deepfake Detection Generalize?cited by 135
- 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 121
- 2020One-class Learning Towards Synthetic Voice Spoofing Detectioncited by 61
- 2024MLAAD: The Multi-Language Audio Anti-Spoofing Datasetcited by 56
- 2025Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024cited by 45
- 2021Speech is Silver, Silence is Golden: What do ASVspoof-trained Models Really Learn?cited by 37
- 2024The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audiocited by 31
- 2022SAMO: Speaker Attractor Multi-Center One-Class Learning for Voice Anti-Spoofingcited by 18
- 2025Post-training for Deepfake Speech Detectioncited by 11
- 2024SLIM: Style-Linguistics Mismatch Model for Generalized Audio Deepfake Detectioncited by 8
7 more
- 2025Generalizable Audio Deepfake Detection via Latent Space Refinement and Augmentationcited by 8
- 2026TRACE: Training-Free Partial Audio Deepfake Detection via Embedding Trajectory Analysis of Speech Foundation Modelscited by 5
- 2025Improving Out-of-Domain Audio Deepfake Detection via Layer Selection and Fusion of SSL-Based Countermeasurescited by 3
- 2026BreathNet: Generalizable Audio Deepfake Detection via Breath-Cue-Guided Feature Refinementcited by 2
- 2026ProSDD: Learning Prosodic Representations for Speech Deepfake Detection against Expressive and Emotional Attackscited by 2
- 2025QAMO: Quality-aware Multi-centroid One-class Learning For Speech Deepfake Detectioncited by 1
- 2026Fine-Grained Frame Modeling in Multi-head Self-Attention for Speech Deepfake Detectioncited by 1
Built on by
Not cited yet.