# Frame-to-Utterance Convergence: A Spectra-Temporal Approach for Unified Spoofing Detection

arXiv: https://arxiv.org/abs/2309.09837 · HTML: https://mlsanity.com/paper/2309.09837/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 18 Sep 2023.

## Built on by (most cited first, 9 of 9)

- [SLIM: Style-Linguistics Mismatch Model for Generalized Audio Deepfake Detection](https://mlsanity.com/paper/2407.18517/) (2024)
- [Adversarial Attacks on Audio Deepfake Detection: A Benchmark and Comparative Study](https://mlsanity.com/paper/2509.07132/) (2025)
- [TRACE: Training-Free Partial Audio Deepfake Detection via Embedding Trajectory Analysis of Speech Foundation Models](https://mlsanity.com/paper/2604.01083/) (2026)
- [SHIELD: A Secure and Highly Enhanced Integrated Learning for Robust Deepfake Detection against Adversarial Attacks](https://mlsanity.com/paper/2507.13170/) (2025)
- [Dual-Branch Gated Fusion for Open-Set Audio Deepfake Source Tracing](https://mlsanity.com/paper/2606.10223/) (2026)
- [Uncertainty-Aware Deepfake Detection via Multi-View Structural Learning](https://mlsanity.com/paper/2607.28769/) (2026)
- [ArFake: A Robust Framework for Multi-Dialect Arabic Speech Spoofing Detection Benchmark](https://mlsanity.com/paper/2509.22808/) (2025)
- [Performance and Complexity Trade-off Optimization of Speech Models During Training](https://mlsanity.com/paper/2601.13704/) (2026)
- [A Training-Free Proactive Defense Against Partial Speech Manipulation via Self-Embedding Steganography](https://mlsanity.com/paper/2608.25285/) (2026)

## Abstract (arXiv)

Voice spoofing attacks pose a significant threat to automated speaker verification systems. Existing anti-spoofing methods often simulate specific attack types, such as synthetic or replay attacks. However, in real-world scenarios, the countermeasures are unaware of the generation schema of the attack, necessitating a unified solution. Current unified solutions struggle to detect spoofing artifacts, especially with recent spoofing mechanisms. For instance, the spoofing algorithms inject spectral or temporal anomalies, which are challenging to identify. To this end, we present a spectra-temporal fusion leveraging frame-level and utterance-level coefficients. We introduce a novel local spectral deviation coefficient (SDC) for frame-level inconsistencies and employ a bi-LSTM-based network for sequential temporal coefficients (STC), which capture utterance-level artifacts. Our spectra-temporal fusion strategy combines these coefficients, and an auto-encoder generates spectra-temporal deviated coefficients (STDC) to enhance robustness. Our proposed approach addresses multiple spoofing categories, including synthetic, replay, and partial deepfake attacks. Extensive evaluation on diverse datasets (ASVspoof2019, ASVspoof2021, VSDC, partial spoofs, and in-the-wild deepfakes) demonstrated its robustness for a wide range of voice applications.