mlsanityData to 14 Oct 2026

Zero-Shot Temporal Localisation of Audio Deepfakes in Multi-Speaker Conversations

arXiv 2609.10051 ↗First posted 9 Sep 2026cs.SD cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Voice-cloning fraud increasingly relies on surgical injection: a genuine conversation in which only one or two sentences are replaced by synthetic speech. Utterance-level deepfake detectors emit a single real/fake label per clip and cannot report where the synthetic speech lies. We formalise this as Temporal Deepfake Localisation in Multi-Speaker Conversations (TDLMC), show that equal error rate and min-DCF are ill-posed once a file contains both classes, and propose temporal metrics for this regime. Our contribution is a training-free five-stage pipeline that wraps a frozen binary detector and adds segment-level output with no retraining, using a two-threshold hysteresis finitestate-machine decoder to turn noisy window scores into coherent intervals. On 180 constructed multi-speaker conversations from ASVspoof 5, the system attains temporal intersection-over-union 0.90, temporal detection rate 0.95, and MS-DCF 0.26 with a strong backbone, and its false-alarm rate on genuine speech is below 6%, falling under 2% on genuine real multi-speaker dialogue (AMI). Under an identical pipeline, a trained localiser improves temporal IoU by only about 0.04, bounding the cost of forgoing supervision. Evaluated across three frozen detectors under one decoder whose constants are selected on a held-out calibration split, and with a controlled analysis attributing the residual false-alarm rate to a backbone domain gap rather than to the decoder, this provides the first zero-shot baseline and a reusable benchmark for TDLMC.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 17 references that are in the map. First posted on arXiv 9 Sep 2026.

Builds on

14 of 17 references.

References · 14

  1. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  2. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  3. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
  4. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 361
  5. 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
  6. 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 91
  7. 2021ASVspoof 2019: spoofing countermeasures for the detection of synthesized, converted and replayed speechcited by 58
  8. 2023Audio Deepfake Detection: A Surveycited by 50
  9. 2022The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterancecited by 47
  10. 2021Half-Truth: A Partially Fake Audio Detection Datasetcited by 44
  11. 2025Speech DF Arena: A Leaderboard for Speech DeepFake Detection Modelscited by 21
  12. 2023Range-Based Equal Error Rate for Spoof Localizationcited by 5
2 more
  1. 2025LENS-DF: Deepfake Detection and Temporal Localization for Long-Form Noisy Speechcited by 2
  2. 2026Multi-Speaker Conversational Audio Deepfake: Taxonomy, Dataset and Pilot Studycited by 2

Built on by

Not cited yet.