mlsanityData to 14 Oct 2026

Unifying Speech Editing Detection and Content Localization via Prior-Enhanced Audio LLMs

arXiv 2601.21463 ↗First posted 29 Jan 2026cs.SD cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Existing speech editing detection (SED) datasets are predominantly constructed using manual splicing or limited editing operations, resulting in restricted diversity and poor coverage of realistic editing scenarios. Meanwhile, current SED methods rely heavily on frame-level supervision to detect observable acoustic anomalies, which fundamentally limits their ability to handle deletion-type edits, where the manipulated content is entirely absent from the signal. To address these challenges, we present a unified framework that bridges speech editing detection and content localization through a generative formulation based on Audio Large Language Models (Audio LLMs). We first introduce AiEdit, https://huggingface.co/datasets/JunXueTech/AiEdit, a large-scale bilingual dataset (approximately 140 hours) that covers addition, deletion, and modification operations using state-of-the-art end-to-end speech editing systems, providing a more realistic benchmark for modern threats. Building upon this, we reformulate SED as a structured text generation task, enabling joint reasoning over edit type identification, and content localization. To enhance the grounding of generative models in acoustic evidence, we propose a prior-enhanced prompting strategy that injects word-level probabilistic cues derived from a frame-level detector. Furthermore, we introduce an acoustic consistency-aware loss that explicitly enforces the separation between normal and anomalous acoustic representations in the latent space. Experimental results demonstrate that the proposed approach consistently outperforms existing methods across both detection and localization tasks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 35 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

26 of 35 references.

References · 26

  1. 2024Qwen2-Audio Technical Reportcited by 560
  2. 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 505
  3. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 361
  4. 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 178
  5. 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 161
  6. 2024VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wildcited by 120
  7. 2023LibriTTS-R: A Restored Multi-Speaker Text-to-Speech Corpuscited by 101
  8. 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 96
  9. 2023Libriheavy: a 50,000 hours ASR corpus with punctuation casing and contextcited by 85
  10. 2023ADD 2023: the Second Audio Deepfake Detection Challengecited by 64
  11. 2022The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterancecited by 47
  12. 2021Half-Truth: A Partially Fake Audio Detection Datasetcited by 44
14 more
  1. 2022A3T: Alignment-Aware Acoustic and Text Pretraining for Speech Synthesis and Editingcited by 40
  2. 2022The Vicomtech Audio Deepfake Detection System based on Wav2Vec2 for the 2022 ADD Challengecited by 35
  3. 2023FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Modelscited by 23
  4. 2025ALLM4ADD: Unlocking the Capabilities of Audio Large Language Models for Audio Deepfake Detectioncited by 17
  5. 2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representationcited by 17
  6. 2024LlamaPartialSpoof: An LLM-Driven Fake Speech Dataset Simulating Disinformation Generationcited by 14
  7. 2024StableVC: Style Controllable Zero-Shot Voice Conversion with Conditional Flow Matchingcited by 14
  8. 2024SSR-Speech: Towards Stable, Safe and Robust Zero-shot Text-based Speech Editing and Synthesiscited by 13
  9. 2023An Efficient Temporary Deepfake Location Approach Based Embeddings for Partially Spoofed Audio Detectioncited by 10
  10. 2024Coarse-to-Fine Proposal Refinement Framework for Audio Temporal Forgery Detection and Localizationcited by 9
  11. 2024Enhancing Partially Spoofed Audio Localization with Boundary-aware Attention Mechanismcited by 9
  12. 2025PartialEdit: Identifying Partial Deepfakes in the Era of Neural Speech Editingcited by 9
  13. 2025Chinese-LiPS: A Chinese audio-visual speech recognition dataset with Lip-reading and Presentation Slidescited by 5
  14. 2025Pay More Attention To Audio: Mitigating Imbalance of Cross-Modal Attention in Large Audio Language Modelscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.