mlsanityData to 14 Oct 2026

Speech Unlearning

arXiv 2506.00848 ↗First posted 1 Jun 2025cs.LG cs.AI cs.SDcited by 7

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

We introduce machine unlearning for speech tasks, a novel and underexplored research problem that aims to efficiently and effectively remove the influence of specific data from trained speech models without full retraining. This has important applications in privacy preservation, removal of outdated or noisy data, and bias mitigation. While machine unlearning has been studied in computer vision and natural language processing, its application to speech is largely unexplored due to the high-dimensional, sequential, and speaker-dependent nature of speech data. We define two fundamental speech unlearning tasks: sample unlearning, which removes individual data points (e.g., a voice recording), and class unlearning, which removes an entire category (e.g., all data from a speaker), while preserving performance on the remaining data. Experiments on keyword spotting and speaker identification demonstrate that unlearning speech data is significantly more challenging than unlearning image or text data. We conclude with key future directions in this area, including structured training, robust evaluation, feature-level unlearning, broader applications, scalable methods, and adversarial robustness.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 24 of its 37 references that are in the map. First posted on arXiv 1 Jun 2025.

Builds on

24 of 37 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025Tool Unlearning for Tool-Augmented LLMs3 Feb
  2. 2024MU-Bench: A Multitask Multimodal Benchmark for Machine Unlearning21 Jun
  3. 2024Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference12 Jun
  4. 2024SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning28 Apr
  5. 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr
  6. 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
  7. 2023Certified Minimax Unlearning with Generalization Rates and Deletion Capacity16 Dec
  8. 2023MultiDelete for Multimodal Machine Unlearning18 Nov
  9. 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
  10. 2023Who's Harry Potter? Approximate Unlearning in LLMs3 Oct
  11. 2023SAFE: Machine Unlearning With Shard Graphs25 Apr
  12. 2022Deep Regression Unlearning15 Oct
3 more
  1. 2022Algorithms that Approximate Data Removal: New Results and Limitations25 Sep
  2. 2022Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks using an Incompetent Teacher17 May
  3. 2022Continual Learning and Private Unlearning24 Mar

Other references · 9

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  3. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  4. 2019Machine Unlearningcited by 1,061
  5. 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 666
  6. 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 618
  7. 2024Machine Unlearning for Image-to-Image Generative Modelscited by 47
  8. 2022Machine Unlearning of Federated Clusterscited by 22
  9. 2024CogniVoice: Multimodal and Multilingual Fusion Networks for Mild Cognitive Impairment Assessment from Spontaneous Speechcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 6.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025"Alexa, can you forget me?" Machine Unlearning Benchmark in Spoken Language Understanding
  2. 2026Forgetting Similar Samples: Can Machine Unlearning Do it Better?
  3. 2026Continual Speaker Identity Unlearning with Minimal Interference
  4. 2023Machine Unlearning: A Survey
  5. 2026Unlearning in LLMs: Methods, Evaluation, and Open Challenges
  6. 2026Open-MMUnlearning: Unifying Methods and Evaluation for MLLM Unlearning
  7. 2024Gone but Not Forgotten: Improved Benchmarks for Machine Unlearning
  8. 2026SAU: Sparsity-Aware Unlearning for LLMs via Gradient Masking and Importance Redistribution