Speech Unlearning
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
We introduce machine unlearning for speech tasks, a novel and underexplored research problem that aims to efficiently and effectively remove the influence of specific data from trained speech models without full retraining. This has important applications in privacy preservation, removal of outdated or noisy data, and bias mitigation. While machine unlearning has been studied in computer vision and natural language processing, its application to speech is largely unexplored due to the high-dimensional, sequential, and speaker-dependent nature of speech data. We define two fundamental speech unlearning tasks: sample unlearning, which removes individual data points (e.g., a voice recording), and class unlearning, which removes an entire category (e.g., all data from a speaker), while preserving performance on the remaining data. Experiments on keyword spotting and speaker identification demonstrate that unlearning speech data is significantly more challenging than unlearning image or text data. We conclude with key future directions in this area, including structured training, robust evaluation, feature-level unlearning, broader applications, scalable methods, and adversarial robustness.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 24 of its 37 references that are in the map. First posted on arXiv 1 Jun 2025.
Builds on
24 of 37 references.
Closest ancestors · 15
Same direction, newest first
- 2025Tool Unlearning for Tool-Augmented LLMs3 Feb
- 2024MU-Bench: A Multitask Multimodal Benchmark for Machine Unlearning21 Jun
- 2024Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference12 Jun
- 2024SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning28 Apr
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr
- 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
- 2023Certified Minimax Unlearning with Generalization Rates and Deletion Capacity16 Dec
- 2023MultiDelete for Multimodal Machine Unlearning18 Nov
- 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
- 2023Who's Harry Potter? Approximate Unlearning in LLMs3 Oct
- 2023SAFE: Machine Unlearning With Shard Graphs25 Apr
- 2022Deep Regression Unlearning15 Oct
3 more
Other references · 9
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2019Machine Unlearningcited by 1,061
- 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 666
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 618
- 2024Machine Unlearning for Image-to-Image Generative Modelscited by 47
- 2022Machine Unlearning of Federated Clusterscited by 22
- 2024CogniVoice: Multimodal and Multilingual Fusion Networks for Mild Cognitive Impairment Assessment from Spontaneous Speechcited by 8
Built on by
Citing papers per year: 2025: 1; 2026: 6.
7 papers.
- 2025FUTURE: Flexible Unlearning for Tree Ensemblecited by 3
- 2026TRACER: Token ReAssignment for Concept ERasure in Generative Recommendationcited by 2
- 2026Fair Cognitive Impairment Detection Through Unlearningcited by 0
- 2026Understanding Machine Unlearning Through the Lens of Mode Connectivitycited by 0
- 2026Machine Unlearning for Speech Question Answering in Large Audio-Language Modelscited by 0
- 2026Inference-Time Target Speaker Unlearning in LLM-Based Automatic Speech Recognitioncited by 0
- 2026Evaluating Machine Unlearning in ASRcited by 0
- 2026Evaluating Machine Unlearning in ASR28 Sep 2026
- 2026Inference-Time Target Speaker Unlearning in LLM-Based Automatic Speech Recognition24 Sep 2026
- 2026Machine Unlearning for Speech Question Answering in Large Audio-Language Models13 Aug 2026
- 2026Understanding Machine Unlearning Through the Lens of Mode Connectivity27 Jul 2026
- 2026Fair Cognitive Impairment Detection Through Unlearning17 Jun 2026
- 2026TRACER: Token ReAssignment for Concept ERasure in Generative Recommendation5 Jun 2026
- 2025FUTURE: Flexible Unlearning for Tree Ensemble28 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025"Alexa, can you forget me?" Machine Unlearning Benchmark in Spoken Language Understanding
- 2026Forgetting Similar Samples: Can Machine Unlearning Do it Better?
- 2026Continual Speaker Identity Unlearning with Minimal Interference
- 2023Machine Unlearning: A Survey
- 2026Unlearning in LLMs: Methods, Evaluation, and Open Challenges
- 2026Open-MMUnlearning: Unifying Methods and Evaluation for MLLM Unlearning
- 2024Gone but Not Forgotten: Improved Benchmarks for Machine Unlearning
- 2026SAU: Sparsity-Aware Unlearning for LLMs via Gradient Masking and Importance Redistribution