Exploring Audio Editing Features as User-Centric Privacy Defenses Against Large Language Model(LLM) Based Emotion Inference Attacks
Not on the map. Why?
Abstract (arXiv)
The rapid proliferation of speech-enabled technologies, including virtual assistants, video conferencing platforms, and wearable devices, has raised significant privacy concerns, particularly regarding the inference of sensitive emotional information from audio data. Existing privacy-preserving methods often compromise usability and security, limiting their adoption in practical scenarios. This paper introduces a novel, user-centric approach that leverages familiar audio editing techniques, specifically pitch and tempo manipulation, to protect emotional privacy without sacrificing usability. By analyzing popular audio editing applications on Android and iOS platforms, we identified these features as both widely available and usable. We rigorously evaluated their effectiveness against a threat model, considering adversarial attacks from diverse sources, including Deep Neural Networks (DNNs), Large Language Models (LLMs), and and reversibility testing. Our experiments, conducted on three distinct datasets, demonstrate that pitch and tempo manipulation effectively obfuscates emotional data. Additionally, we explore the design principles for lightweight, on-device implementation to ensure broad applicability across various devices and platforms.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 40 references that are in the map. First posted on arXiv 30 Jan 2025.
Builds on
12 of 40 references.
References · 12
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2023SECap: Speech Emotion Captioning with Large Language Modelcited by 33
- 2024Beyond Silent Letters: Amplifying LLMs in Emotion Recognition with Vocal Nuancescited by 27
- 2020Privacy-preserving Voice Analysis via Disentangled Representationscited by 24
- 2021Attribute Inference Attack of Speech Emotion Recognition in Federated Learning Settingscited by 12
- 2022User-Level Differential Privacy against Attribute Inference Attack of Speech Emotion Recognition in Federated Learningcited by 9
- 2023SoK: Data Privacy in Virtual Realitycited by 6
- 2020Zooming Into Video Conferencing Privacy and Security Threatscited by 5
- 2023New Challenges for Content Privacy in Speech and Audiocited by 4
- 2022Privacy against Real-Time Speech Emotion Detection via Acoustic Adversarial Evasion of Machine Learningcited by 2
- 2020Emotion Recognition in Audio and Video Using Deep Neural Networkscited by 1
- 2023Music Enhances Activity in the Hypothalamus, Brainstem, and Anterior Cerebellum during Script-Driven Imagery of Affective Scenescited by 1
Built on by
Not cited yet.