Automated Side Channel Analysis of Media Software with Manifold Learning
Not on the map. Why?
Abstract (arXiv)
The prosperous development of cloud computing and machine learning as a service has led to the widespread use of media software to process confidential media data. This paper explores an adversary's ability to launch side channel analyses (SCA) against media software to reconstruct confidential media inputs. Recent advances in representation learning and perceptual learning inspired us to consider the reconstruction of media inputs from side channel traces as a cross-modality manifold learning task that can be addressed in a unified manner with an autoencoder framework trained to learn the mapping between media inputs and side channel observations. We further enhance the autoencoder with attention to localize the program points that make the primary contribution to SCA, thus automatically pinpointing information-leakage points in media software. We also propose a novel and highly effective defensive technique called perception blinding that can perturb media inputs with perception masks and mitigate manifold learning-based SCA. Our evaluation exploits three popular media software to reconstruct inputs in image, audio, and text formats. We analyze three common side channels - cache bank, cache line, and page tables - and userspace-only cache set accesses logged by standard Prime+Probe. Our framework successfully reconstructs high-quality confidential inputs from the assessed media software and automatically pinpoint their vulnerable program points, many of which are unknown to the public. We further show that perception blinding can mitigate manifold learning-based SCA with negligible extra cost.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 34 of its 119 references that are in the map. First posted on arXiv 9 Dec 2021.
Builds on
34 of 119 references.
References · 34
- 2017Attention Is All You Needcited by 60,361
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2018CBAM: Convolutional Block Attention Modulecited by 2,477
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
- 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 864
- 2018Speech Commands: A Dataset for Limited-Vocabulary Speech Recognitioncited by 752
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 652
- 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
22 more
- 2017Image reconstruction by domain transform manifold learningcited by 232
- 2017Deep Cross-Modal Audio-Visual Generationcited by 63
- 2016Creating A Multi-track Classical Musical Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applicationscited by 61
- 2018SphereReID: Deep Hypersphere Manifold Embedding for Person Re-Identificationcited by 27
- 2018NEUZZ: Efficient Fuzzing with Neural Program Smoothingcited by 19
- 2017Statistical Parametric Speech Synthesis Incorporating Generative Adversarial Networkscited by 16
- 2017Software Grand Exposure: SGX Cache Attacks Are Practicalcited by 15
- 2019Cascade Attention Guided Residue Learning GAN for Cross-Modal Translationcited by 14
- 2019Deep Long Audio Inpaintingcited by 8
- 2017Malware Guard Extension: Using SGX to Conceal Cache Attackscited by 7
- 2017CacheZoom: How SGX Amplifies The Power of Cache Attackscited by 7
- 2019Neutaint: Efficient Dynamic Taint Analysis with Neural Networkscited by 7
- 2019An Off-Chip Attack on Hardware Enclaves via the Memory Buscited by 6
- 2015The Spy in the Sandbox -- Practical Cache Attacks in Javascriptcited by 4
- 2017Unsupervised Latent Behavior Manifold Learning from Acoustic Features: audio2behaviorcited by 3
- 2018MicroWalk: A Framework for Finding Side Channels in Binariescited by 2
- 2020Encoding Power Traces as Images for Efficient Side-Channel Analysiscited by 2
- 2021Osiris: Automated Discovery of Microarchitectural Side Channelscited by 2
- 2015Robust and Efficient Elimination of Cache and Timing Side Channelscited by 1
- 2016Rigorous Analysis of Software Countermeasures against Cache Attackscited by 1
- 2017Did we learn from LLC Side Channel Attacks? A Cache Leakage Detection Tool for Crypto Librariescited by 1
- 2019Identifying Cache-Based Side Channels through Secret-Augmented Abstract Interpretationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.