Privacy-Utility Trade-off in Data Publication: A Bilevel Optimization Framework with Curvature-Guided Perturbation
On the map: LLM safety and security → Membership inference attacks
Abstract (arXiv)
Machine learning models require datasets for effective training, but directly sharing raw data poses significant privacy risk such as membership inference attacks (MIA). To mitigate the risk, privacy-preserving techniques such as data perturbation, generalization, and synthetic data generation are commonly utilized. However, these methods often degrade data accuracy, specificity, and diversity, limiting the performance of downstream tasks and thus reducing data utility. Therefore, striking an optimal balance between privacy preservation and data utility remains a critical challenge. To address this issue, we introduce a novel bilevel optimization framework for the publication of private datasets, where the upper-level task focuses on data utility and the lower-level task focuses on data privacy. In the upper-level task, a discriminator guides the generation process to ensure that perturbed latent variables are mapped to high-quality samples, maintaining fidelity for downstream tasks. In the lower-level task, our framework employs local extrinsic curvature on the data manifold as a quantitative measure of individual vulnerability to MIA, providing a geometric foundation for targeted privacy protection. By perturbing samples toward low-curvature regions, our method effectively suppresses distinctive feature combinations that are vulnerable to MIA. Through alternating optimization of both objectives, we achieve a synergistic balance between privacy and utility. Extensive experimental evaluations demonstrate that our method not only enhances resistance to MIA in downstream tasks but also surpasses existing methods in terms of sample quality and diversity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Membership inference attacks, one of 12 directions in LLM safety and security. Builds on 31 of its 65 references that are in the map. First posted on arXiv 2 Sep 2025.
Builds on
31 of 65 references.
Closest ancestors · 3
Same direction, newest first
- 2024Curvature Clues: Decoding Deep Learning Privacy with Input Loss Curvature3 Jul
- 2021Membership Inference Attacks From First Principles7 Dec
- 2021Practical Blind Membership Inference Attack via Differential Comparisons5 Jan
Other references · 28
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2016Improved Techniques for Training GANscited by 2,970
- 2016Deep Learning with Differential Privacycited by 2,728
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 690
- 2018ML-Leaks: Model and Data Independent Membership Inference Attacks and Defenses on Machine Learning Modelscited by 498
- 2018Deep Learning for Classical Japanese Literaturecited by 422
- 2020Label-Only Membership Inference Attackscited by 388
- 2020Systematic Evaluation of Privacy Risks of Machine Learning Modelscited by 292
- 2018Differentially Private Generative Adversarial Networkcited by 235
- 2017Latent Space Oddity: on the Curvature of Deep Generative Modelscited by 174
16 more
- 2019Privacy Risks of Securing Machine Learning Models against Adversarial Examplescited by 141
- 2020GS-WGAN: A Gradient-Sanitized Approach for Learning Differentially Private Generatorscited by 117
- 2020Variational Autoencoders with Riemannian Brownian Motion Priorscited by 34
- 2022A Geometric Perspective on Variational Autoencoderscited by 24
- 2019Effects of Differential Privacy and Data Skewness on Membership Inference Vulnerabilitycited by 17
- 2019Kannada-MNIST: A new handwritten digits dataset for the Kannada languagecited by 14
- 2020Quantifying Membership Inference Vulnerability via Generalization Gap and Other Model Metricscited by 13
- 2023Data Representations' Study of Latent Image Manifoldscited by 11
- 2021SHAPr: An Efficient and Versatile Membership Privacy Risk Metric for Machine Learningcited by 10
- 2025From Easy to Hard: Building a Shortcut for Differentially Private Image Synthesiscited by 7
- 2018Curvature-based Comparison of Two Neural Networkscited by 6
- 2024Decoder ensembling for learned latent geometriescited by 6
- 2025Geometry-Preserving Encoder/Decoder in Latent Generative Modelscited by 6
- 2019Feature-Based Interpolation and Geodesics in the Latent Spaces of Generative Modelscited by 5
- 2020Afro-MNIST: Synthetic generation of MNIST-style datasets for low-resource languagescited by 5
- 2023Differentially Private Synthetic Data Generation via Lipschitz-Regularised Variational Autoencoderscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Defending Membership Inference Attacks via Privacy-aware Sparsity Tuning
- 2024Mitigating Privacy Risk in Membership Inference by Convex-Concave Loss
- 2026Assessing Per-Sample Membership Inference Vulnerability without Retraining
- 2025The DCR Delusion: Measuring the Privacy Risk of Synthetic Data
- 2024Lost in the Averages: A New Specific Setup to Evaluate Membership Inference Attacks Against Machine Learning Models
- 2025Membership Inference Attacks as Privacy Tools: Reliability, Disparity and Ensemble
- 2025Synth-MIA: A Testbed for Auditing Privacy Leakage in Tabular Data Synthesis
- 2024Explaining the Model, Protecting Your Data: Revealing and Mitigating the Data Privacy Risks of Post-Hoc Model Explanations via Membership Inference