mlsanityData to 14 Oct 2026

Secure Multiparty Generative AI

arXiv 2409.19120 ↗First posted 27 Sep 2024cs.CR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

As usage of generative AI tools skyrockets, the amount of sensitive information being exposed to these models and centralized model providers is alarming. For example, confidential source code from Samsung suffered a data leak as the text prompt to ChatGPT encountered data leakage. An increasing number of companies are restricting the use of LLMs (Apple, Verizon, JPMorgan Chase, etc.) due to data leakage or confidentiality issues. Also, an increasing number of centralized generative model providers are restricting, filtering, aligning, or censoring what can be used. Midjourney and RunwayML, two of the major image generation platforms, restrict the prompts to their system via prompt filtering. Certain political figures are restricted from image generation, as well as words associated with women's health care, rights, and abortion. In our research, we present a secure and private methodology for generative artificial intelligence that does not expose sensitive data or models to third-party AI providers. Our work modifies the key building block of modern generative AI algorithms, e.g. the transformer, and introduces confidential and verifiable multiparty computations in a decentralized network to maintain the 1) privacy of the user input and obfuscation to the output of the model, and 2) introduce privacy to the model itself. Additionally, the sharding process reduces the computational burden on any one node, enabling the distribution of resources of large generative AI processes across multiple, smaller nodes. We show that as long as there exists one honest node in the decentralized computation, security is maintained. We also show that the inference process will still succeed if only a majority of the nodes in the computation are successful. Thus, our method offers both secure and verifiable computation in a decentralized network.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 27 Sep 2024.

Builds on

20 of 34 references.

References · 20

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  4. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
  5. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  6. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
  7. 2018DeepMind Control Suitecited by 956
  8. 2016Practical Black-Box Attacks against Machine Learningcited by 903
  9. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
  10. 2022DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scalecited by 407
  11. 2023Text Embeddings Reveal (Almost) As Much As Textcited by 192
  12. 2016DeepBach: a Steerable Model for Bach Chorales Generationcited by 91
8 more
  1. 2020FALCON: Honest-Majority Maliciously Secure Framework for Private Deep Learningcited by 74
  2. 2022MPCFormer: fast, performant and private Transformer inference with MPCcited by 69
  3. 2019CrypTFlow: Secure TensorFlow Inferencecited by 61
  4. 2020BLAZE: Blazing Fast Privacy-Preserving Machine Learningcited by 32
  5. 2022Selective Network Linearization for Efficient Private Inferencecited by 31
  6. 2020Automatic Cross-Replica Sharding of Weight Update in Data-Parallel Trainingcited by 30
  7. 2018Verification for Machine Learning, Autonomy, and Neural Networks Surveycited by 24
  8. 2021Circa: Stochastic ReLUs for Private Deep Learningcited by 16

Built on by

Not cited yet.