mlsanityData to 14 Oct 2026

Securing the Future of GenAI: Policy and Technology

arXiv 2407.12999 ↗First posted 21 May 2024cs.CY cs.AI cs.CRcited by 4

Not on the map. Why?

Abstract (arXiv)

The rise of Generative AI (GenAI) brings about transformative potential across sectors, but its dual-use nature also amplifies risks. Governments globally are grappling with the challenge of regulating GenAI, balancing innovation against safety. China, the United States (US), and the European Union (EU) are at the forefront with initiatives like the Management of Algorithmic Recommendations, the Executive Order, and the AI Act, respectively. However, the rapid evolution of GenAI capabilities often outpaces the development of comprehensive safety measures, creating a gap between regulatory needs and technical advancements. A workshop co-organized by Google, University of Wisconsin, Madison (UW-Madison), and Stanford University aimed to bridge this gap between GenAI policy and technology. The diverse stakeholders of the GenAI space -- from the public and governments to academia and industry -- make any safety measures under consideration more complex, as both technical feasibility and regulatory guidance must be realized. This paper summarizes the discussions during the workshop which addressed questions, such as: How regulation can be designed without hindering technological progress? How technology can evolve to meet regulatory standards? The interplay between legislation and technology is a very vast topic, and we don't claim that this paper is a comprehensive treatment on this topic. This paper is meant to capture findings based on the workshop, and hopefully, can guide discussion on this topic.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 48 of its 87 references that are in the map. First posted on arXiv 21 May 2024.

Builds on

48 of 87 references.

References · 48

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  3. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  4. 2022Emergent Abilities of Large Language Modelscited by 2,512
  5. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  6. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  7. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
  8. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  9. 2022Toy Models of Superpositioncited by 971
  10. 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 729
  11. 2023A Watermark for Large Language Modelscited by 725
  12. 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 672
36 more
  1. 2022Diffusion Models for Adversarial Purificationcited by 476
  2. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 429
  3. 2018HiDDeN: Hiding Data With Deep Networkscited by 397
  4. 2023Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructionscited by 387
  5. 2023Can AI-Generated Text be Reliably Detected?cited by 386
  6. 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 356
  7. 2023Robust Distortion-free Watermarks for Language Modelscited by 320
  8. 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Modelscited by 304
  9. 2023Poisoning Web-Scale Training Datasets is Practicalcited by 290
  10. 2023Undetectable Watermarks for Language Modelscited by 226
  11. 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attackscited by 194
  12. 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 157
  13. 2020Adversarial Watermarking Transformer: Towards Tracing Text Provenance with Data Hidingcited by 130
  14. 2023Explore, Establish, Exploit: Red Teaming Language Models from Scratchcited by 114
  15. 2022Is Out-of-Distribution Detection Learnable?cited by 109
  16. 2024Faithfulness vs. Plausibility: On the (Un)Reliability of Explanations from Large Language Modelscited by 105
  17. 2024WAVES: Benchmarking the Robustness of Image Watermarkscited by 97
  18. 2023Evaluating Language-Model Agents on Realistic Autonomous Taskscited by 96
  19. 2024Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systemscited by 96
  20. 2023Identifying and Mitigating the Security Risks of Generative AIcited by 91
  21. 2023Do Models Explain Themselves? Counterfactual Simulatability of Natural Language Explanationscited by 85
  22. 2023Robustness of AI-Image Detectors: Fundamental Limits and Practical Attackscited by 81
  23. 2023Evading Watermark based Detection of AI-Generated Contentcited by 78
  24. 2023Publicly-Detectable Watermarking for Language Modelscited by 76
  25. 2020Detecting Deep-Fake Videos from Appearance and Behaviorcited by 66
  26. 2024PRP: Propagating Universal Perturbations to Attack Large Language Model Guard-Railscited by 52
  27. 2023LLM Censorship: A Machine Learning Challenge or a Computer Security Problem?cited by 49
  28. 2023Detecting Voice Cloning Attacks via Timbre Watermarkingcited by 44
  29. 2023Analyzing Chain-of-Thought Prompting in Large Language Models via Gradient-based Feature Attributionscited by 32
  30. 2023Quantifying Uncertainty in Natural Language Explanations of Large Language Modelscited by 32
  31. 2024A Transfer Attack to Image Watermarkscited by 27
  32. 2023Stable Diffusion Exposed: Gender Bias from Prompt to Imagecited by 25
  33. 2023PRIME: Prioritizing Interpretability in Failure Mode Extractioncited by 9
  34. 2023Word-Level Explanations for Analyzing Bias in Text-to-Image Modelscited by 8
  35. 2024Watermark-based Attribution of AI-Generated Contentcited by 8
  36. 2023Is Ignorance Bliss? The Role of Post Hoc Explanation Faithfulness and Alignment in Model Trust in Laypeople and Domain Expertscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.