Beyond Release: Access Considerations for Generative AI Systems
Not on the map. Why?
Abstract (arXiv)
Generative AI release decisions determine whether system components are made available, but release does not address many other elements that change how users and stakeholders are able to engage with a system. Beyond release, access to system components informs potential risks and benefits. Access refers to practical needs, infrastructurally, technically, and societally, in order to use available components in some way. We deconstruct access along three axes: resourcing, technical usability, and utility. Within each category, a set of variables per system component clarify tradeoffs. For example, resourcing requires access to computing infrastructure to serve model weights. We also compare the accessibility of four high performance language models, two open-weight and two closed-weight, showing similar considerations for all based instead on access variables. Access variables set the foundation for being able to scale or increase access to users; we examine the scale of access and how scale affects ability to manage and intervene on risks. This framework better encompasses the landscape and risk-benefit tradeoffs of system releases to inform system release decisions, research, and policy.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 40 of its 102 references that are in the map. First posted on arXiv 23 Feb 2025.
Builds on
40 of 102 references.
References · 40
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
- 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 515
- 2019Release Strategies and the Social Impacts of Language Modelscited by 505
- 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 415
- 2020Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)cited by 318
- 2022Red-Teaming the Stable Diffusion Safety Filtercited by 257
28 more
- 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Modelscited by 186
- 2023Power Hungry Processing: Watts Driving the Cost of AI Deployment?cited by 186
- 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
- 2024Stealing Part of a Production Language Modelcited by 152
- 2024Tamper-Resistant Safeguards for Open-Weight LLMscited by 132
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
- 2024The rising costs of training frontier AI modelscited by 91
- 2024WAVES: Benchmarking the Robustness of Image Watermarkscited by 89
- 2024OpenELM: An Efficient Language Model Family with Open Training and Inference Frameworkcited by 74
- 2021Memorization vs. Generalization: Quantifying Data Leakage in NLP Performance Evaluationcited by 69
- 2024On the Societal Impact of Open Foundation Modelscited by 64
- 2023The Gradient of Generative AI Release: Methods and Considerationscited by 63
- 2022Self-Destructing Models: Increasing the Costs of Harmful Dual Uses of Foundation Modelscited by 56
- 2024The Limits of Inference Scaling Through Resamplingcited by 51
- 2024A Safe Harbor for AI Evaluation and Red Teamingcited by 46
- 2024Consent in Crisis: The Rapid Decline of the AI Data Commonscited by 45
- 2022Structured access: an emerging paradigm for safe AI deploymentcited by 40
- 2024Logits of API-Protected LLMs Leak Proprietary Informationcited by 38
- 2022Data Governance in the Age of Large-Scale Data-Driven Language Technologycited by 32
- 2023The ROOTS Search Tool: Data Transparency for LLMscited by 30
- 2024Navigating Dataset Documentations in AI: A Large-Scale Analysis of Dataset Cards on Hugging Facecited by 27
- 2023Scaling Down to Scale Up: A Cost-Benefit Analysis of Replacing OpenAI's LLM with Open Source SLMs in Productioncited by 21
- 2024The Model Openness Framework: Promoting Completeness and Openness for Reproducibility, Transparency, and Usability in Artificial Intelligencecited by 21
- 2023Protecting Society from AI Misuse: When are Restrictions on Capabilities Warranted?cited by 15
- 2024Towards a Framework for Openness in Foundation Models: Proceedings from the Columbia Convening on Openness in Artificial Intelligencecited by 7
- 2023What is the Impact of Releasing Code with Publications? Statistics from the Machine Learning, Robotics, and Control Communitiescited by 4
- 2024The Implications of Open Generative Models in Human-Centered Data Science Work: A Case Study with Fact-Checking Organizationscited by 3
- 2024PRISM: A Design Framework for Open-Source Foundation Model Safetycited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.