Generative AI Uses and Risks for Knowledge Workers in a Science Organization
Not on the map. Why?
Abstract (arXiv)
Generative AI could enhance scientific discovery by supporting knowledge workers in science organizations. However, the real-world applications and perceived concerns of generative AI use in these organizations are uncertain. In this paper, we report on a collaborative study with a US national laboratory with employees spanning Science and Operations about their use of generative AI tools. We surveyed 66 employees, interviewed a subset (N=22), and measured early adoption of an internal generative AI interface called Argo lab-wide. We have four findings: (1) Argo usage data shows small but increasing use by Science and Operations employees; Common current and envisioned use cases for generative AI in this context conceptually fall into either a (2) copilot or (3) workflow agent modality; and (4) Concerns include sensitive data security, academic publishing, and job impacts. Based on our findings, we make recommendations for generative AI use in science and other organizations.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 28 of its 79 references that are in the map. First posted on arXiv 27 Jan 2025.
Builds on
28 of 79 references.
References · 28
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 417
- 2023The Impact of AI on Developer Productivity: Evidence from GitHub Copilotcited by 264
- 2022Do Users Write More Insecure Code with AI Assistants?cited by 186
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
- 2023Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programmingcited by 87
- 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
- 2023Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Modelscited by 48
- 2024Can Large Language Models Write Parallel Code?cited by 36
- 2023Investigating and Designing for Trust in AI-powered Code Generation Toolscited by 34
16 more
- 2023Navigating the Complexity of Generative AI Adoption in Software Engineeringcited by 32
- 2023How Knowledge Workers Think Generative AI Will (Not) Transform Their Industriescited by 29
- 2023Opportunities for Retrieval and Tool Augmented Large Language Models in Scientific Facilitiescited by 27
- 2024Materials science in the era of large language models: a perspectivecited by 23
- 2023Scientists' Perspectives on the Potential for Generative AI in their Fieldscited by 22
- 2023Evaluation of OpenAI Codex for HPC Parallel Programming Models Kernel Generationcited by 22
- 2024"If the Machine Is As Good As Me, Then What Use Am I?" -- How the Use of ChatGPT Changes Young Professionals' Perception of Productivity and Accomplishmentcited by 19
- 2023The Rise of the AI Co-Pilot: Lessons for Design from Aviation and Beyondcited by 15
- 2024The Role of Generative AI in Software Development Productivity: A Pilot Case Studycited by 14
- 2024LASSI: An LLM-based Automated Self-Correcting Pipeline for Translating Parallel Scientific Codescited by 10
- 2023An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactionscited by 9
- 2024Generative AI in the Wild: Prospects, Challenges, and Strategiescited by 9
- 2024"It's like a rubber duck that talks back": Understanding Generative AI-Assisted Data Analysis Workflows through a Participatory Prompting Studycited by 6
- 2024AI and Generative AI for Research Discovery and Summarizationcited by 4
- 2023Designing Ocean Vision AI: An Investigation of Community Needs for Imaging-based Ocean Conservationcited by 3
- 2023Large Language Models to the Rescue: Reducing the Complexity in Scientific Workflow Development Using ChatGPTcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2025A Case Study Investigating the Role of Generative AI in Quality Evaluations of Epics in Agile Software Developmentcited by 1
- 2026Beyond the Desk: Barriers and Future Opportunities for AI to Assist Scientists in Embodied Physical Taskscited by 1
- 2026Rethinking Code Review in the Age of AI: A Vision for Agentic Code Reviewcited by 1
- 2026Upskilling with Generative AI: Practices and Challenges for Freelance Knowledge Workerscited by 0
- 2026From Tool to Agent: How Worker Needs Reorganize Across the Agentic Roles of Workplace AIcited by 0
- 2026Rethinking Code Review in the Age of AI: A Vision for Agentic Code Review17 May 2026
- 2026From Tool to Agent: How Worker Needs Reorganize Across the Agentic Roles of Workplace AI4 May 2026
- 2026Upskilling with Generative AI: Practices and Challenges for Freelance Knowledge Workers29 Apr 2026
- 2026Beyond the Desk: Barriers and Future Opportunities for AI to Assist Scientists in Embodied Physical Tasks19 Mar 2026
- 2025A Case Study Investigating the Role of Generative AI in Quality Evaluations of Epics in Agile Software Development12 May 2025