mlsanityData to 14 Oct 2026

Generative AI in Knowledge Work: Design Implications for Data Navigation and Decision-Making

arXiv 2503.18419 ↗First posted 24 Mar 2025cs.HC cs.AI cs.ETcited by 9

Not on the map. Why?

Abstract (arXiv)

Our study of 20 knowledge workers revealed a common challenge: the difficulty of synthesizing unstructured information scattered across multiple platforms to make informed decisions. Drawing on their vision of an ideal knowledge synthesis tool, we developed Yodeai, an AI-enabled system, to explore both the opportunities and limitations of AI in knowledge work. Through a user study with 16 product managers, we identified three key requirements for Generative AI in knowledge work: adaptable user control, transparent collaboration mechanisms, and the ability to integrate background knowledge with external information. However, we also found significant limitations, including overreliance on AI, user isolation, and contextual factors outside the AI's reach. As AI tools become increasingly prevalent in professional settings, we propose design principles that emphasize adaptability to diverse workflows, accountability in personal and collaborative contexts, and context-aware interoperability to guide the development of human-centered AI systems for product managers and knowledge workers.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 27 of its 100 references that are in the map. First posted on arXiv 24 Mar 2025.

Builds on

27 of 100 references.

References · 27

  1. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  2. 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 841
  3. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  4. 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 186
  5. 2023OpenAgents: An Open Platform for Language Agents in the Wildcited by 137
  6. 2023Generative AIcited by 120
  7. 2023The Metacognitive Demands and Opportunities of Generative AIcited by 87
  8. 2021Towards a Science of Human-AI Decision Making: A Survey of Empirical Studiescited by 86
  9. 2023Graphologue: Exploring Large Language Model Responses with Interactive Diagramscited by 66
  10. 2022Can Large Language Models Truly Understand Prompts? A Case Study with Negated Promptscited by 59
  11. 2024Design Principles for Generative AI Applicationscited by 57
  12. 2024Determinants of LLM-assisted Decision-Makingcited by 56
15 more
  1. 2023Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Modelscited by 48
  2. 2022Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summariescited by 47
  3. 2019"The Human Body is a Black Box": Supporting Clinical Decision-Making with Deep Learningcited by 39
  4. 2023Large Language Models for Scientific Synthesis, Inference and Explanationcited by 39
  5. 2022Advancing Human-AI Complementarity: The Impact of User Expertise and Algorithmic Tuning on Joint Decision Makingcited by 33
  6. 2023Rethinking Human-AI Collaboration in Complex Medical Decision Making: A Case Study in Sepsis Diagnosiscited by 30
  7. 2023How Knowledge Workers Think Generative AI Will (Not) Transform Their Industriescited by 30
  8. 2023Synergi: A Mixed-Initiative System for Scholarly Synthesis and Sensemakingcited by 26
  9. 2022Threddy: An Interactive System for Personalized Thread-based Exploration and Organization of Scientific Literaturecited by 22
  10. 2024"If the Machine Is As Good As Me, Then What Use Am I?" -- How the Use of ChatGPT Changes Young Professionals' Perception of Productivity and Accomplishmentcited by 19
  11. 2023Beyond ChatBots: ExploreLLM for Structured Thoughts and Personalized Model Responsescited by 18
  12. 2023User Experience Design Professionals' Perceptions of Generative Artificial Intelligencecited by 16
  13. 2024Not Just Novelty: A Longitudinal Study on Utility and Customization of an AI Workflowcited by 14
  14. 2024Generative Echo Chamber? Effects of LLM-Powered Search Systems on Diverse Information Seekingcited by 13
  15. 2024To Search or To Gen? Exploring the Synergy between Generative AI and Web Search in Programmingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 8.

9 papers.