mlsanityData to 7 Oct 2026

Synergizing Human-AI Agency: A Guide of 23 Heuristics for Service Co-Creation with LLM-Based Agents

arXiv 2310.15065 ↗First posted 23 Oct 2023cs.HC cs.AIcited by 5

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

This empirical study serves as a primer for interested service providers to determine if and how Large Language Models (LLMs) technology will be integrated for their practitioners and the broader community. We investigate the mutual learning journey of non-AI experts and AI through CoAGent, a service co-creation tool with LLM-based agents. Engaging in a three-stage participatory design processes, we work with with 23 domain experts from public libraries across the U.S., uncovering their fundamental challenges of integrating AI into human workflows. Our findings provide 23 actionable "heuristics for service co-creation with AI", highlighting the nuanced shared responsibilities between humans and AI. We further exemplar 9 foundational agency aspects for AI, emphasizing essentials like ownership, fair treatment, and freedom of expression. Our innovative approach enriches the participatory design model by incorporating AI as crucial stakeholders and utilizing AI-AI interaction to identify blind spots. Collectively, these insights pave the way for synergistic and ethical human-AI co-creation in service contexts, preparing for workforce ecosystems where AI coexists.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 19 of its 108 references that are in the map. First posted on arXiv 23 Oct 2023.

Builds on

19 of 108 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023A Survey on Large Language Model based Autonomous Agents22 Aug
  2. 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration11 Jul

Other references · 17

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  2. 2021Ethical and social risks of harm from Language Modelscited by 957
  3. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
  4. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
  5. 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 337
  6. 2021AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Promptscited by 265
  7. 2023A Categorical Archive of ChatGPT Failurescited by 167
  8. 2018Neural Approaches to Conversational AIcited by 164
  9. 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 137
  10. 2022PromptChainer: Chaining Large Language Model Prompts through Visual Programmingcited by 134
  11. 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 86
  12. 2018Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Makingcited by 66
5 more
  1. 2022Designing Creative AI Partners with COFI: A Framework for Modeling Interaction in Human-AI Co-Creative Systemscited by 59
  2. 2019How should my chatbot interact? A survey on human-chatbot interaction designcited by 56
  3. 2021Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir"cited by 26
  4. 2022UX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital Librarycited by 20
  5. 2023Shaping the Emerging Norms of Using Large Language Models in Social Computing Researchcited by 14

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 2.

5 papers.

  1. 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studiescited by 127
  2. 2025Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistantcited by 54
  3. 2024Artificial Leviathan: Exploring Social Evolution of LLM Agents Through the Lens of Hobbesian Social Contract Theorycited by 15
  4. 2025Inherent and emergent liability issues in LLM-based agentic systems: a principal-agent perspectivecited by 12
  5. 2024Collaborative Participatory Research with LLM Agents in South Asia: An Empirically-Grounded Methodological Initiative and Agenda from Field Evidence in Sri Lankacited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026From Human-Human Collaboration to Human-Agent Collaboration: A Vision, Design Philosophy, and an Empirical Framework for Achieving Successful Partnerships Between Humans and LLM Agents
  2. 2025A Call for Collaborative Intelligence: Why Human-Agent Systems Should Precede AI Autonomy
  3. 2025Human-AI Co-Creation: A Framework for Collaborative Design in Intelligent Systems
  4. 2025Through the Lens of Human-Human Collaboration: A Configurable Research Platform for Exploring Human-Agent Collaboration
  5. 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey
  6. 2023CoQuest: Exploring Research Question Co-Creation with an LLM-based Agent
  7. 2023Who's Thinking? A Push for Human-Centered Evaluation of LLMs using the XAI Playbook
  8. 2024Creating an LLM-based AI-agent: A high-level methodology towards enhancing LLMs with APIs