mlsanityData to 14 Oct 2026

"I Didn't Make the Micro Decisions": Measuring, Inducing, and Exposing Goal-Level AI Contributions in Collaboration

arXiv 2605.21363 ↗First posted 20 May 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

As large language models (LLMs) increasingly shape how users form, refine, and extend their goals, attributing contributions in human-AI collaboration becomes critical for users calibrating their own reliance and for evaluators assessing AI-assisted work. Yet existing methods focus on final artifacts, missing the process through which goals themselves are jointly shaped. We introduce a goal-level attribution framework, CoTrace, that decomposes explicit goals into verifiable requirements and traces both direct contributions and indirect influences across dialogue turns. Applying CoTrace to 638 real-world collaboration logs, we find that while models account for only 11-26% of goal-shaping contribution, they contribute substantially more on introducing lower-level concrete requirements, and make various kinds of indirect contributions. Through controlled simulations, we show that interaction design choices significantly affect model goal-shaping behavior. In a user study, exposing participants to goal-level analyses shifts their perceived contributions by nearly 2 points on a 5-point scale, revealing systematic miscalibration in how users understand their own AI-assisted work.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 32 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

19 of 32 references.

References · 19

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2024InFoBench: Evaluating Instruction Following Ability in Large Language Modelscited by 135
  3. 2025Checklists Are Better Than Reward Models For Aligning Language Modelscited by 128
  4. 2024Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaborationcited by 65
  5. 2023Stylometric Detection of AI-Generated Text in Twitter Timelinescited by 59
  6. 2026Mind the Sim2Real Gap in User Simulation for Agentic Taskscited by 54
  7. 2025Levels of Autonomy for AI Agentscited by 48
  8. 2025Future of Work with AI Agents: Auditing Automation and Augmentation Potential across the U.S. Workforcecited by 38
  9. 2024Evaluating Human-AI Collaboration: A Review and Methodological Frameworkcited by 27
  10. 2024Watermarking Techniques for Large Language Models: A Surveycited by 23
  11. 2025Taxonomy of User Needs and Actionscited by 15
  12. 2025ShareChat: A Dataset of Chatbot Conversations in the Wildcited by 15
7 more
  1. 2025Which Contributions Deserve Credit? Perceptions of Attribution in Human-AI Co-Creationcited by 14
  2. 2025The StudyChat Dataset: Analyzing Student Dialogues With ChatGPT in an Artificial Intelligence Coursecited by 9
  3. 2025DraftMarks: Enhancing Transparency in Human-AI Co-Writing Through Interactive Skeuomorphic Process Tracescited by 6
  4. 2025Completion neq Collaboration: Scaling Collaborative Effort with Agentscited by 6
  5. 2026DiscoverLLM: From Executing Intents to Discovering Themcited by 6
  6. 2025Open-Ended Goal Inference through Actions and Language for Human-Robot Collaborationcited by 5
  7. 2026How2Everything: Mining the Web for How-To Procedures to Evaluate and Improve LLMscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.