mlsanityData to 14 Oct 2026

Toward Personal Intelligence Through Cooperative Observation

arXiv 2608.17128 ↗First posted 17 Aug 2026cs.AI cs.CY cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

A personal AI system needs a model of the user's goals, constraints, and ongoing commitments to plan and act on their behalf, and the quality of that model is bounded by what the system can observe. Broader observation does not by itself improve assistance because a bounded system must select and compress information for the task at hand. We argue that this observation bottleneck has a cooperative structure: the system builds a partial model of the user's changing life, the user evaluates its actions, and the user's consent and control shape what it can observe next. Useful and inspectable behavior can give users a reason to maintain or expand the observation channel, while failures can lead them to correct, narrow, revoke, or abandon it. We use the term cooperative observation for this feedback loop among usefulness, trust, and future access, and propose it as a framework for personal intelligence. We report a preliminary single-subject account from Organizm, a prototype used over six months, and outline evaluation directions for measuring how observation quality shapes personal AI.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 43 references that are in the map. First posted on arXiv 17 Aug 2026.

Builds on

13 of 43 references.

References · 13

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  3. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,330
  4. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  5. 2020Performative Predictioncited by 327
  6. 2016Cooperative Inverse Reinforcement Learningcited by 300
  7. 2026From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agentscited by 37
  8. 2021What are you optimizing for? Aligning Recommender Systems with Human Valuescited by 29
  9. 2026Toward a Theory of Hierarchical Memory for Language Agentscited by 5
  10. 2026ClawTrap: A MITM-Based Red-Teaming Framework for Real-World OpenClaw Security Evaluationcited by 3
  11. 2026Why Solve It Twice? Hierarchical Accumulation of Skills for Transfer-Efficient ML Engineeringcited by 3
  12. 2025GOD model: Privacy Preserved AI School for Personal Assistantcited by 1
1 more
  1. 2025Online Behavioral Advertising: A Literature Review and Research Agendacited by 1

Built on by

Not cited yet.