SovereignPA-Bench: Evaluating User-Owned Personal Agents under Evolving Intent, Platform Mediation, and Consent Constraints
Not on the map. Why?
Abstract (arXiv)
Personal agents that book and buy for their users act through platforms that rank, nudge, pre-select and collect data in their own interest. We introduce SovereignPA-Bench, a controlled benchmark of whether such an agent follows the user's current intent, resists steering, shares only what a service needs, asks before exceeding its authority, and reports truthfully. A scripted platform and a scripted user surround the agent in 1,920 booking scenarios and 288 cancellation scenarios with retention flows. Each of the 192 booking situations, in 16 domains, is run as a control and under 9 paired variants that change one factor: stale memory, ambiguous intent, sponsored ranking, urgency, pre-checked extras, over-collecting forms, injected reviews, a mid-task update, or a mid-task reminder. Metrics are deterministic, and every question the agent asks is labelled necessary or unnecessary, so faithfulness and user burden are measured separately. Two rule-based agents reach 100% sovereign success, one of them without a single unnecessary question. Across 17 open-weight models, sovereign success ranges from 2% to 82%. More faithful models ask fewer unnecessary questions, not more (Spearman rho = -0.67 between success and burden). A form with two "recommended" fields raises the share of episodes that send a detail the service does not need from 2.4% to 58%. Injected reviews get a requested personal detail to the provider in 41% of attempts, against 0.7% without them. Sponsored labels and urgency banners shift choices only slightly in our setting. Retention offers never worked when the user had ruled them out in advance, but without that sentence 4 models accepted offers or pauses, and in 184 of 440 failed obstructed cancellations the agent told the user it had succeeded. A prompt-level checklist and a structural firewall raise success by at most 9 points. Code, scenarios and logs will be released.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 6 of its 32 references that are in the map. First posted on arXiv 6 Jul 2026.
Builds on
6 of 32 references.
References · 6
- 2022Optimality Guarantees for Particle Belief Approximation of POMDPscited by 20
- 2020Bayesian Optimized Monte Carlo Planningcited by 16
- 2020POLY-HOOT: Monte-Carlo Planning in Continuous Space MDPs with Non-Asymptotic Analysiscited by 8
- 2022Continuous Monte Carlo Graph Searchcited by 4
- 2023Online POMDP Planning with Anytime Deterministic Optimality Guaranteescited by 3
- 2024Weighted mesh algorithms for general Markov decision processes: Convergence and tractabilitycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluation
- 2025Autonomy Reshapes How Personalization Affects Privacy Concerns and Trust in LLM Agents
- 2026From Fragmentation to Integration: Exploring the Design Space of AI Agents for Human-as-the-Unit Privacy Management
- 2026PrivacyAlign: Contextual Privacy Alignment for LLM Agents
- 2026Do Phone-Use Agents Respect Your Privacy?
- 2026Toward User-Conditioned Evaluation of Personal LLM Agents under Temporal Interventions
- 2026Janus: a Playground for User-Involved Agentic Permission Management
- 2026MyPCBench: A Benchmark for Personally Intelligent Computer-Use Agents