# The Shadow Boss: Identifying Atomized Manipulations in Agentic Employment of XR Users using Scenario Constructions

arXiv: https://arxiv.org/abs/2602.13622 · HTML: https://mlsanity.com/paper/2602.13622/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use.
- Builds on 11 of its 68 references that are in the map.
- First posted on arXiv 14 Feb 2026.

## Placed in

- LLM agents and tool use / [General LLM agent frameworks and benchmarks](https://mlsanity.com/agents/general-llm-agent-frameworks-and-benchmarks/)

## Builds on (most cited first, 11 of 11)

- [All One Needs to Know about Metaverse: A Complete Survey on Technological Singularity, Virtual Ecosystem, and Research Agenda](https://mlsanity.com/paper/2110.05352/) (2021)
- [XAIR: A Framework of Explainable AI in Augmented Reality](https://mlsanity.com/paper/2303.16292/) (2023)
- [Understanding the Impact of AI Generated Content on Social Media: The Pixiv Case](https://mlsanity.com/paper/2402.18463/) (2024)
- [Towards Augmented Reality-driven Human-City Interaction: Current Research on Mobile Headsets and Future Challenges](https://mlsanity.com/paper/2007.09207/) (2020)
- [The Dark Side of Augmented Reality: Exploring Manipulative Designs in AR](https://mlsanity.com/paper/2303.02843/) (2023)
- [Wearable AR in Everyday Contexts: Insights from a Digital Ethnography of YouTube Videos](https://mlsanity.com/paper/2502.06191/) (2025)
- [DeepDR: Deep Structure-Aware RGB-D Inpainting for Diminished Reality](https://mlsanity.com/paper/2312.00532/) (2023)
- [PersoNo: Personalised Notification Urgency Classifier in Mixed Reality](https://mlsanity.com/paper/2508.19622/) (2025)
- [MetaDragonBoat: Exploring Paddling Techniques of Virtual Dragon Boating in a Metaverse Campus](https://mlsanity.com/paper/2408.04013/) (2024)
- [Mind Games! Exploring the Impact of Dark Patterns in Mixed Reality Scenarios](https://mlsanity.com/paper/2506.06774/) (2025)
- [MetaRoundWorm: A Virtual Reality Escape Room Game for Learning the Lifecycle and Immune Response to Parasitic Infections](https://mlsanity.com/paper/2509.01367/) (2025)

## Abstract (arXiv)

The emerging paradigm of ``Agentic Employment" is a labor model where autonomous AI agents, acting as economic principals rather than mere management tools, directly hire, instruct, and pay human workers. Facilitated by the launch of platforms like Rentahuman.ai in February 2026, this shift inverts the traditional ``ghost work" dynamic, positioning visible human workers as ``biological actuators" for invisible software entities. With speculative design approach, we analyze how Extended Reality (XR) serves as the critical ``control surface" for this relationship, enabling agents to issue granular, context-free micro-instructions while harvesting real-time environmental data. Through a scenario construction methodology, we identify seven key risk vectors, including the creation of a liability void where humans act as moral crumple zones for algorithmic risk, the acceleration of cognitive deskilling through ``Shadow Boss" micromanagement, and the manipulation of civic and social spheres via Diminished Reality (DR). The findings suggest that without new design frameworks prioritizing agency and legibility, Agentic Employment threatens to reduce human labor to a friction-less hardware layer for digital minds, necessitating urgent user-centric XR and policy interventions.