mlsanityData to 7 Oct 2026

Visioning Human-Agentic AI Teaming: Continuity, Tension, and Future Research

arXiv 2603.04746 ↗First posted 5 Mar 2026cs.AI cs.HC econ.GNcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Artificial intelligence is undergoing a structural transformation marked by the rise of agentic systems capable of open-ended action trajectories, generative representations and outputs, and evolving objectives. These properties introduce structural uncertainty into human-AI teaming (HAT), including uncertainty about behavior trajectories, epistemic grounding, and the stability of governing logics over time. Under such conditions, alignment cannot be secured through agreement on bounded outputs; it must be continuously sustained as plans unfold and priorities shift. We advance Team Situation Awareness (Team SA) theory, grounded in shared perception, comprehension, and projection, as an integrative anchor for this transition. While Team SA remains analytically foundational, its stabilizing logic presumes that shared awareness, once achieved, will support coordinated action through iterative updating. Agentic AI challenges this presumption. Our argument unfolds in two stages: first, we extend Team SA to reconceptualize both human and AI awareness under open-ended agency, including the sensemaking of projection congruence across heterogeneous systems. Second, we interrogate whether the dynamic processes traditionally assumed to stabilize teaming in relational interaction, cognitive learning, and coordination and control continue to function under adaptive autonomy. By distinguishing continuity from tension, we clarify where foundational insights hold and where structural uncertainty introduces strain, and articulate a forward-looking research agenda for HAT. The central challenge of HAT is not whether humans and AI can agree in the moment, but whether they can remain aligned as futures are continuously generated, revised, enacted, and governed over time.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 11 of its 75 references that are in the map. First posted on arXiv 5 Mar 2026.

Builds on

11 of 75 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directions29 Oct
  2. 2025Agentic AI Needs a Systems Theory28 Feb

Other references · 9

  1. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  3. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
  4. 2023How is ChatGPT's behavior changing over time?cited by 265
  5. 2024Agent AI: Surveying the Horizons of Multimodal Interactioncited by 167
  6. 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 165
  7. 2024Uncertainty Quantification for In-Context Learning of Large Language Modelscited by 45
  8. 2022Sensible AI: Re-imagining Interpretability and Explainability using Sensemaking Theorycited by 32
  9. 2025Path Drift in Large Reasoning Models:How First-Person Commitments Override Safetycited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026An Agent Model Abstraction for Human-AI Teaming Cognitive Coupling
  2. 2026When Should an AI Act? A Human-Centered Model of Scene, Context, and Behavior for Agentic AI Design
  3. 2025Adaptive Human-Agent Teaming: A Review of Empirical Studies from the Process Dynamics Perspective
  4. 2026When Multi-Robot Systems Meet Agentic AI:Towards Embodied Collective Intelligence
  5. 2025Agentic AI as Undercover Teammates: Argumentative Knowledge Construction in Hybrid Human-AI Collaborative Learning
  6. 2025Transforming Monolithic Foundation Models into Embodied Multi-Agent Architectures for Human-Robot Collaboration
  7. 2025DoubleAgents: Human-Agent Alignment in a Socially Embedded Workflow
  8. 2026Toward Human-Centered Multi-Agent Systems: Integrating Cognition, Culture, Values, and Cooperation in AI Agents