mlsanityData to 14 Oct 2026

Engagement Process: Rethinking the Temporal Interface of Action and Observation

arXiv 2605.11484 ↗First posted 12 May 2026cs.AIcited by 2

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Task completion in digital and physical environments increasingly involves complex temporal interaction, where actions and observations unfold over different time scales rather than align with fixed observation--action steps. To model such interactions, we propose Engagement Process (EP), an interaction formalism that inherits the decision-theoretic structure of POMDPs while making time explicit in the action--observation interface. EP represents actions and observations as decoupled event streams along time, rather than updates paired at fixed decision steps. This interface captures single-agent timing issues such as deliberation latency, delayed feedback, and persistent actions, while supporting richer agent-side organization, multi-rate coordination, and compositional interaction among subsystems. Across toy, LLM-agent, and learning experiments, EP exposes temporal behaviors hidden by step-based interfaces and enables policies to adapt under explicit time costs.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 25 of its 42 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

25 of 42 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Real-Time Reasoning Agents in Evolving Environments7 Nov

Other references · 24

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  7. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  8. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  9. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  10. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
  11. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 304
  12. 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 138
12 more
  1. 2025Full-Duplex-Bench: A Benchmark to Evaluate Full-duplex Spoken Dialogue Models on Turn-taking Capabilitiescited by 100
  2. 2016Revisiting Active Perceptioncited by 94
  3. 2022A Survey on Active Simultaneous Localization and Mapping: State of the Art and New Frontierscited by 66
  4. 2024Language Model Can Listen While Speakingcited by 63
  5. 2024A Full-duplex Speech Dialogue Scheme Based On Large Language Modelscited by 40
  6. 2025Robotouille: An Asynchronous Planning Benchmark for LLM Agentscited by 32
  7. 2024Asynchronous Tool Usage for Real-Time Agentscited by 13
  8. 2025Handling Delay in Real-Time Reinforcement Learningcited by 7
  9. 2025AViLA: Asynchronous Vision-Language Agent for Streaming Multimodal Data Interactioncited by 6
  10. 2025Reflex First, Reflect Later: Latency-Aware Embodied LLM Agents for Dynamic Responsecited by 4
  11. 2020POMDPs in Continuous Time and Discrete Spacescited by 3
  12. 2026From Static Inference to Dynamic Interaction: A Survey of Streaming Large Language Modelscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026What Do Agents Learn from Trajectory-SFT: Semantics or Interfaces?
  2. 2026Signals: Trajectory Sampling and Triage for Agentic Interactions
  3. 2026Unified Agent: Managing Interactions across Devices
  4. 2025Learning to Wait: Synchronizing Agents with the Physical World
  5. 2026Absorbed in Inertia: Activation Analysis for Computer-Use Agents
  6. 2026Momento: Evaluating Persistent Memory and Reasoning with Multi-Session Agentic Conversations
  7. 2026From State to Action: OODA-Tool for Reliable Multi-Turn Tool Use
  8. 2026When Should an AI Act? A Human-Centered Model of Scene, Context, and Behavior for Agentic AI Design