Rhythms of Work: Multi-Scale Interpretation of Human Behavioral Traces for Workplace Agents
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Runtime traces are becoming a central substrate for understanding agentic systems, yet interpretation has focused largely on what the agent did. Workplace agents face the complementary problem: interpreting the human activity that surrounds them. Hours of low-level events carry rich evidence about a user's state but are too granular to reason over directly, and flattening them into one stream or compressing them into a single embedding both treat "summarize the user's behavior" as if it had one correct answer. We argue instead that behavioral interpretation is resolution-dependent: the same trace should admit multiple addressable interpretations at different temporal resolutions. We construct a multi-resolution vocabulary of semantically normalized operators, recurring motifs, coherent episodes, and day-level rhythms, each preserving the structure salient at its own horizon. Applied to 667 million human-attributed events from a large commercial productivity suite (50,000 users, 100 organizations), it yields 120 operator types, thousands of motifs, 25 episode types, and five day-rhythm archetypes. We validate it on real telemetry: re-running the entire pipeline on a disjoint 2,000-user sample recovers the same taxonomy (structural stability), and on held-out users the full representation forecasts a user's next episode more accurately than a flat-operator baseline, a 17% relative macro-F1 gain (predictive validity), so the abstractions preserve future-relevant information rather than merely describe it. A controlled resolution ablation then shows that no single level is optimal across questions: different agent-facing questions about the same trace are best answered at different resolutions. Behavioral trace interpretation for agents should therefore be multi-resolution and query-conditioned: an agent should access the temporal grain a question needs, not one universal summary.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 16 of its 26 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
16 of 26 references.
Closest ancestors · 4
Same direction, newest first
- 2025OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflows12 Aug
- 2024Proactive Agent: Shifting LLM Agents from Reactive Responses to Active Assistance16 Oct
- 2024OfficeBench: Benchmarking Language Agents across Multiple Applications for Office Automation26 Jul
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
Other references · 12
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 363
- 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 223
- 2016Predictive Business Process Monitoring with LSTM Neural Networkscited by 104
- 2024WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Taskscited by 90
- 2024Evaluating Large Language Models as Generative User Simulators for Conversational Recommendationcited by 48
- 2025ContextAgent: Context-Aware Proactive LLM Agents with Open-World Sensory Perceptionscited by 45
- 2025ProMemAssist: Exploring Timely Proactive Assistance Through Working Memory Modeling in Multi-Modal Wearable Devicescited by 13
- 2026How to Interpret Agent Behaviorcited by 10
- 2026Learning Next Action Predictors from Human-Computer Interactioncited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Workerville: Towards an Organizational Behavior Account of Agent Safety
- 2026AgentHabit: Characterizing Distinct Behaviors of Agents on Everyday Tasks
- 2026Inducing Task Models from Computer-Use Traces
- 2026X-SYNTH: Beyond Retrieval -- Enterprise Context Synthesis from Observed Digital Human Attention
- 2026Same Outcomes, Different Journeys: A Trace-Level Framework for Comparing Human and GUI-Agent Behavior in Production Search Systems
- 2026Beyond the Click: A Framework for Inferring Cognitive Traces in Search
- 2026The atomic structure of work: a micro-action instrument reveals two-pole AI occupational exposure and its decade-scale polar inversion ↗
- 2026When Should an AI Act? A Human-Centered Model of Scene, Context, and Behavior for Agentic AI Design