mlsanityData to 14 Oct 2026

Interlock: From Local Correctness to Task Completion in Long-Horizon Agents

arXiv 2610.19686 ↗First posted 14 Oct 2026cs.CL cs.AIcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks also fits: Agent skill learning and evolution

Abstract (arXiv)

Large language model agents increasingly undertake long-horizon tasks in complex environments characterized by fragmented evidence, partially completed states, and dependencies across resources and artifacts. Existing agents may satisfy individual requirements while failing to maintain these relationships, producing locally correct but incomplete outcomes. These failures arise because task completion depends on relationships among environmental evidence, consequential decisions, and required effects. To address this completion gap, we propose Interlock, a framework for task synthesis that represents each task as a typed completion graph. Grounding edges connect public evidence to decisions, coupling hyperedges impose joint constraints across components, and realization edges connect decisions to all required downstream effects. Interlock compiles this graph into a resettable workspace, a public request, and an evaluation rubric. A source-coverage review checks whether the original requirements survive generation, while a public-input review checks whether the rubric is supported by the materials available to the solver. An agent-as-judge inspects execution artifacts and runs verification scripts, retaining trajectories judged to satisfy all mandatory requirements. To evaluate training utility, we fine-tune two Qwen3.6 backbones on their own accepted trajectories. Across the two backbones, training improves AutomationBench task pass rates by 4.00-4.50 percentage points, JobBench weighted scores by 3.20-6.64 points, and Harvey LAB criterion pass rates by 3.89-4.16 percentage points. These results demonstrate the training utility of the synthesized experience across external task environments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 33 of its 38 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

33 of 38 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026ClawGym: A Scalable Framework for Building Effective Claw Agents29 Apr
  2. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence20 Apr
  3. 2025AgentSynth: Scalable Task Generation for Generalist Computer-Use Agents17 Jun
  4. 2025TaskCraft: Automated Generation of Agentic Tasks11 Jun
  5. 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplay4 Apr
  6. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks18 Dec
  7. 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generation1 Aug

Other references · 26

  1. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  2. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  3. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  4. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  5. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  6. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
  7. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 401
  8. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 393
  9. 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 295
  10. 2024ToolACE: Winning the Points of LLM Function Callingcited by 216
  11. 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 198
  12. 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesiscited by 163
14 more
  1. 2024WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Taskscited by 90
  2. 2025Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agentscited by 72
  3. 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
  4. 2026Endless Terminals: Scaling RL Environments for Terminal Agentscited by 54
  5. 2024Facilitating Multi-turn Function Calling for LLMs via Compositional Instruction Tuningcited by 42
  6. 2026ScaleEnv: Scaling Environment Synthesis from Scratch for Generalist Interactive Tool-Use Agent Trainingcited by 32
  7. 2026Long-Horizon-Terminal-Bench: Testing the Limits of Agents on Long-Horizon Terminal Tasks with Dense Reward-Based Gradingcited by 31
  8. 2024ToolFlow: Boosting LLM Tool-Calling Through Natural and Coherent Dialogue Synthesiscited by 30
  9. 2026Toward Scalable Terminal Task Synthesis via Skill Graphscited by 22
  10. 2026Recursive Synthesis for Long-Horizon Terminal Taskscited by 19
  11. 2025AutoForge: Automated Environment Synthesis for Agentic Reinforcement Learningcited by 17
  12. 2026EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RLcited by 14
  13. 2026Anchor: Mitigating Artifact Drift in Agent Benchmark Generationcited by 5
  14. 2026CodeMidas: Scaling Agentic Coding RL Environments from Code Itselfcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AM-Bench: Understanding Agents under Task Underspecification across Models and Harnesses
  2. 2026StructAgent: Harness Long-horizon Digital Agents with Unified Causal Structure
  3. 2026The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agents
  4. 2026AutoRefine: Compiling Trajectories into Validated Typed Agent Artifacts
  5. 2026SKILL.state: Scalable Long-Horizon Agent Skills
  6. 2026The Long-Horizon Task Mirage? Diagnosing Where and Why Agentic Systems Break
  7. 2026Staying on Task: Testing the Foundations of Long-Horizon Agent Reliability
  8. 2026SkillHorizon: Constructing Long-Horizon Agent Tasks through Skill Composition