mlsanityData to 14 Oct 2026

State Representation Shapes Long-Horizon Agent Learning and Transfer: An Empirical Study

arXiv 2610.15407 ↗First posted 11 Oct 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

An end-to-end success rate alone cannot distinguish failure to learn an action from failure to apply it as task state changes. We study this distinction in deterministic tool workflows that provide the current artifact state and candidate action recipes. Using 1.7B, 8B, and 27B Qwen models, we compare supervised learning across workflow horizons and cross the state representation used for training with the one used at evaluation. Horizon-matched supervision yields high completion, but an H4-trained 1.7B model transfers poorly to longer workflows under full-state observations. In an H16 crossover, compact-trained 1.7B adapters complete 50/50 held-out tasks in compact view and 0/50 in full view for each of three paired training seeds; full-trained outcomes vary across seeds. A separate 8B adapter pair shows a similar asymmetry. The view dependence also appears in paired-choice tasks where both candidate calls are executable and the correct choice depends on table contents; here, the compact mask does not consult the target action. An explicit relevance cue improves full-view execution but does not close the gap for the tested checkpoint. In a separate 27B ScienceWorld study, compact-state training improves local accuracy under both views, indicating that the transfer pattern depends on the task and observation construction. Together, these experiments identify representation-sensitive transfer as a bottleneck in the controlled workflows, without isolating content reduction from other changes to the observation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 23 references that are in the map. First posted on arXiv 11 Oct 2026.

Builds on

22 of 23 references.

References · 22

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  4. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  5. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  6. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
  7. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  8. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 338
  9. 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
  10. 2024HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Modelcited by 106
  11. 2025Memory as Action: Autonomous Context Curation for Long-Horizon Agentic Taskscited by 66
  12. 2026Towards a Science of AI Agent Reliabilitycited by 65
10 more
  1. 2025The Complexity Trap: Simple Observation Masking Is as Efficient as LLM Summarization for Agent Context Managementcited by 48
  2. 2025How Is LLM Reasoning Distracted by Irrelevant Context? An Analysis Using a Controlled Benchmarkcited by 28
  3. 2025Imitation Learning for Multi-turn LM Agents via On-policy Expert Correctionscited by 19
  4. 2026When Tools Fail: Benchmarking Dynamic Replanning and Anomaly Recovery in LLM Agentscited by 17
  5. 2026CompactionRL: Reinforcement Learning with Context Compaction for Long-Horizon Agentscited by 14
  6. 2026Toward Reliable Context Compression for Long-Horizon Agents: An Empirical Study of Execution Instabilitycited by 10
  7. 2025Hell or High Water: Evaluating Agentic Recovery from External Failurescited by 9
  8. 2026On Training Large Language Models for Long-Horizon Tasks: An Empirical Study of Horizon Lengthcited by 6
  9. 2026The Devil Is in the Interface: Evaluating How Tool Architecture Shapes Coding Agent Behaviorcited by 3
  10. 2026MUDDLE: Measuring Understanding of Documents under Distractor and Length Effectscited by 2

Built on by

Not cited yet.