mlsanityData to 14 Oct 2026

LADDER: A Long-Horizon Robot Manipulation Benchmark

arXiv 2610.18053 ↗First posted 13 Oct 2026cs.RO cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

General-purpose robot manipulation policies learn short-horizon skills effectively, but degrade rapidly on long-horizon tasks. Existing benchmarks cannot isolate failures because task horizon is either too short or entangled with scene and object variations. We propose LADDER, a long-horizon robot manipulation benchmark scaling from 1 to 10 subgoals within the same environment over three suites (SimplerEnv-Long, RobotArena-∞-Long, and RoboLab-Long), 145 tasks, eight categories, two embodiments, and 2,024 simulated episodes per system. We evaluate two orchestration paradigms: text subgoals for learned low-level policies (VoLo) and tool selection orchestration (CaP-X, GPT-Policy, PSP-Agent, TiPToP). Given the full instruction directly, low-level policies achieve 85.4% on single-subgoal tasks, but drop to near zero on extended tasks. While orchestration remedies this, it remains bounded by physical execution errors of the low-level policy rather than high-level planning and achieves only ~25%. Tool selection orchestration with GPT-Policy on GPT-6 Astra significantly outperforms learned-policy methods, but incurs significant time and cost budget and succeeds only ~62%. Real-world experiments across two embodiments confirm the collapse of the low-level policy and the gain from orchestration. Project website: https://ladder.insait.ai

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 27 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

22 of 27 references.

References · 22

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  2. 2025Qwen3-VL Technical Reportcited by 2,793
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  4. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  6. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  7. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  8. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  9. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
  10. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
  11. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
  12. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
10 more
  1. 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 221
  2. 2024RT-H: Action Hierarchies Using Languagecited by 210
  3. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
  4. 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 130
  5. 2026CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulationcited by 88
  6. 2026RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policiescited by 24
  7. 2025RobotArena ∞: Scalable Robot Benchmarking via Real-to-Sim Translationcited by 18
  8. 2026VoLo: A Physical Orchestrator for Open-Vocabulary Long-Horizon Manipulationcited by 11
  9. 2026TiPToP: A Modular Open-Vocabulary Robot Manipulation System That Planscited by 8
  10. 2026In-Context Robot Learning with VLM Agentscited by 8

Built on by

Not cited yet.