LiLo-VLA: Compositional Long-Horizon Manipulation via Linked Object-Centric Policies
Not on the map. Why?
Abstract (arXiv)
General-purpose robots must master long-horizon manipulation, defined as tasks involving multiple kinematic structure changes (e.g., attaching or detaching objects) in unstructured environments. While Vision-Language-Action (VLA) models offer the potential to master diverse atomic skills, they struggle with the combinatorial complexity of sequencing them and are prone to cascading failures due to environmental sensitivity. To address these challenges, we propose LiLo-VLA (Linked Local VLA), a modular framework capable of zero-shot generalization to novel long-horizon tasks without ever being trained on them. Our approach decouples transport from interaction: a Reaching Module handles global motion, while an Interaction Module employs an object-centric VLA to process isolated objects of interest, ensuring robustness against irrelevant visual features and invariance to spatial configurations. Crucially, this modularity facilitates robust failure recovery through dynamic replanning and skill reuse, effectively mitigating the cascading errors common in end-to-end approaches. We introduce a 21-task simulation benchmark consisting of two challenging suites: LIBERO-Long++ and Ultra-Long. In these simulations, LiLo-VLA achieves a 69% average success rate, outperforming Pi0.5 by 41% and OpenVLA-OFT by 67%. Furthermore, real-world evaluations across 8 long-horizon tasks demonstrate an average success rate of 85%. Project page: https://yy-gx.github.io/LiLo-VLA/.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 35 of its 41 references that are in the map. First posted on arXiv 25 Feb 2026.
Builds on
35 of 41 references.
References · 35
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2017Random Erasing Data Augmentationcited by 1,239
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
23 more
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2020Integrated Task and Motion Planningcited by 290
- 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 224
- 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 175
- 2020Toward the Fundamental Limits of Imitation Learningcited by 96
- 2023Generative Skill Chaining: Long-Horizon Skill Planning with Diffusion Modelscited by 91
- 2023DoReMi: Grounding Language Model by Detecting and Recovering from Plan-Execution Misalignmentcited by 61
- 2021Learning Symbolic Operators for Task and Motion Planningcited by 58
- 2022Learning Neuro-Symbolic Skills for Bilevel Planningcited by 58
- 2024Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Taskscited by 52
- 2025Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulationcited by 48
- 2025Reflective Planning: Vision-Language Models for Multi-Stage Long-Horizon Robotic Manipulationcited by 42
- 2022LEAGUE: Guided Skill Learning and Abstraction for Long-Horizon Manipulationcited by 34
- 2023Human-in-the-Loop Task and Motion Planning for Imitation Learningcited by 29
- 2024Local Policies Enable Zero-shot Long-horizon Manipulationcited by 22
- 2021Search-Based Task Planning with Learned Skill Effect Models for Lifelong Robotic Manipulationcited by 20
- 2025Seeing to Act, Prompting to Specify: A Bayesian Factorization of Vision Language Action Policycited by 18
- 2023NOD-TAMP: Generalizable Long-Horizon Planning with Neural Object Descriptorscited by 8
- 2025BOSS: Benchmark for Observation Space Shift in Long-Horizon Taskcited by 7
Built on by
Citing papers per year: 2026: 14.
14 papers.
Sort:
By area:
- 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulationcited by 28
- 2026Towards Long-horizon Embodied Agents with Tool-Aligned Vision-Language-Action Modelscited by 9
- 2026μVLA: On Recurrent Memory for Partially Observable Manipulation in VLA Modelscited by 8
- 2026AEGIS: A Backup Reflex for Physical AIcited by 3
- 2026Unleashing More Actions via Action Compositional Training for VLA Modelscited by 3
- 2026Safe Embodied AI for Long-horizon Tasks: A Cross-layer Analysis of Robotic Manipulationcited by 1
- 2026Analytic Concept-Centric Memory for Agentic Embodied Manipulationcited by 1
- 2026FurnitureVLA: Learning Long-Horizon Bimanual Furniture Assembly with Vision-Language-Action Modelcited by 1
- 2026SkipVLA: Skipping VLA Steps with Classical Planning for Fast Robot Manipulationcited by 1
- 2026Sensing Which Modality Matters: Evidence-Gated Regularization for Robust VLA Policiescited by 0
- 2026From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluationcited by 0
- 2026Correcting WHERE, Preserving HOW: Compositional Generalization for Vision-Language-Action Models via Referential Guidancecited by 0
- 2026DexStitch: Learning and Composing Dexterous Skills from Human Videos via Contact-Aware Robotic Inpainting13 Oct 2026
- 2026LIBERO-Agent: Evaluating General-Purpose Agents for Direct Embodied Manipulation30 Sep 2026
- 2026Correcting WHERE, Preserving HOW: Compositional Generalization for Vision-Language-Action Models via Referential Guidance29 Sep 2026
- 2026SkipVLA: Skipping VLA Steps with Classical Planning for Fast Robot Manipulation17 Sep 2026
- 2026From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluation16 Sep 2026
- 2026Sensing Which Modality Matters: Evidence-Gated Regularization for Robust VLA Policies2 Sep 2026
- 2026FurnitureVLA: Learning Long-Horizon Bimanual Furniture Assembly with Vision-Language-Action Model1 Jul 2026
- 2026Unleashing More Actions via Action Compositional Training for VLA Models1 Jul 2026
- 2026Analytic Concept-Centric Memory for Agentic Embodied Manipulation29 Jun 2026
- 2026μVLA: On Recurrent Memory for Partially Observable Manipulation in VLA Models10 Jun 2026
- 2026AEGIS: A Backup Reflex for Physical AI4 Jun 2026
- 2026Safe Embodied AI for Long-horizon Tasks: A Cross-layer Analysis of Robotic Manipulation4 Jun 2026
- 2026Towards Long-horizon Embodied Agents with Tool-Aligned Vision-Language-Action Modelscited by 9
- 2026μVLA: On Recurrent Memory for Partially Observable Manipulation in VLA Modelscited by 8
- 2026Unleashing More Actions via Action Compositional Training for VLA Modelscited by 3
- 2026FurnitureVLA: Learning Long-Horizon Bimanual Furniture Assembly with Vision-Language-Action Modelcited by 1
- 2026SkipVLA: Skipping VLA Steps with Classical Planning for Fast Robot Manipulationcited by 1
- 2026Sensing Which Modality Matters: Evidence-Gated Regularization for Robust VLA Policiescited by 0
- 2026Correcting WHERE, Preserving HOW: Compositional Generalization for Vision-Language-Action Models via Referential Guidancecited by 0
- 2026Correcting WHERE, Preserving HOW: Compositional Generalization for Vision-Language-Action Models via Referential Guidance29 Sep 2026
- 2026SkipVLA: Skipping VLA Steps with Classical Planning for Fast Robot Manipulation17 Sep 2026
- 2026Sensing Which Modality Matters: Evidence-Gated Regularization for Robust VLA Policies2 Sep 2026
- 2026FurnitureVLA: Learning Long-Horizon Bimanual Furniture Assembly with Vision-Language-Action Model1 Jul 2026
- 2026Unleashing More Actions via Action Compositional Training for VLA Models1 Jul 2026
- 2026μVLA: On Recurrent Memory for Partially Observable Manipulation in VLA Models10 Jun 2026
- 2026Towards Long-horizon Embodied Agents with Tool-Aligned Vision-Language-Action Models13 May 2026
- 2026AEGIS: A Backup Reflex for Physical AIcited by 3
- 2026Safe Embodied AI for Long-horizon Tasks: A Cross-layer Analysis of Robotic Manipulationcited by 1
- 2026From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluationcited by 0
- 2026DexStitch: Learning and Composing Dexterous Skills from Human Videos via Contact-Aware Robotic Inpaintingcited by 0
- 2026DexStitch: Learning and Composing Dexterous Skills from Human Videos via Contact-Aware Robotic Inpainting13 Oct 2026
- 2026From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluation16 Sep 2026
- 2026AEGIS: A Backup Reflex for Physical AI4 Jun 2026
- 2026Safe Embodied AI for Long-horizon Tasks: A Cross-layer Analysis of Robotic Manipulation4 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026GloVLA: Let Geometry Move and Local VLA Interact for Robust Object-Centric Manipulation in Unstructured Environments
- 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models
- 2026Towards Generalizable Robotic Manipulation in Dynamic Environments
- 2025REALM: A Real-to-Sim Validated Benchmark for Generalization in Robotic Manipulation
- 2026Veo-Act: Enhancing VLA Policies with Frontier Video Models
- 2025LoLA: Long Horizon Latent Action Learning for General Robot Manipulation
- 2026Scaling World Model for Hierarchical Manipulation Policies
- 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policies