LIBERO-Industry: Benchmarking Robotic Manipulation under Industrial Process Constraints
New in Vision-language-action models; no direction yet. Vision-language-action models
Abstract (arXiv)
Industrial manipulation in flexible manufacturing, e.g., high-mix, low-volume (HMLV) electronics assembly, requires robot policies to adapt to changing products and production conditions. Such settings impose industrial process constraints, including product variants, moving material flows, finite execution windows, and tight geometric tolerances. However, existing evaluation frameworks do not systematically capture these constraints when assessing generalist robot policies. To address this gap, we introduce LIBERO-Industry, a novel benchmark built on the widely used robot learning benchmark LIBERO, that translates the aforementioned industrial constraints into controllable task conditions and measurable success criteria. Specifically, LIBERO-Industry comprises three classic task scenarios: Static-to-Dynamic (S2D) loading, Dynamic-to-Static (D2S) unloading, and Dynamic-to-Dynamic (D2D) transfer. The suites contain 216 tasks in total that systematically vary object geometry, conveyor speed, interaction-window duration, and geometric acceptance region size. Extensive experiments across five generalist robot policies (including vision-language-action models and world-action models) show that performance progressively degrades as industrial constraints are introduced and combined. Under a shared fine-tuning and evaluation protocol, the LIBERO-Industry co-training condition achieved higher observed target-transfer completion than the original-LIBERO condition.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 46 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
29 of 46 references.
References · 29
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
17 more
- 2026World Action Models are Zero-shot Policiescited by 465
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 349
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
- 2020Integrated Task and Motion Planningcited by 290
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 179
- 2025FLARE: Robot Learning with Implicit World Modelingcited by 113
- 2026DynamicVLA: A Vision-Language-Action Model for Dynamic Object Manipulationcited by 34
- 2025VLA-Arena: An Open-Source Framework for Benchmarking Vision-Language-Action Modelscited by 31
- 2026LIBERO-X: Robustness Litmus for Vision-Language-Action Modelscited by 22
- 2026Towards Generalizable Robotic Manipulation in Dynamic Environmentscited by 20
- 2023Towards Building AI-CPS with NVIDIA Isaac Sim: An Industrial Benchmark and Case Study for Robotics Manipulationcited by 11
- 2021Provably Constant-time Planning and Replanning for Real-time Grasping Objects off a Conveyor Beltcited by 8
- 2025Transferring Vision-Language-Action Models to Industry Applications: Architectures, Performance, and Challengescited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LIBERO-RECOVER: Beyond Task Success Towards Failure Recovery in Robotic Manipulation Models
- 2026LIBERO-Agent: Evaluating General-Purpose Agents for Direct Embodied Manipulation
- 2026Cortex 2.0: Grounding World Models in Real-World Industrial Deployment
- 2026MINERVA: How Small Can a Manipulation Policy Be and Still Solve LIBERO?
- 2026WireCraft: A Simulation Benchmark for Industrial DLO Manipulation
- 2026Industrial Dexterity Benchmark: A Hardware-Software Benchmarking Platform for Industrial Dexterous Manipulation ↗
- 2026LIBERO-MAX: Do Robot Policies Adapt When the World Changes?
- 2026IndustrialVLA-Bench: A Traceable Multi-Axis Evaluation of Open Robot Policy Models