LabVLA: Grounding Vision-Language-Action Models in Scientific Laboratories
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
Scientific laboratories increasingly rely on AI systems to reason about experiments, but the physical act of doing science remains largely outside their reach. AI can help read literature, generate hypotheses, and plan protocols, yet the execution of those protocols at the bench still requires a human operator. Vision-Language-Action (VLA) models provide one possible interface between written protocols and robot execution, but existing policies are trained mostly on household and tabletop demonstrations and rarely encounter the instruments, transparent liquids, or fixed protocol workflows found in scientific laboratories. Closing this gap requires both laboratory-specific supervision and a unified learning framework that can accommodate the diverse robot embodiments used to execute experimental protocols. We therefore identify data and embodiment as central bottlenecks alongside model design. To address the data side, we build RoboGenesis, a simulation-based workflow and data engine that composes configured laboratory workflows from atomic skills, validates and filters rollouts, and exports structured demonstrations across supported robot profiles. On the policy side, we present LabVLA, trained with a two-stage recipe: FAST action token pretraining first makes the Qwen3-VL-4B-Instruct backbone action aware before any continuous control is learned, and flow matching posttraining then attaches a DiT action expert under knowledge insulation. On the LabUtopia benchmark, LabVLA achieves the highest average success rate among all evaluated baselines under both in-distribution and out-of-distribution settings.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 75 of its 86 references that are in the map. First posted on arXiv 11 Jun 2026.
Builds on
75 of 86 references.
Closest ancestors · 14
Same direction, newest first
- 2026InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulation5 Jan
- 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policy20 Nov
- 2025PixelVLA: Advancing Pixel-level Understanding in Vision-Language-Action Model3 Nov
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model11 Oct
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Better29 May
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation29 Nov
- 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulation19 Sep
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
2 more
Other references · 61
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
38 more
- 2022Galactica: A Large Language Model for Sciencecited by 744
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 523
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2026World Action Models are Zero-shot Policiescited by 465
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 346
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 304
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 270
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
- 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 225
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
- 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 194
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 156
- 2023Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulationcited by 138
- 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 137
- 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulationcited by 133
- 2024Liger Kernel: Efficient Triton Kernels for LLM Trainingcited by 130
- 2020SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulationcited by 121
- 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 117
- 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 106
- 2023GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fieldscited by 99
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026GRAFT: Grounded and Efficient Online Reinforcement Adaptation for Fine-Grained Robot Manipulationcited by 0
- 2026WetRobo: A Reproducible Robot Kit for Coding Agents in Biological Laboratoriescited by 0
- 2026SciHorizon-eLab: An Agentic Protocol-to-Task Compiler for Scalable Benchmarking of Scientific Embodied Agentscited by 0
- 2026SciHorizon-eLab: An Agentic Protocol-to-Task Compiler for Scalable Benchmarking of Scientific Embodied Agents25 Sep 2026
- 2026WetRobo: A Reproducible Robot Kit for Coding Agents in Biological Laboratories16 Sep 2026
- 2026GRAFT: Grounded and Efficient Online Reinforcement Adaptation for Fine-Grained Robot Manipulation27 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026AtomBridge: Agentic VLA Inference Plugin for Long-Horizon Tasks in Scientific Experiments
- 2025AutoBio: A Simulation and Benchmark for Robotic Automation in Digital Biology Laboratory
- 2025RoboChemist: Long-Horizon and Safety-Compliant Robotic Chemical Experimentation
- 2026Long-Term Memory for VLA-based Agents in Open-World Task Execution
- 2026BioProVLA-Agent: An Affordable, Protocol-Driven, Vision-Enhanced VLA-Enabled Embodied Multi-Agent System with Closed-Loop-Capable Reasoning for Biological Laboratory Manipulation
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges
- 2026CAPER: Constrained and Procedural Reasoning for Robotic Scientific Experiments
- 2026SimVLA: A Simple VLA Baseline for Robotic Manipulation