mlsanityData to 14 Oct 2026

LabVLA: Grounding Vision-Language-Action Models in Scientific Laboratories

arXiv 2606.13578 ↗First posted 11 Jun 2026cs.CL cs.AI cs.LGcited by 3

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

Scientific laboratories increasingly rely on AI systems to reason about experiments, but the physical act of doing science remains largely outside their reach. AI can help read literature, generate hypotheses, and plan protocols, yet the execution of those protocols at the bench still requires a human operator. Vision-Language-Action (VLA) models provide one possible interface between written protocols and robot execution, but existing policies are trained mostly on household and tabletop demonstrations and rarely encounter the instruments, transparent liquids, or fixed protocol workflows found in scientific laboratories. Closing this gap requires both laboratory-specific supervision and a unified learning framework that can accommodate the diverse robot embodiments used to execute experimental protocols. We therefore identify data and embodiment as central bottlenecks alongside model design. To address the data side, we build RoboGenesis, a simulation-based workflow and data engine that composes configured laboratory workflows from atomic skills, validates and filters rollouts, and exports structured demonstrations across supported robot profiles. On the policy side, we present LabVLA, trained with a two-stage recipe: FAST action token pretraining first makes the Qwen3-VL-4B-Instruct backbone action aware before any continuous control is learned, and flow matching posttraining then attaches a DiT action expert under knowledge insulation. On the LabUtopia benchmark, LabVLA achieves the highest average success rate among all evaluated baselines under both in-distribution and out-of-distribution settings.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 75 of its 86 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

75 of 86 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulation5 Jan
  2. 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policy20 Nov
  3. 2025PixelVLA: Advancing Pixel-level Understanding in Vision-Language-Action Model3 Nov
  4. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model11 Oct
  5. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
  6. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Better29 May
  7. 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
  8. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
  9. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation29 Nov
  10. 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
  11. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulation19 Sep
  12. 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
2 more
  1. 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulation6 Jun
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 61

  1. 2022Scalable Diffusion Models with Transformerscited by 6,054
  2. 2022Flow Matching for Generative Modelingcited by 5,702
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  6. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  7. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  8. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
  9. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  10. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  11. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  12. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
38 more
  1. 2022Galactica: A Large Language Model for Sciencecited by 744
  2. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  3. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
  4. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  5. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
  6. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
  7. 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
  8. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
  9. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
  10. 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 523
  11. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  12. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  13. 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
  14. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
  15. 2026World Action Models are Zero-shot Policiescited by 465
  16. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  17. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
  18. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
  19. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  20. 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 346
  21. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327
  22. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 304
  23. 2019RoboNet: Large-Scale Multi-Robot Learningcited by 270
  24. 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
  25. 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 225
  26. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
  27. 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 194
  28. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
  29. 2025Native and Compact Structured Latents for 3D Generationcited by 175
  30. 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 156
  31. 2023Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulationcited by 138
  32. 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 137
  33. 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulationcited by 133
  34. 2024Liger Kernel: Efficient Triton Kernels for LLM Trainingcited by 130
  35. 2020SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulationcited by 121
  36. 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 117
  37. 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 106
  38. 2023GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fieldscited by 99

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AtomBridge: Agentic VLA Inference Plugin for Long-Horizon Tasks in Scientific Experiments
  2. 2025AutoBio: A Simulation and Benchmark for Robotic Automation in Digital Biology Laboratory
  3. 2025RoboChemist: Long-Horizon and Safety-Compliant Robotic Chemical Experimentation
  4. 2026Long-Term Memory for VLA-based Agents in Open-World Task Execution
  5. 2026BioProVLA-Agent: An Affordable, Protocol-Driven, Vision-Enhanced VLA-Enabled Embodied Multi-Agent System with Closed-Loop-Capable Reasoning for Biological Laboratory Manipulation
  6. 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges
  7. 2026CAPER: Constrained and Procedural Reasoning for Robotic Scientific Experiments
  8. 2026SimVLA: A Simple VLA Baseline for Robotic Manipulation