AutoBio: A Simulation and Benchmark for Robotic Automation in Digital Biology Laboratory
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
Vision-language-action (VLA) models have shown promise as generalist robotic policies by jointly leveraging visual, linguistic, and proprioceptive modalities to generate action trajectories. While recent benchmarks have advanced VLA research in domestic tasks, professional science-oriented domains remain underexplored. We introduce AutoBio, a simulation framework and benchmark designed to evaluate robotic automation in biology laboratory environments--an application domain that combines structured protocols with demanding precision and multimodal interaction. AutoBio extends existing simulation capabilities through a pipeline for digitizing real-world laboratory instruments, specialized physics plugins for mechanisms ubiquitous in laboratory workflows, and a rendering stack that support dynamic instrument interfaces and transparent materials through physically based rendering. Our benchmark comprises biologically grounded tasks spanning three difficulty levels, enabling standardized evaluation of language-guided robotic manipulation in experimental protocols. We provide infrastructure for demonstration generation and seamless integration with VLA models. Baseline evaluations with two SOTA VLA models reveal significant gaps in precision manipulation, visual reasoning, and instruction following in scientific workflows. By releasing AutoBio, we aim to catalyze research on generalist robotic systems for complex, high-precision, and multimodal professional environments. The simulator and benchmark are publicly available to facilitate reproducible research.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 13 of its 23 references that are in the map. First posted on arXiv 20 May 2025.
Builds on
13 of 23 references.
Closest ancestors · 4
Same direction, newest first
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
- 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 9
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 280
- 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 117
- 2022Factory: Fast Contact for Robotic Assemblycited by 49
- 2024Chemistry3D: Robotic Interaction Benchmark for Chemistry Experimentscited by 8
Built on by
Citing papers per year: 2025: 2; 2026: 10.
12 papers.
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2025WorldEval: World Model as Real-World Robot Policies Evaluatorcited by 64
- 2026RMBench: Memory-Dependent Robotic Manipulation Benchmark with Insights into Policy Designcited by 40
- 2026RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policiescited by 35
- 2026SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Taskscited by 6
- 2026Pipette: An Embodied Simulation Platform, Benchmark, and Data-Efficient Augmentation Framework for Wet-Lab Roboticscited by 3
- 2026AtomBridge: Agentic VLA Inference Plugin for Long-Horizon Tasks in Scientific Experimentscited by 2
- 2026ProtoAct: Turning Wet-Lab Protocols into Embodied Robotic Actionscited by 1
- 2026LabRobFail: A Benchmark for Robotic Failure Analysis in Chemical Self-driving Laboratorycited by 0
- 2026Towards Trustworthy Embodied Intelligence: A Systems Framework and Graded Trustworthiness Levelscited by 0
- 2026GRAFT: Grounded and Efficient Online Reinforcement Adaptation for Fine-Grained Robot Manipulationcited by 0
- 2026WetRobo: A Reproducible Robot Kit for Coding Agents in Biological Laboratoriescited by 0
- 2026WetRobo: A Reproducible Robot Kit for Coding Agents in Biological Laboratories16 Sep 2026
- 2026GRAFT: Grounded and Efficient Online Reinforcement Adaptation for Fine-Grained Robot Manipulation27 Aug 2026
- 2026ProtoAct: Turning Wet-Lab Protocols into Embodied Robotic Actions3 Aug 2026
- 2026Towards Trustworthy Embodied Intelligence: A Systems Framework and Graded Trustworthiness Levels28 Jul 2026
- 2026LabRobFail: A Benchmark for Robotic Failure Analysis in Chemical Self-driving Laboratory26 Jul 2026
- 2026RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policies5 Jul 2026
- 2026Pipette: An Embodied Simulation Platform, Benchmark, and Data-Efficient Augmentation Framework for Wet-Lab Robotics11 Jun 2026
- 2026SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Tasks8 Jun 2026
- 2026RMBench: Memory-Dependent Robotic Manipulation Benchmark with Insights into Policy Design1 Mar 2026
- 2026AtomBridge: Agentic VLA Inference Plugin for Long-Horizon Tasks in Scientific Experiments10 Feb 2026
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation22 Jun 2025
- 2025WorldEval: World Model as Real-World Robot Policies Evaluator25 May 2025
Similar, not cited
Close in wording, no citation either way
- 2026LabVLA: Grounding Vision-Language-Action Models in Scientific Laboratories
- 2026BioProVLA-Agent: An Affordable, Protocol-Driven, Vision-Enhanced VLA-Enabled Embodied Multi-Agent System with Closed-Loop-Capable Reasoning for Biological Laboratory Manipulation
- 2025BioMARS: A Multi-Agent Robotic System for Autonomous Biological Experiments
- 2025REALM: A Real-to-Sim Validated Benchmark for Generalization in Robotic Manipulation
- 2025VLMgineer: Vision Language Models as Robotic Toolsmiths
- 2024LADEV: A Language-Driven Testing and Evaluation Platform for Vision-Language-Action Models in Robotic Manipulation
- 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review
- 2026VLA-REPLICA: A Low-Cost, Reproducible Benchmark for Real-World Evaluation of Vision-Language-Action Models