BioProVLA-Agent: An Affordable, Protocol-Driven, Vision-Enhanced VLA-Enabled Embodied Multi-Agent System with Closed-Loop-Capable Reasoning for Biological Laboratory Manipulation
On the map: LLM reasoning → Spatial and embodied reasoning
also in 1 more
Abstract (arXiv)
Biological laboratory automation can reduce repetitive manual work and improve reproducibility, but reliable embodied execution in wet-lab environments remains challenging. Protocols are often unstructured, labware is frequently transparent or reflective, and multi-step procedures require state-aware execution beyond one-shot instruction following. Existing robotic systems often rely on costly hardware, fixed workflows, dedicated instruments, or robotics-oriented interfaces. Here, we introduce BioProVLA-Agent, an affordable, protocol-driven, vision-enhanced embodied multi-agent system enabled by Vision-Language-Action (VLA) models for biological manipulation. The system uses protocols as the task interface and integrates protocol parsing, visual state verification, and embodied execution in a closed-loop workflow. A Tailored LLM Protocol Agent converts protocols into verifiable subtasks; a VLM-RAG Verification Agent assesses readiness and completion using observations, robot states, retrieved knowledge, and success/failure examples; and a VLA Embodied Agent executes verified subtasks through a lightweight policy. To improve robustness under wet-lab visual perturbations, we develop AugSmolVLA, an online augmentation strategy targeting transparent labware, reflections, illumination shifts, and overexposure. We evaluate the system on a hierarchical benchmark covering 15 atomic tasks, 6 composite workflows, and 3 bimanual tasks, including tube loading, sorting, waste disposal, cap twisting, and liquid pouring. Across normal and high-exposure settings, AugSmolVLA improves execution stability over ACT, X-VLA, and the original SmolVLA, especially for precise placement, transparent-object manipulation, composite workflows, and visually degraded scenes. These results suggest a practical route toward accessible, protocol-centered, and verification-capable embodied AI for biological manipulation.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 20 of its 36 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
20 of 36 references.
Closest ancestors · 2
Same direction, newest first
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation3 Sep
- 2023RoboVQA: Multimodal Long-Horizon Reasoning for Robotics1 Nov
Other references · 18
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2023ChatGPT for Robotics: Design Principles and Model Abilitiescited by 296
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 175
6 more
- 2023GenAug: Retargeting behaviors to unseen situations via Generative Augmentationcited by 103
- 2023BioPlanner: Automatic Evaluation of LLMs on Protocol Planning in Biologycited by 42
- 2024Semantically Controllable Augmentations for Generalizable Robot Learningcited by 17
- 2025RoboChemist: Long-Horizon and Safety-Compliant Robotic Chemical Experimentationcited by 9
- 2024DABI: Evaluation of Data Augmentation Methods Using Downsampling in Bilateral Control-Based Imitation Learning with Imagescited by 7
- 2024ProtoMed-LLM: An Automatic Evaluation Framework for Large Language Models in Medical Protocol Formulationcited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025AutoBio: A Simulation and Benchmark for Robotic Automation in Digital Biology Laboratory
- 2026LabVLA: Grounding Vision-Language-Action Models in Scientific Laboratories
- 2026AtomBridge: Agentic VLA Inference Plugin for Long-Horizon Tasks in Scientific Experiments
- 2025BioMARS: A Multi-Agent Robotic System for Autonomous Biological Experiments
- 2026EmbodiedSkills: A Unified Framework for Orchestrating, Training, and Deploying VLA Agents
- 2026SciHorizon-eLab: An Agentic Protocol-to-Task Compiler for Scalable Benchmarking of Scientific Embodied Agents
- 2025PhysiAgent: An Embodied Agent Framework in Physical World
- 2026Long-Term Memory for VLA-based Agents in Open-World Task Execution