mlsanityData to 14 Oct 2026

vla.simd: Efficient CPU Inference for Language-Conditioned Manipulation

arXiv 2609.24274 ↗First posted 21 Sep 2026cs.RO cs.AI cs.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

Deploying language-conditioned manipulation without a dedicated GPU requires efficient inference and action chunks that cover the delay between policy queries. We present vla.simd, a CPU inference engine that combines shared SIMD micro-kernels, reusable computation, and target-specific optimization. We relate query latency and execution horizon to action availability under lagged and time-aligned execution, distinguishing action supply from feedback frequency. Across six policies and four CPUs, vla.simd achieves approximately 1.4× median speedup over compiled PyTorch references while preserving fp32 numerical fidelity. We also introduce IMPACT, an ACT-based policy with cached text representations and language-modulated visual features. IMPACT is the only language-conditioned policy in our evaluated set that supplies at least 30 actions/s on the Raspberry Pi 5: after a 90 s thermal soak, it supplies 33.5 actions/s in fp32 and 81.2 with int8. Separate GPU evaluations yield 76.4% mean success across four LIBERO suites without robot pretraining; instruction-shuffling tests demonstrate selection among familiar goals. Trials with IMPACT on an SO-101 arm and SmolVLA on a UR10e with a Robotiq gripper demonstrate CPU deployment on two robot embodiments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 47 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

36 of 47 references.

References · 36

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  6. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  8. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  9. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  10. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  11. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  12. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
24 more
  1. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  2. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  3. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
  4. 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 523
  5. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
  6. 2025Real-Time Execution of Action Chunking Flow Policiescited by 216
  7. 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 169
  8. 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Modelscited by 93
  9. 2024BAKU: An Efficient Transformer for Multi-Task Policy Learningcited by 80
  10. 2026LeRobot: An Open-Source Library for End-to-End Robot Learningcited by 73
  11. 2024Bidirectional Decoding: Improving Action Chunking via Guided Test-Time Samplingcited by 52
  12. 2025BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulationcited by 43
  13. 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
  14. 2026How Fast Can I Run My VLA? Demystifying VLA Inference Performance with VLA-Perfcited by 19
  15. 2023Motions in Microseconds via Vectorized Sampling-Based Planningcited by 17
  16. 2025NanoVLA: Routing Decoupled Vision-Language Understanding for Nano-sized Generalist Robotic Policiescited by 12
  17. 2026TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAMcited by 10
  18. 2025Lite VLA: Efficient Vision-Language-Action Control on CPU-Bound Edge Robotscited by 9
  19. 2026Characterizing Vision-Language-Action Models across XPUs: Constraints and Acceleration for On-Robot Deploymentcited by 7
  20. 2026ExecuTorch -- A Unified PyTorch Solution to Run AI Models On-Devicecited by 5
  21. 2026vla.cpp: A Unified Inference Runtime for Vision-Language-Action Modelscited by 4
  22. 2024Collision-Affording Point Trees: SIMD-Amenable Nearest Neighbors for Fast Collision Checkingcited by 3
  23. 2026Characterizing VLA Models: Identifying the Action Generation Bottleneck for Edge AI Architecturescited by 3
  24. 2026Decoupling Vision, Language, and Action for Efficient Multi-Task Robot Policiescited by 2

Built on by

Not cited yet.