mlsanityData to 7 Oct 2026

RhinoVLA Technical Report

arXiv 2606.07383 ↗First posted 5 Jun 2026cs.RO cs.LGcited by 0

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

Vision-Language-Action (VLA) models have shown strong potential for robotic manipulation, but real-time deployment on edge hardware remains challenging. In this work, we identify VLM visual and context tokens as a major source of deployment latency: for GEMM-dominated projection operators, computation grows linearly with the number of input tokens when model dimensions are fixed. Motivated by this observation, we propose RhinoVLA, a deployment-oriented VLA model co-designed with the Huixi R1 edge SoC. RhinoVLA adopts a token-efficient Qwen3-VL backbone and a continuous Action Expert, reducing the VLM-side token and computation burden while preserving pretrained multimodal capability. To support cross-robot learning, RhinoVLA further introduces a unified interface that combines View Registry, 72D physical state-action slot space, and robotinstance LoRA, allowing heterogeneous robot observations and action schemas to be aligned under a shared policy. On the deployment side, RhinoVLA is optimized through hardware-aware compilation, mixed-precision execution, and parallel visual encoding. Experiments show that RhinoVLA achieves downstream performance comparable to π0.5 at a similar parameter scale, while reaching 11.69 Hz end-to-end inference on Huixi R1, meeting the 10 Hz real-time closedloop control target. The project will be open-sourced at https://github.com/HuixiAI/RhinoVLA.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 38 of its 44 references that are in the map. First posted on arXiv 5 Jun 2026.

Builds on

38 of 44 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026A Pragmatic VLA Foundation Model26 Jan
  2. 2026InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulation5 Jan
  3. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
  4. 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Tasks28 Apr
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
  6. 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Control9 Feb
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
  8. 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
  9. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 29

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2023Visual Instruction Tuningcited by 7,792
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2025Qwen2.5-VL Technical Reportcited by 5,418
  7. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  8. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  9. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  10. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  11. 2025Qwen3-VL Technical Reportcited by 2,534
  12. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
17 more
  1. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  2. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  3. 2019Root Mean Square Layer Normalizationcited by 1,425
  4. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  5. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  6. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  7. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  8. 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 517
  9. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  10. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
  11. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  12. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
  13. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
  14. 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 254
  15. 2024Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learningcited by 153
  16. 2024Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goalscited by 131
  17. 2025Eagle 2: Building Post-Training Data Strategies from Scratch for Frontier Vision-Language Modelscited by 69

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SimVLA: A Simple VLA Baseline for Robotic Manipulation
  2. 2025EdgeVLA: Efficient Vision-Language-Action Models
  3. 2026Efficient Vision-Language-Action Management and Serving for Robot Factories
  4. 2025BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulation
  5. 2026Characterizing Vision-Language-Action Models across XPUs: Constraints and Acceleration for On-Robot Deployment
  6. 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Experts
  7. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
  8. 2025VLA-0: Building State-of-the-Art VLAs with Zero Modification