VOTE: Vision-Language-Action Optimization with Trajectory Ensemble Voting
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
Recent large-scale Vision Language Action (VLA) models have shown superior performance in robotic manipulation tasks guided by natural language. However, current VLA models suffer from two drawbacks: (i) generation of massive tokens leading to high inference latency and increased training cost, and (ii) insufficient utilization of generated actions resulting in potential performance loss. To address these issues, we develop a training framework to finetune VLA models for generating significantly fewer action tokens with high parallelism, effectively reducing inference latency and training cost. Furthermore, we introduce an inference optimization technique with a novel voting-based ensemble strategy to combine current and previous action predictions, improving the utilization of generated actions and overall performance. Our results demonstrate that we achieve superior performance compared with state-of-the-art VLA models, achieving significantly higher success rates and 39× faster inference than OpenVLA with 46 Hz throughput on edge platforms, demonstrating practical deployability. The code is available at https://github.com/LukeLIN-web/VOTE.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 42 of its 52 references that are in the map. First posted on arXiv 7 Jul 2025.
Builds on
42 of 52 references.
Closest ancestors · 8
Same direction, newest first
- 2025OTTER: A Vision-Language-Action Model with Text-Aware Visual Feature Extraction5 Mar
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulation8 Feb
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation29 Nov
- 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulation19 Sep
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 34
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
22 more
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 304
- 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 255
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 221
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 183
- 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 117
- 2025Efficient Reasoning with Hidden Thinkingcited by 75
- 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformerscited by 37
- 2024From LLMs to Actions: Latent Codes as Bridges in Hierarchical Robot Controlcited by 35
- 2024Exploring Token Pruning in Vision State Space Modelscited by 28
- 2024Numerical Pruning for Efficient Autoregressive Modelscited by 25
- 2025DraftAttention: Fast Video Diffusion via Low-Resolution Attention Guidancecited by 22
- 2024Pruning Foundation Models for High Accuracy without Retrainingcited by 20
- 2025ObjectVLA: End-to-End Open-World Object Manipulation Without Demonstrationcited by 20
- 2024Rethinking Token Reduction for State Space Modelscited by 15
- 2024Search for Efficient Large Language Modelscited by 14
- 2024Fast and Memory-Efficient Video Diffusion Using Streamlined Inferencecited by 14
- 2025FastCar: Cache Attentive Replay for Fast Auto-Regressive Video Generation on the Edgecited by 10
- 2025QuartDepth: Post-Training Quantization for Real-Time Depth Estimation on the Edgecited by 8
- 2025ALTER: All-in-One Layer Pruning and Temporal Expert Routing for Efficient Diffusion Generationcited by 4
Built on by
Citing papers per year: 2025: 6; 2026: 16.
22 papers.
Sort:
By area:
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 49
- 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Surveycited by 26
- 2026A Systematic Study of Data Modalities and Strategies for Co-training Large Behavior Models for Robot Manipulationcited by 22
- 2026Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Modelscited by 22
- 2026Flash-WAM: Modality-Aware Distillation for World Action Modelscited by 19
- 2025I-FailSense: Towards General Robotic Failure Detection with Vision-Language Modelscited by 12
- 2026Self-Evolving Embodied Agents via Skill-Harness Evolutioncited by 12
- 2026ROCKET: Residual-Oriented Multi-Layer Alignment for Spatially-Aware Vision-Language-Action Modelscited by 11
- 2025Cross-Platform Scaling of Vision-Language-Action Models from Edge to Cloud GPUscited by 8
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulationcited by 6
10 more
- 2026PhyWorld: Physics-Faithful World Model for Video Generationcited by 6
- 2026Human Cognition in Machines: A Unified Perspective of World Modelscited by 5
- 2026Dual Latent Memory in Vision-Language-Action Models for Robotic Manipulationcited by 4
- 2026QuoVLA: Quotient Space for Vision-Language-Action Modelscited by 2
- 2026AnchorRefine: Synergy-Manipulation Based on Trajectory Anchor and Residual Refinement for Vision-Language-Action Modelscited by 1
- 2026Hydra: Phase-Aware Workload Characterization of LLM Inference across Edge SoC Generations, Backends, and Quantization Levelscited by 1
- 2026Mechanistic Interpretability of Structure-Aware Numerical Reasoning in LLaMA 3.1 8Bcited by 0
- 2026From Retrieved Context to Runtime Control: Adaptive Compression for Edge-based RAGcited by 0
- 2026Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edgecited by 0
- 2026LEAP: Learned Block-wise Evidence Retrieval for Long Audio-Video Perceptioncited by 0
- 2026LEAP: Learned Block-wise Evidence Retrieval for Long Audio-Video Perception30 Sep 2026
- 2026Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge29 Aug 2026
- 2026Hydra: Phase-Aware Workload Characterization of LLM Inference across Edge SoC Generations, Backends, and Quantization Levels25 Aug 2026
- 2026From Retrieved Context to Runtime Control: Adaptive Compression for Edge-based RAG20 Aug 2026
- 2026Mechanistic Interpretability of Structure-Aware Numerical Reasoning in LLaMA 3.1 8B19 Aug 2026
- 2026Self-Evolving Embodied Agents via Skill-Harness Evolution11 Aug 2026
- 2026Dual Latent Memory in Vision-Language-Action Models for Robotic Manipulation8 Jul 2026
- 2026Flash-WAM: Modality-Aware Distillation for World Action Models3 Jun 2026
- 2026QuoVLA: Quotient Space for Vision-Language-Action Models24 May 2026
- 2026PhyWorld: Physics-Faithful World Model for Video Generation19 May 2026
- 2026AnchorRefine: Synergy-Manipulation Based on Trajectory Anchor and Residual Refinement for Vision-Language-Action Models20 Apr 2026
- 2026Human Cognition in Machines: A Unified Perspective of World Models17 Apr 2026
10 more
- 2026ROCKET: Residual-Oriented Multi-Layer Alignment for Spatially-Aware Vision-Language-Action Models20 Feb 2026
- 2026Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Models1 Feb 2026
- 2026A Systematic Study of Data Modalities and Strategies for Co-training Large Behavior Models for Robot Manipulation1 Feb 2026
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation27 Jan 2026
- 2025A Survey on Efficient Vision-Language-Action Models27 Oct 2025
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey20 Oct 2025
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey23 Sep 2025
- 2025I-FailSense: Towards General Robotic Failure Detection with Vision-Language Models19 Sep 2025
- 2025Cross-Platform Scaling of Vision-Language-Action Models from Edge to Cloud GPUs15 Sep 2025
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey18 Aug 2025
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
- 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
- 2026A Systematic Study of Data Modalities and Strategies for Co-training Large Behavior Models for Robot Manipulationcited by 22
- 2026ROCKET: Residual-Oriented Multi-Layer Alignment for Spatially-Aware Vision-Language-Action Modelscited by 11
- 2025Cross-Platform Scaling of Vision-Language-Action Models from Edge to Cloud GPUscited by 8
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulationcited by 6
- 2026Dual Latent Memory in Vision-Language-Action Models for Robotic Manipulationcited by 4
- 2026AnchorRefine: Synergy-Manipulation Based on Trajectory Anchor and Residual Refinement for Vision-Language-Action Modelscited by 1
- 2026Dual Latent Memory in Vision-Language-Action Models for Robotic Manipulation8 Jul 2026
- 2026AnchorRefine: Synergy-Manipulation Based on Trajectory Anchor and Residual Refinement for Vision-Language-Action Models20 Apr 2026
- 2026ROCKET: Residual-Oriented Multi-Layer Alignment for Spatially-Aware Vision-Language-Action Models20 Feb 2026
- 2026A Systematic Study of Data Modalities and Strategies for Co-training Large Behavior Models for Robot Manipulation1 Feb 2026
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation27 Jan 2026
- 2025A Survey on Efficient Vision-Language-Action Models27 Oct 2025
- 2025Cross-Platform Scaling of Vision-Language-Action Models from Edge to Cloud GPUs15 Sep 2025
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey18 Aug 2025
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 49
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Surveycited by 26
- 2025I-FailSense: Towards General Robotic Failure Detection with Vision-Language Modelscited by 12
- 2026QuoVLA: Quotient Space for Vision-Language-Action Modelscited by 2
- 2026QuoVLA: Quotient Space for Vision-Language-Action Models24 May 2026
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey20 Oct 2025
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey23 Sep 2025
- 2025I-FailSense: Towards General Robotic Failure Detection with Vision-Language Models19 Sep 2025
- 2026Self-Evolving Embodied Agents via Skill-Harness Evolutioncited by 12
- 2026Self-Evolving Embodied Agents via Skill-Harness Evolution11 Aug 2026
- 2026Hydra: Phase-Aware Workload Characterization of LLM Inference across Edge SoC Generations, Backends, and Quantization Levelscited by 1
- 2026Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edgecited by 0
- 2026LEAP: Learned Block-wise Evidence Retrieval for Long Audio-Video Perceptioncited by 0
- 2026LEAP: Learned Block-wise Evidence Retrieval for Long Audio-Video Perception30 Sep 2026
- 2026Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge29 Aug 2026
- 2026Hydra: Phase-Aware Workload Characterization of LLM Inference across Edge SoC Generations, Backends, and Quantization Levels25 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026VLA-REPLICA: A Low-Cost, Reproducible Benchmark for Real-World Evaluation of Vision-Language-Action Models
- 2025VLA-0: Building State-of-the-Art VLAs with Zero Modification
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
- 2026Reshaping Action Error Distributions for Reliable Vision-Language-Action Models
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decoding
- 2026Learning to Accelerate Vision-Language-Action Models through Adaptive Visual Token Caching
- 2024Benchmarking Vision, Language, & Action Models on Robotic Learning Tasks
- 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Model