PolicyTrim: Boosting Intrinsic Policy Efficiency of Vision-Language-Action Models
On the map: Vision-language-action models → Reinforcement learning and post-training
Abstract (arXiv)
Vision-Language-Action (VLA) models provide a unified paradigm for robotic manipulation, yet their real-world deployment is often bottlenecked by execution efficiency. While existing efforts predominantly focus on compute-centric efficiency to reduce per-step inference latency, the intrinsic policy efficiency of these models remains largely unexplored. Policy efficiency is fundamentally affected by two factors, namely the effective executable length of predicted action chunks and the total physical steps required to complete a task. These two factors jointly determine the total number of forward inference calls during execution. We observe that current VLA policies struggle with planning unreliability and action redundancy, suffering from severe prediction degradation at the tail of action chunks and tending to generate unnecessarily redundant physical steps. To address this, we propose PolicyTrim, a reinforcement learning-based post-training framework that extends the reliable action chunk length and reduces redundant physical steps. For reliable chunk extension, we employ a dynamic exploration strategy that explicitly rewards the successful completion of longer executable lengths, progressively pushing the trustworthy prediction horizon to its empirical limit. For step efficiency, we design a redundancy-aware reward that directly favors successful task completions with fewer steps while penalizing unreproducible shortcuts, effectively eliminating redundant physical actions. Extensive experiments across three benchmarks and three VLA models demonstrate that PolicyTrim improves action chunk utilization by 3× and reduces physical execution steps by 51.4%. Ultimately, our framework delivers up to a 5.83× end-to-end deployment speedup without compromising task success rates.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 51 of its 57 references that are in the map. First posted on arXiv 21 Jun 2026.
Builds on
51 of 57 references.
Closest ancestors · 6
Same direction, newest first
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learning11 Sep
- 2025CO-RFT: Efficient Fine-Tuning of Vision-Language-Action Models through Chunked Offline Reinforcement Learning4 Aug
- 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learning24 May
- 2025Interactive Post-Training for Vision-Language-Action Models22 May
- 2025ConRFT: A Reinforced Fine-tuning Method for VLA Models via Consistency Policy8 Feb
- 2024Octo: An Open-Source Generalist Robot Policy20 May
Other references · 45
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
33 more
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 181
- 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 127
- 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Modelscited by 93
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decodingcited by 88
- 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Cachingcited by 86
- 2025VQ-VLA: Improving Vision-Language-Action Models via Scaling Vector-Quantized Action Tokenizerscited by 70
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
- 2025SP-VLA: A Joint Model Scheduling and Token Pruning Approach for VLA Model Accelerationcited by 58
- 2025RLinf: Flexible and Efficient Large-scale Reinforcement Learning via Macro-to-Micro Flow Transformationcited by 57
- 2025Meta-World+: An Improved, Standardized, RL Benchmarkcited by 43
- 2025BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulationcited by 43
- 2025SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruningcited by 43
- 2025CEED-VLA: Consistency Vision-Language-Action Model with Early-Exit Decodingcited by 38
- 2025The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruningcited by 36
- 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
- 2025Spec-VLA: Speculative Decoding for Vision-Language-Action Models with Relaxed Acceptancecited by 32
- 2025dVLA: Diffusion Vision-Language-Action Model with Multimodal Chain-of-Thoughtcited by 30
- 2026QuantVLA: Scale-Calibrated Post-Training Quantization for Vision-Language-Action Modelscited by 30
- 2026QVLA: Not All Channels Are Equal in Vision-Language-Action Model's Quantizationcited by 28
- 2025Mixture of Horizons in Action Chunkingcited by 21
- 2025EdgeVLA: Efficient Vision-Language-Action Modelscited by 19
- 2025RetoVLA: Reusing Register Tokens for Spatial Reasoning in Vision-Language-Action Modelscited by 6
- 2025Sparsity Forcing: Reinforcing Token Sparsity of MLLMscited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Reducing Temporal Redundancy for Efficient Vision-Language-Action Inference
- 2025SRPO: Self-Referential Policy Optimization for Vision-Language-Action Models
- 2026Learning to Accelerate Vision-Language-Action Models through Adaptive Visual Token Caching
- 2026PAPO-VLA: Planning-Aware Policy Optimization for Vision-Language-Action Models
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
- 2025WMPO: World Model-based Policy Optimization for Vision-Language-Action Models
- 2026Accelerating VLA Inference with Perturbation Informed Execution
- 2026Prioritized Rollouts for Efficient World Model-based Vision-Language-Action Policy Optimization