Reshaping Action Error Distributions for Reliable Vision-Language-Action Models
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
In robotic manipulation, vision-language-action (VLA) models have emerged as a promising paradigm for learning generalizable and scalable robot policies. Most existing VLA frameworks rely on standard supervised objectives, typically cross-entropy for discrete actions and mean squared error (MSE) for continuous action regression, which impose strong pointwise constraints on individual predictions. In this work, we focus on continuous-action VLA models and move beyond conventional MSE-based regression by reshaping action error distributions during training. Drawing on information-theoretic principles, we introduce Minimum Error Entropy (MEE) into modern VLA architectures and propose a trajectory-level MEE objective, together with two weighted variants, combined with MSE for continuous-action VLA training. We evaluate our approaches across standard, few-shot, and noisy settings on multiple representative VLA architectures, using simulation benchmarks such as LIBERO and SimplerEnv as well as real-world robotic manipulation tasks. Experimental results demonstrate consistent improvements in success rates and robustness across these settings. Under imbalanced data regimes, the gains persist within a well-characterized operating range, while incurring negligible additional training cost and no impact on inference efficiency. We further provide theoretical analyses that explain why MEE-based supervision is effective and characterize its practical range. Project Page: https://cognition2actionlab.github.io/VLA-TMEE.github.io/
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 31 of its 46 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
31 of 46 references.
Closest ancestors · 11
Same direction, newest first
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model11 Sep
- 2025Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulation27 Aug
- 2025OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulation6 May
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2025VLAS: Vision-Language-Action Model With Speech Instructions For Customized Robot Manipulation19 Feb
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation29 Nov
- 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
- 2024Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulation10 Oct
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 20
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2024Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goalscited by 131
8 more
- 2025VQ-VLA: Improving Vision-Language-Action Models via Scaling Vector-Quantized Action Tokenizerscited by 67
- 2018Performance Metrics (Error Measures) in Machine Learning Regression, Forecasting and Prognostics: Properties and Typologycited by 35
- 2022A Comprehensive Survey of Regression Based Loss Functions for Time Series Forecastingcited by 33
- 2025Towards a Unified Understanding of Robot Manipulation: A Comprehensive Surveycited by 32
- 2025Align-Then-stEer: Adapting the Vision-Language Action Models through Unified Latent Guidancecited by 18
- 2025Rethinking Latent Redundancy in Behavior Cloning: An Information Bottleneck Approach for Robot Manipulationcited by 10
- 2017Quantized Minimum Error Entropy Criterioncited by 4
- 2019Minimum Error Entropy Kalman Filtercited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025VLA-0: Building State-of-the-Art VLAs with Zero Modification
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulation
- 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review
- 2024Benchmarking Vision, Language, & Action Models on Robotic Learning Tasks
- 2026VLA-REPLICA: A Low-Cost, Reproducible Benchmark for Real-World Evaluation of Vision-Language-Action Models
- 2025VOTE: Vision-Language-Action Optimization with Trajectory Ensemble Voting
- 2026Unleashing More Actions via Action Compositional Training for VLA Models
- 2026VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment