Quantile Head for Vision-Language-Action Models
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
also in 2 more
Abstract (arXiv)
Vision-Language-Action (VLA) models integrate pretrained Vision-Language Models (VLMs) with action heads for robot control. Common action heads have distinct limitations: point regression provides only a point estimate of the action distribution, while standard flow-matching samplers require costly iterative sampling. To address these limitations, we unify regression and flow matching under a shared objective and extend it to derive a quantile objective. This quantile objective guides the design of our Quantile Head, which predicts a median and positive gaps to form ordered marginal action quantiles in one forward pass. These quantiles support multiple sampling strategies without retraining and are jointly supervised to train the default median policy. Our local analysis of this joint supervision shows that, with calibrated nearby quantiles, fixed gaps, and matched correction speed, direct median updates have lower variance than under median-only supervision. Experiments show that this jointly supervised median policy achieves the highest average success rates among the compared methods on LIBERO, LIBERO-Plus, LIBERO-Pro, and two real-robot tasks, together with the shortest mean episode time among matched LIBERO baselines; code is available at https://github.com/xwangrs/Quantile-Head-for-VLA.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 34 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
28 of 34 references.
Closest ancestors · 5
Same direction, newest first
- 2026Continuous Reasoning for Vision-Language-Action29 May
- 2026ACoT-VLA: Action Chain-of-Thought for Vision-Language-Action Models16 Jan
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model11 Sep
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 23
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 166
- 2026InternVLA-A1.5: Unifying Understanding, Latent Foresight, and Action for Compositional Generalizationcited by 18
11 more
- 2026SnapFlow: One-Step Action Generation for Flow-Matching VLAs via Progressive Self-Distillationcited by 12
- 2026SimVLA: A Simple VLA Baseline for Robotic Manipulationcited by 10
- 2026World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesiscited by 10
- 2026Geometric Action Model for Robot Policy Learningcited by 10
- 2026MemoryVLA++: Temporal Modeling via Memory and Imagination in Vision-Language-Action Modelscited by 9
- 2026ReconVLA: An Uncertainty-Guided and Failure-Aware Vision-Language-Action Framework for Robotic Controlcited by 5
- 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulationcited by 4
- 2026Let It Be Simple: One-Step Action Generation for Vision-Language-Action Modelscited by 3
- 2025OrderFusion: Encoding Orderbook for End-to-End Probabilistic Intraday Electricity Price Forecastingcited by 2
- 2026SUREFlow: State-space Uncertainty-aware REsidual Flow Matching for Robust Robot Manipulationcited by 2
- 2026CofactVLA: Deconfounding Vision-Language-Action Models via Counterfactual Interventioncited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization
- 2026Reshaping Action Error Distributions for Reliable Vision-Language-Action Models
- 2026QuoVLA: Quotient Space for Vision-Language-Action Models
- 2026Fewer Steps, Better Actions: Rethinking Flow-Matching Inference for VLA Policies
- 2026VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment
- 2026QVLA: Not All Channels Are Equal in Vision-Language-Action Model's Quantization
- 2026Wall-OSS-0.5 Technical Report
- 2026CHASE-VLA: Post-Training Quantization Framework for Vision-Language-Action Models with Chunk-Aware Scale Estimation