VISTA: Enhancing Visual Conditioning via Track-Following Preference Optimization in Vision-Language-Action Models
On the map: Vision-language-action models → Reinforcement learning and post-training
Abstract (arXiv)
Vision-Language-Action (VLA) models have demonstrated strong performance across a wide range of robotic manipulation tasks. Despite the success, extending large pretrained Vision-Language Models (VLMs) to the action space can induce vision-action misalignment, where action predictions exhibit weak dependence on the current visual state, leading to unreliable action outputs. In this work, we study VLA models through the lens of visual conditioning and empirically show that successful rollouts consistently exhibit stronger visual dependence than failed ones. Motivated by this observation, we propose a training framework that explicitly strengthens visual conditioning in VLA models. Our approach first aligns action prediction with visual input via preference optimization on a track-following surrogate task, and then transfers the enhanced alignment to instruction-following task through latent-space distillation during supervised finetuning. Without introducing architectural modifications or additional data collection, our method improves both visual conditioning and task performance for discrete OpenVLA, and further yields consistent gains when extended to the continuous OpenVLA-OFT setting. Project website: https://vista-vla.github.io/ .
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 62 of its 66 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
62 of 66 references.
Closest ancestors · 2
Same direction, newest first
- 2024GRAPE: Generalizing Robot Policy via Preference Alignment28 Nov
- 2024Octo: An Open-Source Generalist Robot Policy20 May
Other references · 60
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 679
- 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decodingcited by 671
38 more
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2023Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuningcited by 439
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
- 2024Latent Action Pretraining from Videoscited by 302
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 264
- 2025Motus: A Unified Latent Action World Modelcited by 231
- 2023Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimizationcited by 223
- 2024Aligning Modalities in Vision Large Language Models via Preference Fine-tuningcited by 197
- 2025Unified Video Action Modelcited by 195
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 159
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 145
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 142
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 140
- 2025Unified Vision-Language-Action Modelcited by 128
- 2024Track2Act: Predicting Point Tracks from Internet Videos enables Generalizable Robot Manipulationcited by 116
- 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Modelcited by 112
- 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 99
- 2024What Matters in Building Vision-Language-Action Models for Generalist Robotscited by 88
- 2024LLARVA: Vision-Action Instruction Tuning Enhances Robot Learningcited by 87
- 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
- 2024Calibrated Self-Rewarding Vision Language Modelscited by 77
- 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policycited by 73
- 2024Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulationcited by 71
- 2024Moto: Latent Motion Token as the Bridging Language for Learning Robot Manipulation from Videoscited by 65
- 2025Motion Tracks: A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learningcited by 57
- 2025Actions as Language: Fine-Tuning VLMs into VLAs Without Catastrophic Forgettingcited by 52
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026VLA Grounder: Language-Conditioning Space Optimization for Black-Box VLA Models
- 2026CAC-VLA: Context-Gated Action Conditioning for Vision-Language-Action Models
- 2025PosA-VLA: Enhancing Action Generation via Pose-Conditioned Anchor Attention
- 2026PriorVLA: Prior-Preserving Adaptation for Vision-Language-Action Models
- 2025AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention
- 2026VANE: Reliable Test-Time Training for Vision-Language-Action Models via Future Visual Representation Prediction
- 2026RoVLA: Multi-Consistency Constraints for Robust Vision-Language-Action Models
- 2026VLaRL: Augmenting Vision-Language-Action Models with Simulation-Trained Latent-Conditioned Residual RL