mlsanityData to 7 Oct 2026

VISTA: Enhancing Visual Conditioning via Track-Following Preference Optimization in Vision-Language-Action Models

arXiv 2602.05049 ↗First posted 4 Feb 2026cs.CV cs.AI cs.LGcited by 2

On the map: Vision-language-action models → Reinforcement learning and post-training

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models have demonstrated strong performance across a wide range of robotic manipulation tasks. Despite the success, extending large pretrained Vision-Language Models (VLMs) to the action space can induce vision-action misalignment, where action predictions exhibit weak dependence on the current visual state, leading to unreliable action outputs. In this work, we study VLA models through the lens of visual conditioning and empirically show that successful rollouts consistently exhibit stronger visual dependence than failed ones. Motivated by this observation, we propose a training framework that explicitly strengthens visual conditioning in VLA models. Our approach first aligns action prediction with visual input via preference optimization on a track-following surrogate task, and then transfers the enhanced alignment to instruction-following task through latent-space distillation during supervised finetuning. Without introducing architectural modifications or additional data collection, our method improves both visual conditioning and task performance for discrete OpenVLA, and further yields consistent gains when extended to the continuous OpenVLA-OFT setting. Project website: https://vista-vla.github.io/ .

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 62 of its 66 references that are in the map. First posted on arXiv 4 Feb 2026.

Builds on

62 of 66 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024GRAPE: Generalizing Robot Policy via Preference Alignment28 Nov
  2. 2024Octo: An Open-Source Generalist Robot Policy20 May

Other references · 60

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  6. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  8. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
  9. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  10. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
  11. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 679
  12. 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decodingcited by 671
38 more
  1. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  2. 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
  3. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  4. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
  5. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  6. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  7. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
  8. 2023Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuningcited by 439
  9. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  10. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  11. 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
  12. 2024Latent Action Pretraining from Videoscited by 302
  13. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
  14. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
  15. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
  16. 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 264
  17. 2025Motus: A Unified Latent Action World Modelcited by 231
  18. 2023Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimizationcited by 223
  19. 2024Aligning Modalities in Vision Large Language Models via Preference Fine-tuningcited by 197
  20. 2025Unified Video Action Modelcited by 195
  21. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
  22. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 159
  23. 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 145
  24. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 142
  25. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 140
  26. 2025Unified Vision-Language-Action Modelcited by 128
  27. 2024Track2Act: Predicting Point Tracks from Internet Videos enables Generalizable Robot Manipulationcited by 116
  28. 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Modelcited by 112
  29. 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 99
  30. 2024What Matters in Building Vision-Language-Action Models for Generalist Robotscited by 88
  31. 2024LLARVA: Vision-Action Instruction Tuning Enhances Robot Learningcited by 87
  32. 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
  33. 2024Calibrated Self-Rewarding Vision Language Modelscited by 77
  34. 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policycited by 73
  35. 2024Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulationcited by 71
  36. 2024Moto: Latent Motion Token as the Bridging Language for Learning Robot Manipulation from Videoscited by 65
  37. 2025Motion Tracks: A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learningcited by 57
  38. 2025Actions as Language: Fine-Tuning VLMs into VLAs Without Catastrophic Forgettingcited by 52

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026VLA Grounder: Language-Conditioning Space Optimization for Black-Box VLA Models
  2. 2026CAC-VLA: Context-Gated Action Conditioning for Vision-Language-Action Models
  3. 2025PosA-VLA: Enhancing Action Generation via Pose-Conditioned Anchor Attention
  4. 2026PriorVLA: Prior-Preserving Adaptation for Vision-Language-Action Models
  5. 2025AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention
  6. 2026VANE: Reliable Test-Time Training for Vision-Language-Action Models via Future Visual Representation Prediction
  7. 2026RoVLA: Multi-Consistency Constraints for Robust Vision-Language-Action Models
  8. 2026VLaRL: Augmenting Vision-Language-Action Models with Simulation-Trained Latent-Conditioned Residual RL