mlsanityData to 7 Oct 2026

VISTA: Vision-Grounded and Physics-Validated Adaptation of UMI data for VLA Training

arXiv 2606.04708 ↗First posted 3 Jun 2026cs.RO cs.AIcited by 2

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

Universal Manipulation Interface (UMI) enables scalable real-world robot data collection without hardware-specific teleoperation, yet leveraging UMI data to train large-scale Vision-Language-Action (VLA) models remains fundamentally challenging. We identify two critical mismatches: wrist-mounted fisheye views, with severe radial distortion and local gripper-centric perspectives, are out-of-distribution for pretrained VLMs; and human-collected trajectories frequently violate kinematic limits, incur collisions, or exceed controller bandwidth, teaching VLA policies physically infeasible actions. To address the challenges, we present VISTA, a framework that bridges this dual gap through three synergistic components. (i)~UMI-VQA, the first large-scale VQA dataset tailored to wrist-mounted fisheye observations, aligns VLM representations to the distorted visual regime via auxiliary vision-language supervision. (ii)~A systematic physical-validation pipeline performs a data-completeness pre-check and scores each valid trajectory for trajectory continuity, self-collision risk, and execution fidelity before it enters training. (iii)~A two-stage co-training recipe jointly learns vision-language grounding on UMI-VQA and action prediction on validated trajectories. Our experiments empirically show that incorporating UMI-VQA consistently improves downstream policy performance, and that physical-validation scores are strongly predictive of deployment success. On diverse simulation and real-world manipulation tasks, VISTA significantly outperforms strong baselines including π0.5, LingBot-VLA, and Wall-X. We release the physical-validation pipeline, UMI-VQA, validated trajectory data, and the pre-trained model for the community.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 46 of its 49 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

46 of 49 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026ManipArena: Comprehensive Real-world Evaluation of Reasoning-Oriented Generalist Robot Manipulation30 Mar
  2. 2026RDT2: Exploring the Scaling Limit of UMI Data Towards Zero-Shot Cross-Embodiment Generalization3 Feb
  3. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Better29 May
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
  6. 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
  7. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 39

  1. 2022Flow Matching for Generative Modelingcited by 5,426
  2. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  4. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  5. 2025Qwen3-VL Technical Reportcited by 2,534
  6. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  7. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  8. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  9. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  10. 2025Qwen-Image Technical Reportcited by 973
  11. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  12. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
27 more
  1. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  2. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  3. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  4. 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
  5. 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
  6. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 242
  7. 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
  8. 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
  9. 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
  10. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Roboticscited by 125
  11. 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 100
  12. 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 72
  13. 2025RynnVLA-002: A Unified Vision-Language-Action and World Modelcited by 70
  14. 2025RoboArena: Distributed Real-World Evaluation of Generalist Robot Policiescited by 63
  15. 2025DexUMI: Using Human Hand as the Universal Manipulation Interface for Dexterous Manipulationcited by 58
  16. 2025AI Flow: Perspectives, Scenarios, and Approachescited by 44
  17. 2026RoboBrain 2.5: Depth in Sight, Time in Mindcited by 38
  18. 2024FastUMI: A Scalable and Hardware-Independent Universal Manipulation Interface with Datasetcited by 36
  19. 2025Embodied-R1: Reinforced Embodied Reasoning for General Robotic Manipulationcited by 36
  20. 2025Vlaser: Vision-Language-Action Model with Synergistic Embodied Reasoningcited by 22
  21. 2025Align-Then-stEer: Adapting the Vision-Language Action Models through Unified Latent Guidancecited by 18
  22. 2025ActiveUMI: Robotic Manipulation with Active Perception from Robot-Free Human Demonstrationscited by 17
  23. 2021ERQA: Edge-Restoration Quality Assessment for Video Super-Resolutioncited by 14
  24. 2025FastUMI-100K: Advancing Data-driven Robotic Manipulation with a Large-scale UMI-style Datasetcited by 11
  25. 2026PRTS: A Primitive Reasoning and Tasking System via Contrastive Representationscited by 6
  26. 2026XRZero-G0: Pushing the Frontier of Dexterous Robotic Manipulation with Interfaces, Quality and Ratioscited by 5
  27. 2026UMI-3D: Extending Universal Manipulation Interface from Vision-Limited to 3D Spatial Perceptioncited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026HIL-UMI: Bringing Human-in-the-Loop Post-Training of Vision-Language-Action Models to Universal Manipulation Interface
  2. 2026A Sim-to-Real Integration Pipeline for Training and Deployment of Chunk-Based VLA Manipulation Policies
  3. 2026CometVLA: Co-Training on an Embodied Data Pyramid towards Physical Understanding
  4. 2026SimVLA: A Simple VLA Baseline for Robotic Manipulation
  5. 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization
  6. 2025Grounding Actions in Camera Space: Observation-Centric Vision-Language-Action Policy
  7. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey
  8. 2026Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectories