mlsanityData to 14 Oct 2026

iFlyBot-VLA Technical Report

arXiv 2511.01914 ↗First posted 1 Nov 2025cs.CV cs.AI cs.ROcited by 1

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

We introduce iFlyBot-VLA, a large-scale Vision-Language-Action (VLA) model trained under a novel framework. The main contributions are listed as follows: (1) a latent action model thoroughly trained on large-scale human and robotic manipulation videos; (2) a dual-level action representation framework that jointly supervises both the Vision-Language Model (VLM) and the action expert during training; (3) a mixed training strategy that combines robot trajectory data with general QA and spatial QA datasets, effectively enhancing the 3D perceptual and reasoning capabilities of the VLM backbone. Specifically, the VLM is trained to predict two complementary forms of actions: latent actions, derived from our latent action model pretrained on cross-embodiment manipulation data, which capture implicit high-level intentions; and structured discrete action tokens, obtained through frequency-domain transformations of continuous control signals, which encode explicit low-level dynamics. This dual supervision aligns the representation spaces of language, vision, and action, enabling the VLM to directly contribute to action generation. Experimental results on the LIBERO Franka benchmark demonstrate the superiority of our frame-work, while real-world evaluations further show that iFlyBot-VLA achieves competitive success rates across diverse and challenging manipulation tasks. Furthermore, we plan to open-source a portion of our self-constructed dataset to support future research in the community

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 40 of its 49 references that are in the map. First posted on arXiv 1 Nov 2025.

Builds on

40 of 49 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Galaxea Open-World Dataset and G0 Dual-System VLA Model30 Aug
  2. 2025GR-3 Technical Report21 Jul
  3. 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 34

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Scalable Diffusion Models with Transformerscited by 6,054
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2017Neural Discrete Representation Learningcited by 4,712
  6. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  7. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  8. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  9. 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
  10. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  11. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
  12. 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 743
22 more
  1. 2024PaliGemma: A versatile 3B VLM for transfercited by 696
  2. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
  3. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  4. 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
  5. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 327
  6. 2024Latent Action Pretraining from Videoscited by 321
  7. 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 283
  8. 2017Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metricscited by 264
  9. 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 255
  10. 2025Real-Time Execution of Action Chunking Flow Policiescited by 216
  11. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 211
  12. 2015Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hourscited by 209
  13. 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 189
  14. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 175
  15. 2023HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real Worldcited by 166
  16. 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedbackcited by 145
  17. 2020ACRONYM: A Large-Scale Grasp Dataset Based on Simulationcited by 117
  18. 2018Jacquard: A Large Scale Dataset for Robotic Grasp Detectioncited by 87
  19. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 84
  20. 2022Holo-Dex: Teaching Dexterity with Immersive Mixed Realitycited by 57
  21. 2024EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generationcited by 41
  22. 2023OpenVR: Teleoperation for Manipulationcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey
  2. 2025iFlyBot-VLM Technical Report
  3. 2025InstructVLA: Vision-Language-Action Instruction Tuning from Understanding to Manipulation
  4. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
  5. 2025Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulation
  6. 2025LLaDA-VLA: Vision Language Diffusion Action Models
  7. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
  8. 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review