iFlyBot-VLA Technical Report
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
We introduce iFlyBot-VLA, a large-scale Vision-Language-Action (VLA) model trained under a novel framework. The main contributions are listed as follows: (1) a latent action model thoroughly trained on large-scale human and robotic manipulation videos; (2) a dual-level action representation framework that jointly supervises both the Vision-Language Model (VLM) and the action expert during training; (3) a mixed training strategy that combines robot trajectory data with general QA and spatial QA datasets, effectively enhancing the 3D perceptual and reasoning capabilities of the VLM backbone. Specifically, the VLM is trained to predict two complementary forms of actions: latent actions, derived from our latent action model pretrained on cross-embodiment manipulation data, which capture implicit high-level intentions; and structured discrete action tokens, obtained through frequency-domain transformations of continuous control signals, which encode explicit low-level dynamics. This dual supervision aligns the representation spaces of language, vision, and action, enabling the VLM to directly contribute to action generation. Experimental results on the LIBERO Franka benchmark demonstrate the superiority of our frame-work, while real-world evaluations further show that iFlyBot-VLA achieves competitive success rates across diverse and challenging manipulation tasks. Furthermore, we plan to open-source a portion of our self-constructed dataset to support future research in the community
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 40 of its 49 references that are in the map. First posted on arXiv 1 Nov 2025.
Builds on
40 of 49 references.
Closest ancestors · 6
Same direction, newest first
- 2025Galaxea Open-World Dataset and G0 Dual-System VLA Model30 Aug
- 2025GR-3 Technical Report21 Jul
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
- 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 34
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2017Neural Discrete Representation Learningcited by 4,712
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 743
22 more
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 327
- 2024Latent Action Pretraining from Videoscited by 321
- 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 283
- 2017Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metricscited by 264
- 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 255
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 216
- 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 211
- 2015Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hourscited by 209
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 189
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 175
- 2023HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real Worldcited by 166
- 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedbackcited by 145
- 2020ACRONYM: A Large-Scale Grasp Dataset Based on Simulationcited by 117
- 2018Jacquard: A Large Scale Dataset for Robotic Grasp Detectioncited by 87
- 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 84
- 2022Holo-Dex: Teaching Dexterity with Immersive Mixed Realitycited by 57
- 2024EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generationcited by 41
- 2023OpenVR: Teleoperation for Manipulationcited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 6
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey
- 2025iFlyBot-VLM Technical Report
- 2025InstructVLA: Vision-Language-Action Instruction Tuning from Understanding to Manipulation
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
- 2025Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulation
- 2025LLaDA-VLA: Vision Language Diffusion Action Models
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
- 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review