mlsanityData to 14 Oct 2026

Fast-in-Slow: A Dual-System Foundation Model Unifying Fast Manipulation within Slow Reasoning

arXiv 2506.01953 ↗First posted 2 Jun 2025cs.ROcited by 31

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Generalized policy and execution efficiency constitute the two critical challenges in robotic manipulation. While recent foundation policies benefit from the common-sense reasoning capabilities of internet-scale pretrained vision-language models (VLMs), they often suffer from low execution frequency. To mitigate this dilemma, dual-system approaches, inspired by Kahneman's theory, have been proposed to leverage a VLM-based System 2 model handling high-level reasoning and a separate System 1 action model ensuring real-time control. However, existing designs maintain both systems as separate models, limiting System 1 from fully leveraging the rich pretrained knowledge from the VLM-based System 2. In this work, we propose Fast-in-Slow (FiS), a unified dual-system vision-language-action (VLA) model that embeds the System 1 execution module within the VLM-based System 2 by partially sharing parameters. This innovative paradigm not only enables high-frequency execution in System 1 but also facilitates coordination between the reasoning and execution components within a single foundation model of System 2. Given their fundamentally distinct roles within FiS-VLA, we design the two systems to incorporate heterogeneous modality inputs alongside asynchronous operating frequencies, enabling both fast and precise manipulation. To enable coordination between the two systems, a dual-aware co-training strategy is proposed that equips System 1 with action generation capabilities while preserving System 2's contextual reasoning representation. For evaluation, FiS-VLA outperforms previous state-of-the-art methods by 8% in simulation and 11% in real-world tasks in terms of average success rate, while achieving a 117.7 Hz control frequency with action chunk set to eight. Project web page: fast-in-slow.github.io.

Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 46 of its 108 references that are in the map. First posted on arXiv 2 Jun 2025.

Builds on

46 of 108 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
  2. 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution4 Nov
  3. 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation3 Sep

Other references · 43

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  7. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  8. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  9. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  10. 2017Decoupled Weight Decay Regularizationcited by 1,831
  11. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  12. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
31 more
  1. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  2. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
  3. 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 743
  4. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  5. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  6. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  7. 2018Behavioral Cloning from Observationcited by 492
  8. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  9. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
  10. 2021Mastering Visual Continuous Control: Improved Data-Augmented Reinforcement Learningcited by 372
  11. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
  12. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
  13. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
  14. 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 250
  15. 2024RT-H: Action Hierarchies Using Languagecited by 210
  16. 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 195
  17. 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 181
  18. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 175
  19. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
  20. 20243D Diffusion Policy: Generalizable Visuomotor Policy Learning via Simple 3D Representationscited by 116
  21. 2024MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data Enginecited by 113
  22. 2022From Play to Policy: Conditional Behavior Generation from Uncurated Robot Datacited by 103
  23. 2024FMB: a Functional Manipulation Benchmark for Generalizable Robotic Learningcited by 80
  24. 2024HiRT: Enhancing Robotic Control with Hierarchical Robot Transformerscited by 75
  25. 2023Multi-Stage Cable Routing through Hierarchical Imitation Learningcited by 60
  26. 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulationcited by 46
  27. 2024Diffusion Transformer Policycited by 41
  28. 2024ManipVQA: Injecting Robotic Affordance and Physically Grounded Information into Multi-Modal Large Language Modelscited by 25
  29. 2024A Self-Correcting Vision-Language-Action Model for Fast and Slow System Manipulationcited by 21
  30. 2024NaturalVLM: Leveraging Fine-grained Natural Language for Affordance-Guided Visual Manipulationcited by 10
  31. 2023LHManip: A Dataset for Long-Horizon Language-Grounded Manipulation Tasks in Cluttered Tabletop Environmentscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 25.

31 papers.

Sort:

By area:

  1. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
  2. 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
  3. 2025MLA: A Multisensory Language-Action Model for Multimodal Understanding and Forecasting in Robotic Manipulationcited by 23
  4. 2025ManualVLA: A Unified VLA Model for Chain-of-Thought Manual Generation and Robotic Manipulationcited by 14
  5. 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Modelscited by 10
  6. 2026ABot-N1: Toward a General Visual Language Navigation Foundation Modelcited by 6
  7. 2025Toward Embodiment Equivariant Vision-Language-Action Policycited by 5
  8. 2026TIDAL: Temporally Interleaved Diffusion and Action Loop for High-Frequency VLA Controlcited by 5
  9. 2026Vesta: A Generalist Embodied Reasoning Modelcited by 5
  10. 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-trainingcited by 4
  11. 2026LABSHIELD: A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratoriescited by 3
  12. 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inferencecited by 3
19 more
  1. 2026Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robotscited by 2
  2. 2026Latency-Tolerant Cloud-Edge Collaborative Vision-Language-Action Models via Emergent Representational Specializationcited by 2
  3. 2026VoiceMem: Streaming Dual-Brain Memory for Real-Time Interactioncited by 2
  4. 2026Think Only When Needed: Prompt-Authority Control for Selective Slow-Path Intervention in Vision-Language-Action Manipulationcited by 1
  5. 2026PonderPounce: A Pretrained MLLM as an Episode Context Engine for Robot Controlcited by 1
  6. 2025MAPF-World: Action World Model for Multi-Agent Path Findingcited by 0
  7. 2026Position: Vision-Language-Action Models Cannot Be Verified to Perform Physical Reasoningcited by 0
  8. 2026Emergent Compositional Skills in Mixture-of-Experts VLAscited by 0
  9. 2026Fast and Accurate: An Adaptive VLA Inference Framework through Environment-aware Model Selectioncited by 0
  10. 2026ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Modelscited by 0
  11. 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAscited by 0
  12. 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Modelscited by 0
  13. 2026H-VLA: Hierarchical Vision-Language-Action Model with Key-Action Reasoning and Motion Planning in a Unified Action Spacecited by 0
  14. 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunkscited by 0
  15. 2026Beyond Token Importance: Preserving Spatial Scaffolds for Efficient Vision-Language-Action Inferencecited by 0
  16. 2026DuoMind: Enabling Distributed Multi-Robot Coordination with Semantic Communicationcited by 0
  17. 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLAcited by 0
  18. 2026Can machines reason non-verbally?cited by 0
  19. 2026What Matters for World Modeling in Vision-Language-Action Models?cited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Asynchronous Fast-Slow Vision-Language-Action Policies for Whole-Body Robotic Manipulation
  2. 2024Language-Conditioned Robotic Manipulation with Fast and Slow Thinking
  3. 2026Critic in the Loop: A Tri-System VLA Framework for Robust Long-Horizon Manipulation
  4. 2025Unified Embodied VLM Reasoning with Robotic Action via Autoregressive Discretized Pre-training
  5. 2026Fast-ThinkAct: Efficient Vision-Language-Action Reasoning via Verbalizable Latent Planning
  6. 2026DySL-VLA: Efficient Vision-Language-Action Model Inference via Dynamic-Static Layer-Skipping for Robot Manipulation
  7. 2026Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulation
  8. 2026Libra-VLA: Achieving Learning Equilibrium via Asynchronous Coarse-to-Fine Dual-System