Fast-in-Slow: A Dual-System Foundation Model Unifying Fast Manipulation within Slow Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Generalized policy and execution efficiency constitute the two critical challenges in robotic manipulation. While recent foundation policies benefit from the common-sense reasoning capabilities of internet-scale pretrained vision-language models (VLMs), they often suffer from low execution frequency. To mitigate this dilemma, dual-system approaches, inspired by Kahneman's theory, have been proposed to leverage a VLM-based System 2 model handling high-level reasoning and a separate System 1 action model ensuring real-time control. However, existing designs maintain both systems as separate models, limiting System 1 from fully leveraging the rich pretrained knowledge from the VLM-based System 2. In this work, we propose Fast-in-Slow (FiS), a unified dual-system vision-language-action (VLA) model that embeds the System 1 execution module within the VLM-based System 2 by partially sharing parameters. This innovative paradigm not only enables high-frequency execution in System 1 but also facilitates coordination between the reasoning and execution components within a single foundation model of System 2. Given their fundamentally distinct roles within FiS-VLA, we design the two systems to incorporate heterogeneous modality inputs alongside asynchronous operating frequencies, enabling both fast and precise manipulation. To enable coordination between the two systems, a dual-aware co-training strategy is proposed that equips System 1 with action generation capabilities while preserving System 2's contextual reasoning representation. For evaluation, FiS-VLA outperforms previous state-of-the-art methods by 8% in simulation and 11% in real-world tasks in terms of average success rate, while achieving a 117.7 Hz control frequency with action chunk set to eight. Project web page: fast-in-slow.github.io.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 46 of its 108 references that are in the map. First posted on arXiv 2 Jun 2025.
Builds on
46 of 108 references.
Closest ancestors · 3
Same direction, newest first
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
- 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution4 Nov
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation3 Sep
Other references · 43
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
31 more
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 743
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2018Behavioral Cloning from Observationcited by 492
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
- 2021Mastering Visual Continuous Control: Improved Data-Augmented Reinforcement Learningcited by 372
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
- 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 250
- 2024RT-H: Action Hierarchies Using Languagecited by 210
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 195
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 181
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 175
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
- 20243D Diffusion Policy: Generalizable Visuomotor Policy Learning via Simple 3D Representationscited by 116
- 2024MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data Enginecited by 113
- 2022From Play to Policy: Conditional Behavior Generation from Uncurated Robot Datacited by 103
- 2024FMB: a Functional Manipulation Benchmark for Generalizable Robotic Learningcited by 80
- 2024HiRT: Enhancing Robotic Control with Hierarchical Robot Transformerscited by 75
- 2023Multi-Stage Cable Routing through Hierarchical Imitation Learningcited by 60
- 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulationcited by 46
- 2024Diffusion Transformer Policycited by 41
- 2024ManipVQA: Injecting Robotic Affordance and Physically Grounded Information into Multi-Modal Large Language Modelscited by 25
- 2024A Self-Correcting Vision-Language-Action Model for Fast and Slow System Manipulationcited by 21
- 2024NaturalVLM: Leveraging Fine-grained Natural Language for Affordance-Guided Visual Manipulationcited by 10
- 2023LHManip: A Dataset for Long-Horizon Language-Grounded Manipulation Tasks in Cluttered Tabletop Environmentscited by 7
Built on by
Citing papers per year: 2025: 6; 2026: 25.
31 papers.
Sort:
By area:
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
- 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
- 2025MLA: A Multisensory Language-Action Model for Multimodal Understanding and Forecasting in Robotic Manipulationcited by 23
- 2025ManualVLA: A Unified VLA Model for Chain-of-Thought Manual Generation and Robotic Manipulationcited by 14
- 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Modelscited by 10
- 2026ABot-N1: Toward a General Visual Language Navigation Foundation Modelcited by 6
- 2025Toward Embodiment Equivariant Vision-Language-Action Policycited by 5
- 2026TIDAL: Temporally Interleaved Diffusion and Action Loop for High-Frequency VLA Controlcited by 5
- 2026Vesta: A Generalist Embodied Reasoning Modelcited by 5
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-trainingcited by 4
- 2026LABSHIELD: A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratoriescited by 3
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inferencecited by 3
19 more
- 2026Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robotscited by 2
- 2026Latency-Tolerant Cloud-Edge Collaborative Vision-Language-Action Models via Emergent Representational Specializationcited by 2
- 2026VoiceMem: Streaming Dual-Brain Memory for Real-Time Interactioncited by 2
- 2026Think Only When Needed: Prompt-Authority Control for Selective Slow-Path Intervention in Vision-Language-Action Manipulationcited by 1
- 2026PonderPounce: A Pretrained MLLM as an Episode Context Engine for Robot Controlcited by 1
- 2025MAPF-World: Action World Model for Multi-Agent Path Findingcited by 0
- 2026Position: Vision-Language-Action Models Cannot Be Verified to Perform Physical Reasoningcited by 0
- 2026Emergent Compositional Skills in Mixture-of-Experts VLAscited by 0
- 2026Fast and Accurate: An Adaptive VLA Inference Framework through Environment-aware Model Selectioncited by 0
- 2026ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Modelscited by 0
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAscited by 0
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Modelscited by 0
- 2026H-VLA: Hierarchical Vision-Language-Action Model with Key-Action Reasoning and Motion Planning in a Unified Action Spacecited by 0
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunkscited by 0
- 2026Beyond Token Importance: Preserving Spatial Scaffolds for Efficient Vision-Language-Action Inferencecited by 0
- 2026DuoMind: Enabling Distributed Multi-Robot Coordination with Semantic Communicationcited by 0
- 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLAcited by 0
- 2026Can machines reason non-verbally?cited by 0
- 2026What Matters for World Modeling in Vision-Language-Action Models?cited by 0
- 2026What Matters for World Modeling in Vision-Language-Action Models?14 Oct 2026
- 2026Can machines reason non-verbally?9 Oct 2026
- 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLA4 Oct 2026
- 2026DuoMind: Enabling Distributed Multi-Robot Coordination with Semantic Communication1 Oct 2026
- 2026Beyond Token Importance: Preserving Spatial Scaffolds for Efficient Vision-Language-Action Inference29 Sep 2026
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunks29 Sep 2026
- 2026H-VLA: Hierarchical Vision-Language-Action Model with Key-Action Reasoning and Motion Planning in a Unified Action Space19 Sep 2026
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAs17 Sep 2026
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Models16 Sep 2026
- 2026ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Models16 Sep 2026
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-training31 Aug 2026
- 2026VoiceMem: Streaming Dual-Brain Memory for Real-Time Interaction26 Aug 2026
19 more
- 2026PonderPounce: A Pretrained MLLM as an Episode Context Engine for Robot Control25 Aug 2026
- 2026Think Only When Needed: Prompt-Authority Control for Selective Slow-Path Intervention in Vision-Language-Action Manipulation24 Aug 2026
- 2026Fast and Accurate: An Adaptive VLA Inference Framework through Environment-aware Model Selection6 Aug 2026
- 2026Latency-Tolerant Cloud-Edge Collaborative Vision-Language-Action Models via Emergent Representational Specialization1 Aug 2026
- 2026Emergent Compositional Skills in Mixture-of-Experts VLAs22 Jul 2026
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference14 Jul 2026
- 2026ABot-N1: Toward a General Visual Language Navigation Foundation Model11 Jul 2026
- 2026Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robots2 Jul 2026
- 2026Position: Vision-Language-Action Models Cannot Be Verified to Perform Physical Reasoning28 Jun 2026
- 2026Vesta: A Generalist Embodied Reasoning Model18 Jun 2026
- 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Models11 May 2026
- 2026LABSHIELD: A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratories12 Mar 2026
- 2026TIDAL: Temporally Interleaved Diffusion and Action Loop for High-Frequency VLA Control21 Jan 2026
- 2025ManualVLA: A Unified VLA Model for Chain-of-Thought Manual Generation and Robotic Manipulation1 Dec 2025
- 2025A Survey on Efficient Vision-Language-Action Models27 Oct 2025
- 2025MLA: A Multisensory Language-Action Model for Multimodal Understanding and Forecasting in Robotic Manipulation30 Sep 2025
- 2025Toward Embodiment Equivariant Vision-Language-Action Policy18 Sep 2025
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey18 Aug 2025
- 2025MAPF-World: Action World Model for Multi-Agent Path Finding16 Aug 2025
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
- 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
- 2025Toward Embodiment Equivariant Vision-Language-Action Policycited by 5
- 2026TIDAL: Temporally Interleaved Diffusion and Action Loop for High-Frequency VLA Controlcited by 5
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inferencecited by 3
- 2026Latency-Tolerant Cloud-Edge Collaborative Vision-Language-Action Models via Emergent Representational Specializationcited by 2
- 2026Think Only When Needed: Prompt-Authority Control for Selective Slow-Path Intervention in Vision-Language-Action Manipulationcited by 1
- 2026Fast and Accurate: An Adaptive VLA Inference Framework through Environment-aware Model Selectioncited by 0
- 2026ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Modelscited by 0
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Modelscited by 0
- 2026Beyond Token Importance: Preserving Spatial Scaffolds for Efficient Vision-Language-Action Inferencecited by 0
- 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLAcited by 0
- 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLA4 Oct 2026
- 2026Beyond Token Importance: Preserving Spatial Scaffolds for Efficient Vision-Language-Action Inference29 Sep 2026
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Models16 Sep 2026
- 2026ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Models16 Sep 2026
- 2026Think Only When Needed: Prompt-Authority Control for Selective Slow-Path Intervention in Vision-Language-Action Manipulation24 Aug 2026
- 2026Fast and Accurate: An Adaptive VLA Inference Framework through Environment-aware Model Selection6 Aug 2026
- 2026Latency-Tolerant Cloud-Edge Collaborative Vision-Language-Action Models via Emergent Representational Specialization1 Aug 2026
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference14 Jul 2026
- 2026TIDAL: Temporally Interleaved Diffusion and Action Loop for High-Frequency VLA Control21 Jan 2026
- 2025A Survey on Efficient Vision-Language-Action Models27 Oct 2025
- 2025Toward Embodiment Equivariant Vision-Language-Action Policy18 Sep 2025
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey18 Aug 2025
- 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Modelscited by 10
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-trainingcited by 4
- 2026Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robotscited by 2
- 2025MAPF-World: Action World Model for Multi-Agent Path Findingcited by 0
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunkscited by 0
- 2026What Matters for World Modeling in Vision-Language-Action Models?cited by 0
- 2026What Matters for World Modeling in Vision-Language-Action Models?14 Oct 2026
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunks29 Sep 2026
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-training31 Aug 2026
- 2026Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robots2 Jul 2026
- 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Models11 May 2026
- 2025MAPF-World: Action World Model for Multi-Agent Path Finding16 Aug 2025
- 2025ManualVLA: A Unified VLA Model for Chain-of-Thought Manual Generation and Robotic Manipulationcited by 14
- 2026Vesta: A Generalist Embodied Reasoning Modelcited by 5
- 2026LABSHIELD: A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratoriescited by 3
- 2026Position: Vision-Language-Action Models Cannot Be Verified to Perform Physical Reasoningcited by 0
- 2026H-VLA: Hierarchical Vision-Language-Action Model with Key-Action Reasoning and Motion Planning in a Unified Action Spacecited by 0
- 2026H-VLA: Hierarchical Vision-Language-Action Model with Key-Action Reasoning and Motion Planning in a Unified Action Space19 Sep 2026
- 2026Position: Vision-Language-Action Models Cannot Be Verified to Perform Physical Reasoning28 Jun 2026
- 2026Vesta: A Generalist Embodied Reasoning Model18 Jun 2026
- 2026LABSHIELD: A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratories12 Mar 2026
- 2025ManualVLA: A Unified VLA Model for Chain-of-Thought Manual Generation and Robotic Manipulation1 Dec 2025
- 2025MLA: A Multisensory Language-Action Model for Multimodal Understanding and Forecasting in Robotic Manipulationcited by 23
- 2026PonderPounce: A Pretrained MLLM as an Episode Context Engine for Robot Controlcited by 1
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAscited by 0
- 2026DuoMind: Enabling Distributed Multi-Robot Coordination with Semantic Communicationcited by 0
- 2026DuoMind: Enabling Distributed Multi-Robot Coordination with Semantic Communication1 Oct 2026
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAs17 Sep 2026
- 2026PonderPounce: A Pretrained MLLM as an Episode Context Engine for Robot Control25 Aug 2026
- 2025MLA: A Multisensory Language-Action Model for Multimodal Understanding and Forecasting in Robotic Manipulation30 Sep 2025
- 2026Emergent Compositional Skills in Mixture-of-Experts VLAscited by 0
- 2026Emergent Compositional Skills in Mixture-of-Experts VLAs22 Jul 2026
- 2026ABot-N1: Toward a General Visual Language Navigation Foundation Modelcited by 6
- 2026VoiceMem: Streaming Dual-Brain Memory for Real-Time Interactioncited by 2
- 2026Can machines reason non-verbally?cited by 0
- 2026Can machines reason non-verbally?9 Oct 2026
- 2026VoiceMem: Streaming Dual-Brain Memory for Real-Time Interaction26 Aug 2026
- 2026ABot-N1: Toward a General Visual Language Navigation Foundation Model11 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025Asynchronous Fast-Slow Vision-Language-Action Policies for Whole-Body Robotic Manipulation
- 2024Language-Conditioned Robotic Manipulation with Fast and Slow Thinking
- 2026Critic in the Loop: A Tri-System VLA Framework for Robust Long-Horizon Manipulation
- 2025Unified Embodied VLM Reasoning with Robotic Action via Autoregressive Discretized Pre-training
- 2026Fast-ThinkAct: Efficient Vision-Language-Action Reasoning via Verbalizable Latent Planning
- 2026DySL-VLA: Efficient Vision-Language-Action Model Inference via Dynamic-Static Layer-Skipping for Robot Manipulation
- 2026Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulation
- 2026Libra-VLA: Achieving Learning Equilibrium via Asynchronous Coarse-to-Fine Dual-System