Mind to Hand: Purposeful Robotic Control via Embodied Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Humans act with context and intention, with reasoning playing a central role. While internet-scale data has enabled broad reasoning capabilities in AI systems, grounding these abilities in physical action remains a major challenge. We introduce Lumo-1, a generalist vision-language-action (VLA) model that unifies robot reasoning ("mind") with robot action ("hand"). Our approach builds upon the general multi-modal reasoning capabilities of pre-trained vision-language models (VLMs), progressively extending them to embodied reasoning and action prediction, and ultimately towards structured reasoning and reasoning-action alignment. This results in a three-stage pre-training pipeline: (1) Continued VLM pre-training on curated vision-language data to enhance embodied reasoning skills such as planning, spatial understanding, and trajectory prediction; (2) Co-training on cross-embodiment robot data alongside vision-language data; and (3) Action training with reasoning process on trajectories collected on Astribot S1, a bimanual mobile manipulator with human-like dexterity and agility. Finally, we integrate reinforcement learning to further refine reasoning-action consistency and close the loop between semantic inference and motor control. Extensive experiments demonstrate that Lumo-1 achieves significant performance improvements in embodied vision-language reasoning, a critical component for generalist robotic control. Real-world evaluations further show that Lumo-1 surpasses strong baselines across a wide range of challenging robotic tasks, with strong generalization to novel objects and environments, excelling particularly in long-horizon tasks and responding to human-natural instructions that require reasoning over strategy, concepts and space.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 54 of its 81 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
54 of 81 references.
Closest ancestors · 8
Same direction, newest first
- 2025MolmoAct: Action Reasoning Models that can Reason in Space11 Aug
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning22 Jul
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
- 2025Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets21 May
- 2024Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning16 Dec
- 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
- 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning11 Dec
- 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoning30 Oct
Other references · 46
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
34 more
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
- 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 723
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2025π*0.6: a VLA That Learns From Experiencecited by 303
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 151
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
- 20243D Diffusion Policy: Generalizable Visuomotor Policy Learning via Simple 3D Representationscited by 116
- 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 114
- 2025GR-3 Technical Reportcited by 111
- 2025Galaxea Open-World Dataset and G0 Dual-System VLA Modelcited by 92
- 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 89
- 2025RoboBrain 2.0 Technical Reportcited by 89
- 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 83
- 2025A Vision-Language-Action-Critic Model for Robotic Real-World Reinforcement Learningcited by 71
- 2023Waypoint-Based Imitation Learning for Robotic Manipulationcited by 61
- 2025ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Modelscited by 43
- 2024Learning with 3D rotations, a hitchhiker's guide to SO(3)cited by 42
- 2021Creating Multimodal Interactive Agents with Imitation and Self-Supervised Learningcited by 40
- 2025BEHAVIOR Robot Suite: Streamlining Real-World Whole-Body Manipulation for Everyday Household Activitiescited by 31
- 2025AC-DiT: Adaptive Coordination Diffusion Transformer for Mobile Manipulationcited by 23
- 2025Robix: A Unified Model for Robot Interaction, Reasoning and Planningcited by 23
- 2023GAMMA: Graspability-Aware Mobile MAnipulation Policy Learning based on Online Grasping Pose Fusioncited by 22
- 2023Reinforcement Learning with Foundation Priors: Let the Embodied Agent Efficiently Learn on Its Owncited by 19
- 2021OCID-Ref: A 3D Robotic Dataset with Embodied Language for Clutter Scene Groundingcited by 16
- 2025LLaVA-c: Continual Improved Visual Instruction Tuningcited by 14
- 2025HERMES: Human-to-Robot Embodied Learning from Multi-Source Motion Data for Mobile Dexterous Manipulationcited by 14
- 2025Towards Human-level Intelligence via Human-like Whole-Body Manipulationcited by 13
- 2025DSPv2: Improved Dense Policy for Effective and Generalizable Whole-body Mobile Manipulationcited by 8
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026CLAP: Contrastive Latent Action Pretraining for Learning Vision-Language-Action Models from Human Videoscited by 31
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulationcited by 7
- 2026Guide, Think, Act: Interactive Embodied Reasoning in Vision-Language-Action Modelscited by 3
- 2026Towards Predictive, Aligned, and Scalable Robot Learningcited by 3
- 2026Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoningcited by 1
- 2026AnnotateAnything: Automatic Annotation of 3D Assets for Robot Manipulationcited by 0
- 2026A Glimpse into Long-term Physical Coexistence with Intelligent Robotscited by 0
- 2026NebulaVLA: A Dual-Frequency Vision-Language-Action Model With Guide Action for Robotic Manipulationcited by 0
- 2026NebulaVLA: A Dual-Frequency Vision-Language-Action Model With Guide Action for Robotic Manipulation17 Aug 2026
- 2026A Glimpse into Long-term Physical Coexistence with Intelligent Robots13 Jul 2026
- 2026Towards Predictive, Aligned, and Scalable Robot Learning13 Jul 2026
- 2026Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoning6 Jul 2026
- 2026AnnotateAnything: Automatic Annotation of 3D Assets for Robot Manipulation16 Jun 2026
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation2 Jun 2026
- 2026Guide, Think, Act: Interactive Embodied Reasoning in Vision-Language-Action Models13 May 2026
- 2026CLAP: Contrastive Latent Action Pretraining for Learning Vision-Language-Action Models from Human Videos7 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Unified Embodied VLM Reasoning with Robotic Action via Autoregressive Discretized Pre-training
- 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoning
- 2025OneTwoVLA: A Unified Vision-Language-Action Model with Adaptive Reasoning
- 2025IntentionVLA: Generalizable and Efficient Embodied Intention Reasoning for Human-Robot Interaction
- 2026ReFineVLA: Multimodal Reasoning-Aware Generalist Robotic Policies via Teacher-Guided Fine-Tuning
- 2026Steerable Vision-Language-Action Policies for Embodied Reasoning and Hierarchical Control
- 2026PLanAR: Planning-Language-Grounded Agentic Reasoning for Robot Manipulation
- 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Tasks