SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Control
Not on the map. Why?
Abstract (arXiv)
Existing humanoid control systems often rely on teleoperation or modular generation pipelines that separate language understanding from physical execution. However, the former is entirely human-driven, and the latter lacks tight alignment between language commands and physical behaviors. In this paper, we present SENTINEL, a fully end-to-end language-action model for humanoid whole-body control. We construct a large-scale dataset by tracking human motions in simulation using a pretrained whole body controller, combined with their text annotations. The model directly maps language commands and proprioceptive inputs to low-level actions without any intermediate representation. The model generates action chunks using flow matching, which can be subsequently refined by a residual action head for real-world deployment. Our method exhibits strong semantic understanding and stable execution on humanoid robots in both simulation and real-world deployment, and also supports multi-modal extensions by converting inputs into texts.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 53 of its 66 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
53 of 66 references.
References · 53
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2022Human Motion Diffusion Modelcited by 1,080
- 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,061
38 more
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
- 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 310
- 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 295
- 2018Residual Reinforcement Learning for Robot Controlcited by 274
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 218
- 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
- 2023Object Motion Guided Human Motion Synthesiscited by 212
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 189
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 185
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 165
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 139
- 2024Learning Human-to-Humanoid Real-Time Whole-Body Teleoperationcited by 130
- 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 116
- 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 101
- 2024ExBody2: Advanced Expressive Humanoid Whole-Body Controlcited by 88
- 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 83
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 76
- 2024Policy Decorator: Model-Agnostic Online Refinement for Large Policy Modelcited by 70
- 20226D Rotation Representation For Unconstrained Head Pose Estimationcited by 64
- 2025AMO: Adaptive Motion Optimization for Hyper-Dexterous Humanoid Whole-Body Controlcited by 51
- 2025Humanoid-VLA: Towards Universal Humanoid Control with Visual Integrationcited by 45
- 2025LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instructioncited by 43
- 2025Motion-X++: A Large-Scale Multimodal 3D Whole-body Human Motion Datasetcited by 33
- 2024PDP: Physics-Based Character Animation via Diffusion Policycited by 31
- 2025Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Controlcited by 28
- 2025LangWBC: Language-directed Humanoid Whole-Body Control via End-to-end Learningcited by 22
- 2025From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robotscited by 17
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2026ECHO: Edge-Cloud Humanoid Orchestration for Language-to-Motion Controlcited by 4
- 2026PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Trackingcited by 2
- 2026MIND: Multi-Scale Intent Diffusion for Text-Driven Physics-Based Humanoid Controlcited by 1
- 2026WOLF-VLA: Whole-Body Humanoid Optimal Locomotion Framework for Vision-Language-Action Learningcited by 1
- 2026NaP-Control: Navigating Diffusion Prior for Versatile and Fast Character Controlcited by 0
- 2026PredActor: Predictive Action Diffusion for Steerable Onboard Humanoid Controlcited by 0
- 2026PredActor: Predictive Action Diffusion for Steerable Onboard Humanoid Control21 Sep 2026
- 2026WOLF-VLA: Whole-Body Humanoid Optimal Locomotion Framework for Vision-Language-Action Learning24 Jun 2026
- 2026MIND: Multi-Scale Intent Diffusion for Text-Driven Physics-Based Humanoid Control25 May 2026
- 2026NaP-Control: Navigating Diffusion Prior for Versatile and Fast Character Control15 Apr 2026
- 2026ECHO: Edge-Cloud Humanoid Orchestration for Language-to-Motion Control17 Mar 2026
- 2026PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Tracking13 Mar 2026
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Control7 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Commanding Humanoid by Free-form Language: A Large Language Action Model with Unified Motion Vocabulary
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructions
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation
- 2026Humanoid Loco-Manipulation With Discrete VLA Model
- 2024Grounding Language Models in Autonomous Loco-manipulation Tasks
- 2024Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions
- 2025From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidance
- 2026Opt2VLA: Force-Aware Vision-Language-Action for Contact-Rich Humanoid Whole-Body Manipulation