mlsanityData to 14 Oct 2026

SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Control

arXiv 2511.19236 ↗First posted 24 Nov 2025cs.RO cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Existing humanoid control systems often rely on teleoperation or modular generation pipelines that separate language understanding from physical execution. However, the former is entirely human-driven, and the latter lacks tight alignment between language commands and physical behaviors. In this paper, we present SENTINEL, a fully end-to-end language-action model for humanoid whole-body control. We construct a large-scale dataset by tracking human motions in simulation using a pretrained whole body controller, combined with their text annotations. The model directly maps language commands and proprioceptive inputs to low-level actions without any intermediate representation. The model generates action chunks using flow matching, which can be subsequently refined by a residual action head for real-world deployment. Our method exhibits strong semantic understanding and stable execution on humanoid robots in both simulation and real-world deployment, and also supports multi-modal extensions by converting inputs into texts.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 53 of its 66 references that are in the map. First posted on arXiv 24 Nov 2025.

Builds on

53 of 66 references.

References · 53

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  8. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  9. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  10. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  11. 2022Human Motion Diffusion Modelcited by 1,080
  12. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,061
38 more
  1. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  2. 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
  3. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  4. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  5. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
  6. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  7. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  8. 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
  9. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
  10. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
  11. 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 310
  12. 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 295
  13. 2018Residual Reinforcement Learning for Robot Controlcited by 274
  14. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
  15. 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 218
  16. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  17. 2023Object Motion Guided Human Motion Synthesiscited by 212
  18. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
  19. 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 189
  20. 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 185
  21. 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 165
  22. 2024Expressive Whole-Body Control for Humanoid Robotscited by 139
  23. 2024Learning Human-to-Humanoid Real-Time Whole-Body Teleoperationcited by 130
  24. 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 116
  25. 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 101
  26. 2024ExBody2: Advanced Expressive Humanoid Whole-Body Controlcited by 88
  27. 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 83
  28. 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 76
  29. 2024Policy Decorator: Model-Agnostic Online Refinement for Large Policy Modelcited by 70
  30. 20226D Rotation Representation For Unconstrained Head Pose Estimationcited by 64
  31. 2025AMO: Adaptive Motion Optimization for Hyper-Dexterous Humanoid Whole-Body Controlcited by 51
  32. 2025Humanoid-VLA: Towards Universal Humanoid Control with Visual Integrationcited by 45
  33. 2025LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instructioncited by 43
  34. 2025Motion-X++: A Large-Scale Multimodal 3D Whole-body Human Motion Datasetcited by 33
  35. 2024PDP: Physics-Based Character Animation via Diffusion Policycited by 31
  36. 2025Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Controlcited by 28
  37. 2025LangWBC: Language-directed Humanoid Whole-Body Control via End-to-end Learningcited by 22
  38. 2025From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robotscited by 17

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Commanding Humanoid by Free-form Language: A Large Language Action Model with Unified Motion Vocabulary
  2. 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructions
  3. 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation
  4. 2026Humanoid Loco-Manipulation With Discrete VLA Model
  5. 2024Grounding Language Models in Autonomous Loco-manipulation Tasks
  6. 2024Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions
  7. 2025From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidance
  8. 2026Opt2VLA: Force-Aware Vision-Language-Action for Contact-Rich Humanoid Whole-Body Manipulation