mlsanityData to 14 Oct 2026

LHM-Humanoid: Long-Horizon Human Motion Control for Continuous Object Transport in Cluttered Scenes

arXiv 2508.16943 ↗First posted 23 Aug 2025cs.RO cs.AIcited by 0

On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation

Abstract (arXiv)

Physics-based human motion control can make a simulated character walk, sit, and manipulate objects with high physical realism. Almost always, though, this happens in short, isolated clips that are re-initialized between interactions. We instead aim for continuous, reset-free long-horizon motion: a physically simulated humanoid that repeatedly walks to a displaced object, lifts it with a balanced whole-body posture, carries it past obstacles, and places it at a goal, over and over within a single uninterrupted take. The hard part is not any individual motion but the transitions between them. Without a reset, each cycle must end in a state that both leaves the object just placed undisturbed and lets the next cycle begin, yet every placement leaves the character off-balance in a non-canonical pose where naive end-to-end reinforcement learning fails. Our key idea is to treat this handoff as a two-sided problem of recoverability: the character must disengage from the object it just placed so the prior success is preserved, and settle into a state from which a balanced continuation exists. Instead of engineering a transition by hand, we learn to shape where each cycle ends so that it lands in this recoverable region. We introduce LHM-Humanoid. One goal-conditioned controller completes a fetch--carry--place cycle and, through a learned release-and-retreat behavior, steers its terminal state into this region; a second controller then takes over from the resulting state distribution. Both are regularized by an adversarial motion prior and distilled into a single goal-conditioned policy that runs the whole sequence as one reset-free rollout. Across 350 cluttered layouts spanning four room types, LHM-Humanoid produces far more successful and stable long-horizon motion than end-to-end RL, hierarchical RL, and prior physics-based human-scene-interaction methods, on both seen and unseen scenes.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 35 of its 49 references that are in the map. First posted on arXiv 23 Aug 2025.

Builds on

35 of 49 references.

References · 35

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  2. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  3. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  4. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
  5. 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 239
  6. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
  7. 2023TidyBot: Personalized Robot Assistance with Large Language Modelscited by 221
  8. 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 218
  9. 2023Object Motion Guided Human Motion Synthesiscited by 212
  10. 2021Stochastic Scene-Aware Motion Predictioncited by 203
  11. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
  12. 2024Scaling Up Dynamic Human-Scene Interaction Modelingcited by 137
23 more
  1. 2025Unified Vision-Language-Action Modelcited by 134
  2. 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulationcited by 112
  3. 2023Synthesizing Diverse Human Motions in 3D Indoor Scenescited by 109
  4. 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 106
  5. 2023Synthesizing Physical Character-Scene Interactionscited by 104
  6. 2021Visual Room Rearrangementcited by 102
  7. 2023CALM: Conditional Adversarial Latent Models for Directable Virtual Characterscited by 94
  8. 2023Unified Human-Scene Interaction via Prompted Chain-of-Contactscited by 94
  9. 2022Compositional Human-Scene Interaction Synthesis with Semantic Controlcited by 83
  10. 2023PhysHOI: Physics-Based Imitation of Dynamic Human-Object Interactioncited by 76
  11. 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 72
  12. 2023MoConVQ: Unified Physics-Based Motion Control via Scalable Discrete Representationscited by 60
  13. 2023C·ASE: Learning Conditional Adversarial Skill Embeddings for Physics-based Characterscited by 55
  14. 2023Physically Plausible Full-Body Hand-Object Interaction Synthesiscited by 52
  15. 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 51
  16. 2023Synthesizing Physically Plausible Human Motions in 3D Scenescited by 49
  17. 2023PADL: Language-Directed Physics-Based Character Controlcited by 48
  18. 2025Humanoid-VLA: Towards Universal Humanoid Control with Visual Integrationcited by 45
  19. 2023Hierarchical Planning and Control for Box Loco-Manipulationcited by 44
  20. 2023Neural Categorical Priors for Physics-Based Character Controlcited by 38
  21. 2024AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agentscited by 32
  22. 2022Learning to Use Chopsticks in Diverse Gripping Stylescited by 29
  23. 2024HumanVLA: Towards Vision-Language Directed Object Rearrangement by Physical Humanoidcited by 19

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026HOTICE: Whole-Body Humanoid Object Transportation in Cluttered Environments ↗
  2. 2025DreamControl: Human-Inspired Whole-Body Humanoid Control for Scene Interaction via Guided Diffusion
  3. 2026PASSAGE: Scaling Scene-Aligned Motion Learning for Perceptive Humanoid Traversal in Cluttered Environments ↗
  4. 2026PhysMoDPO: Physically-Plausible Humanoid Motion with Preference Optimization
  5. 2024Expressive Whole-Body Control for Humanoid Robots
  6. 2024I-CTRL: Imitation to Control Humanoid Robots Through Constrained Reinforcement Learning
  7. 2025PhysHMR: Learning Humanoid Control Policies from Vision for Physically Plausible Human Motion Reconstruction
  8. 2026FetchMan: Learning Visual Humanoid Loco-Manipulation Policies from Simulated Experiences