mlsanityData to 14 Oct 2026

Hierarchical Planning and Control for Box Loco-Manipulation

arXiv 2306.09532 ↗First posted 15 Jun 2023cs.RO cs.GRcited by 44

Not on the map. Why?

Abstract (arXiv)

Humans perform everyday tasks using a combination of locomotion and manipulation skills. Building a system that can handle both skills is essential to creating virtual humans. We present a physically-simulated human capable of solving box rearrangement tasks, which requires a combination of both skills. We propose a hierarchical control architecture, where each level solves the task at a different level of abstraction, and the result is a physics-based simulated virtual human capable of rearranging boxes in a cluttered environment. The control architecture integrates a planner, diffusion models, and physics-based motion imitation of sparse motion clips using deep reinforcement learning. Boxes can vary in size, weight, shape, and placement height. Code and trained control policies are provided.

Key facts. Cited by 44 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Jun 2023.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 6; 2024: 13; 2025: 13; 2026: 12.

44 papers.

Sort:

By area:

  1. 2023Object Motion Guided Human Motion Synthesiscited by 212
  2. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 182
  3. 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 138
  4. 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulationcited by 112
  5. 2023Controllable Human-Object Interaction Synthesiscited by 109
  6. 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 109
  7. 2023PhysHOI: Physics-Based Imitation of Dynamic Human-Object Interactioncited by 76
  8. 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 72
  9. 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 64
  10. 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 51
  11. 2023Synthesizing Physically Plausible Human Motions in 3D Scenescited by 49
  12. 2024THOR: Text to Human-Object Interaction Diffusion via Relation Interventioncited by 46
32 more
  1. 2024CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamicscited by 44
  2. 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementcited by 44
  3. 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generationcited by 32
  4. 2025Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Controlcited by 28
  5. 2024ZeroHSI: Zero-Shot 4D Human-Scene Interaction by Video Generationcited by 25
  6. 2025Guiding Human-Object Interactions with Rich Geometry and Relationscited by 24
  7. 2025ChainHOI: Joint-based Kinematic Chain Modeling for Human-Object Interaction Generationcited by 20
  8. 2025PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction Systemcited by 18
  9. 2024Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimickingcited by 16
  10. 2024SIMS: Simulating Stylized Human-Scene Interactions with Retrieval-Augmented Script Generationcited by 12
  11. 2025Human-Object Interaction via Automatically Designed VLM-Guided Motion Policycited by 12
  12. 2026InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactionscited by 11
  13. 2024F"urElise: Capturing and Physically Synthesizing Hand Motions of Piano Performancecited by 10
  14. 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulationcited by 10
  15. 2024FORCE: Physics-aware Human-object Interactioncited by 7
  16. 2025Learning to Ball: Composing Policies for Long-Horizon Basketball Movescited by 6
  17. 2025Emergent Active Perception and Dexterity of Simulated Humanoids from Visual Reinforcement Learningcited by 5
  18. 2026TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Sizecited by 5
  19. 2025Separate to Collaborate: Dual-Stream Diffusion Model for Coordinated Piano Hand Motion Synthesiscited by 4
  20. 2024COLLAGE: Collaborative Human-Agent Interaction Generation using Hierarchical Latent Diffusion and Language Modelscited by 3
  21. 2024SMGDiff: Soccer Motion Generation using diffusion probabilistic modelscited by 3
  22. 2025Humanoid Agent via Embodied Chain-of-Action Reasoning with Multimodal Foundation Models for Zero-Shot Loco-Manipulationcited by 3
  23. 2026ViHOI: Human-Object Interaction Synthesis with Visual Priorscited by 3
  24. 2026REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learningcited by 2
  25. 2026DeVI: Physics-based Dexterous Human-Object Interaction via Synthetic Video Imitationcited by 1
  26. 2026MUSIC: Learning Muscle-Driven Dexterous Hand Controlcited by 1
  27. 2026InterPhys: Physics-aware Human Motion Synthesis in a Dynamic Scenecited by 1
  28. 2025LHM-Humanoid: Long-Horizon Human Motion Control for Continuous Object Transport in Cluttered Scenescited by 0
  29. 2026Robo-Saber: Generating and Simulating Virtual Reality Playerscited by 0
  30. 2026Learn Weightlessness: Imitate Non-Self-Stabilizing Motions on Humanoid Robotcited by 0
  31. 2026MaMi-HOI: Harmonizing Global Kinematics and Local Geometry for Human-Object Interaction Generationcited by 0
  32. 2026Scalable Multi-Human Cooperative Manipulation via Commander-Executor Coordinationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Deep Imitation Learning for Humanoid Loco-manipulation through Human Teleoperation
  2. 2024HYPERmotion: Learning Hybrid Behavior Planning for Autonomous Loco-manipulation
  3. 2026MetaWorld-X: Hierarchical World Modeling via VLM-Orchestrated Experts for Humanoid Loco-Manipulation
  4. 2026FetchMan: Learning Visual Humanoid Loco-Manipulation Policies from Simulated Experiences
  5. 2026LUCID: Latent-Skill Unified Control via Imagined Dynamics for Long-Horizon Humanoid Loco-Manipulation
  6. 2025SkillBlender: Towards Versatile Humanoid Whole-Body Loco-Manipulation via Skill Blending
  7. 2026KINO: A Keyframe Interface for VLM Planning and Whole-Body Control in Humanoid Loco-Manipulation ↗
  8. 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation