Sim-to-Real Learning for Humanoid Box Loco-Manipulation
Not on the map. Why?
Abstract (arXiv)
In this work we propose a learning-based approach to box loco-manipulation for a humanoid robot. This is a particularly challenging problem due to the need for whole-body coordination in order to lift boxes of varying weight, position, and orientation while maintaining balance. To address this challenge, we present a sim-to-real reinforcement learning approach for training general box pickup and carrying skills for the bipedal robot Digit. Our reward functions are designed to produce the desired interactions with the box while also valuing balance and gait quality. We combine the learned skills into a full system for box loco-manipulation to achieve the task of moving boxes from one table to another with a variety of sizes, weights, and initial configurations. In addition to quantitative simulation results, we demonstrate successful sim-to-real transfer on the humanoid r
Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 Oct 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 11; 2025: 13; 2026: 12.
36 papers.
Sort:
By area:
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 185
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 139
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 72
- 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interactioncited by 71
- 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Controlcited by 51
- 2025Learning Humanoid Standing-up Control across Diverse Posturescited by 46
- 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementcited by 44
- 2025ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learningcited by 41
- 2025Learning coordinated badminton skills for legged manipulatorscited by 19
- 2025PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction Systemcited by 18
- 2025From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robotscited by 17
- 2024Learning Multi-Modal Whole-Body Control for Real-World Humanoid Robotscited by 16
24 more
- 2024Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimickingcited by 16
- 2025DemoHLM: From One Demonstration to Generalizable Humanoid Loco-Manipulationcited by 11
- 2024Helpful DoggyBot: Open-World Object Fetching using Legged Robots and Vision-Language Modelscited by 8
- 2024Deep Reinforcement Learning for Bipedal Locomotion: A Brief Surveycited by 7
- 2024Learn to Teach: Sample-Efficient Privileged Learning for Humanoid Locomotion over Diverse Terrainscited by 6
- 2026Accelerating and Scaling MPC-Guided Reinforcement Learning for Humanoid Locomotion and Manipulationcited by 3
- 2026PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeballcited by 3
- 2026REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learningcited by 2
- 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priorscited by 2
- 2026HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teacherscited by 2
- 2024Human-Humanoid Robots Cross-Embodiment Behavior-Skill Transfer Using Decomposed Adversarial Learning from Demonstrationcited by 1
- 2024Multi-Scenario Reasoning: Unlocking Cognitive Autonomy in Humanoid Robots for Multimodal Understandingcited by 1
- 2025Learning to Evaluate Autonomous Behaviour in Human-Robot Interactioncited by 1
- 2025HAFO: A Force-Adaptive Control Framework for Humanoid Robots in Intense Interaction Environmentscited by 1
- 2026AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimationcited by 1
- 2025Learning to Dock: A Simulation-based Study on Closing the Sim2Real Gap in Autonomous Underwater Dockingcited by 0
- 2025Stabilizing Humanoid Robot Trajectory Generation via Physics-Informed Learning and Control-Informed Steeringcited by 0
- 2025Kinematics-Aware Multi-Policy Reinforcement Learning for Force-Capable Humanoid Loco-Manipulationcited by 0
- 2026Learning Loco-Manipulation From SMPC Demonstrations With Sparse Offline-to-Online RLcited by 0
- 2026Learning Multi-Humanoid Pickup and Transport via Decentralized Object-Centric Controlcited by 0
- 2026Opt2VLA: Force-Aware Vision-Language-Action for Contact-Rich Humanoid Whole-Body Manipulationcited by 0
- 2026MASkillBlender: Decentralized Whole-Body Coordination for Multi-Humanoid Loco-Manipulation via Skill Blendingcited by 0
- 2026Humanoid Rickshaw Pulling: Whole-Body Locomotion under Coupled Wheeled Loadscited by 0
- 2026From Video to Vision: Learning Generalizable Humanoid Carrying from Human Motioncited by 0
- 2026From Video to Vision: Learning Generalizable Humanoid Carrying from Human Motion10 Oct 2026
- 2026Humanoid Rickshaw Pulling: Whole-Body Locomotion under Coupled Wheeled Loads3 Oct 2026
- 2026MASkillBlender: Decentralized Whole-Body Coordination for Multi-Humanoid Loco-Manipulation via Skill Blending1 Oct 2026
- 2026Opt2VLA: Force-Aware Vision-Language-Action for Contact-Rich Humanoid Whole-Body Manipulation21 Sep 2026
- 2026Learning Multi-Humanoid Pickup and Transport via Decentralized Object-Centric Control15 Sep 2026
- 2026Learning Loco-Manipulation From SMPC Demonstrations With Sparse Offline-to-Online RL12 Aug 2026
- 2026PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeball30 Jul 2026
- 2026HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teachers4 Jun 2026
- 2026Accelerating and Scaling MPC-Guided Reinforcement Learning for Humanoid Locomotion and Manipulation4 Jun 2026
- 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priors21 May 2026
- 2026REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learning14 Mar 2026
- 2026AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimation16 Feb 2026
24 more
- 2025Kinematics-Aware Multi-Policy Reinforcement Learning for Force-Capable Humanoid Loco-Manipulation26 Nov 2025
- 2025HAFO: A Force-Adaptive Control Framework for Humanoid Robots in Intense Interaction Environments25 Nov 2025
- 2025DemoHLM: From One Demonstration to Generalizable Humanoid Loco-Manipulation13 Oct 2025
- 2025PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction System13 Oct 2025
- 2025ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learning6 Oct 2025
- 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interaction30 Sep 2025
- 2025Stabilizing Humanoid Robot Trajectory Generation via Physics-Informed Learning and Control-Informed Steering29 Sep 2025
- 2025Learning to Evaluate Autonomous Behaviour in Human-Robot Interaction8 Jul 2025
- 2025Learning to Dock: A Simulation-based Study on Closing the Sim2Real Gap in Autonomous Underwater Docking21 Jun 2025
- 2025From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robots15 Jun 2025
- 2025Learning coordinated badminton skills for legged manipulators29 May 2025
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactions27 Feb 2025
- 2025Learning Humanoid Standing-up Control across Diverse Postures12 Feb 2025
- 2024Multi-Scenario Reasoning: Unlocking Cognitive Autonomy in Humanoid Robots for Multimodal Understanding29 Dec 2024
- 2024Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimicking23 Dec 2024
- 2024Human-Humanoid Robots Cross-Embodiment Behavior-Skill Transfer Using Decomposed Adversarial Learning from Demonstration19 Dec 2024
- 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Control10 Dec 2024
- 2024Helpful DoggyBot: Open-World Object Fetching using Legged Robots and Vision-Language Models30 Sep 2024
- 2024Learning Multi-Modal Whole-Body Control for Real-World Humanoid Robots30 Jul 2024
- 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangement27 Jun 2024
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humans15 Jun 2024
- 2024Deep Reinforcement Learning for Bipedal Locomotion: A Brief Survey25 Apr 2024
- 2024Expressive Whole-Body Control for Humanoid Robots26 Feb 2024
- 2024Learn to Teach: Sample-Efficient Privileged Learning for Humanoid Locomotion over Diverse Terrains9 Feb 2024
- 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interactioncited by 71
- 2025Learning coordinated badminton skills for legged manipulatorscited by 19
- 2024Deep Reinforcement Learning for Bipedal Locomotion: A Brief Surveycited by 7
- 2026Accelerating and Scaling MPC-Guided Reinforcement Learning for Humanoid Locomotion and Manipulationcited by 3
- 2025HAFO: A Force-Adaptive Control Framework for Humanoid Robots in Intense Interaction Environmentscited by 1
- 2025Kinematics-Aware Multi-Policy Reinforcement Learning for Force-Capable Humanoid Loco-Manipulationcited by 0
- 2026MASkillBlender: Decentralized Whole-Body Coordination for Multi-Humanoid Loco-Manipulation via Skill Blendingcited by 0
- 2026From Video to Vision: Learning Generalizable Humanoid Carrying from Human Motioncited by 0
- 2026From Video to Vision: Learning Generalizable Humanoid Carrying from Human Motion10 Oct 2026
- 2026MASkillBlender: Decentralized Whole-Body Coordination for Multi-Humanoid Loco-Manipulation via Skill Blending1 Oct 2026
- 2026Accelerating and Scaling MPC-Guided Reinforcement Learning for Humanoid Locomotion and Manipulation4 Jun 2026
- 2025Kinematics-Aware Multi-Policy Reinforcement Learning for Force-Capable Humanoid Loco-Manipulation26 Nov 2025
- 2025HAFO: A Force-Adaptive Control Framework for Humanoid Robots in Intense Interaction Environments25 Nov 2025
- 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interaction30 Sep 2025
- 2025Learning coordinated badminton skills for legged manipulators29 May 2025
- 2024Deep Reinforcement Learning for Bipedal Locomotion: A Brief Survey25 Apr 2024
- 2025Learning to Evaluate Autonomous Behaviour in Human-Robot Interactioncited by 1
- 2026AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimationcited by 1
- 2025Stabilizing Humanoid Robot Trajectory Generation via Physics-Informed Learning and Control-Informed Steeringcited by 0
- 2026Learning Loco-Manipulation From SMPC Demonstrations With Sparse Offline-to-Online RLcited by 0
- 2026Learning Loco-Manipulation From SMPC Demonstrations With Sparse Offline-to-Online RL12 Aug 2026
- 2026AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimation16 Feb 2026
- 2025Stabilizing Humanoid Robot Trajectory Generation via Physics-Informed Learning and Control-Informed Steering29 Sep 2025
- 2025Learning to Evaluate Autonomous Behaviour in Human-Robot Interaction8 Jul 2025
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 185
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 139
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 72
- 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Controlcited by 51
- 2025Learning Humanoid Standing-up Control across Diverse Posturescited by 46
- 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementcited by 44
- 2025ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learningcited by 41
- 2025PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction Systemcited by 18
- 2025From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robotscited by 17
- 2024Learning Multi-Modal Whole-Body Control for Real-World Humanoid Robotscited by 16
- 2024Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimickingcited by 16
- 2025DemoHLM: From One Demonstration to Generalizable Humanoid Loco-Manipulationcited by 11
12 most cited of 21 All 21 (JSON)
- 2026Humanoid Rickshaw Pulling: Whole-Body Locomotion under Coupled Wheeled Loads3 Oct 2026
- 2026Learning Multi-Humanoid Pickup and Transport via Decentralized Object-Centric Control15 Sep 2026
- 2026PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeball30 Jul 2026
- 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priors21 May 2026
- 2025DemoHLM: From One Demonstration to Generalizable Humanoid Loco-Manipulation13 Oct 2025
- 2025PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction System13 Oct 2025
- 2025ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learning6 Oct 2025
- 2025Learning to Dock: A Simulation-based Study on Closing the Sim2Real Gap in Autonomous Underwater Docking21 Jun 2025
- 2025From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robots15 Jun 2025
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactions27 Feb 2025
- 2025Learning Humanoid Standing-up Control across Diverse Postures12 Feb 2025
- 2024Multi-Scenario Reasoning: Unlocking Cognitive Autonomy in Humanoid Robots for Multimodal Understanding29 Dec 2024
12 newest of 21 All 21 (JSON)