EquivDP3: A SIM(3)-Invariant Point-Cloud Encoder for Data-Efficient Humanoid Loco-Manipulation
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
Visuomotor policies for humanoid loco-manipulation must generalize across object poses and lighting from only a handful of demonstrations. 3D Diffusion Policy (DP3) conditions a diffusion-based action generator on point-cloud features, but its PointNet-style encoder has no built-in equivariance to the rotations, translations, and scalings (SIM(3)) that manipulation tasks respect. EquiBot closed this gap for wheeled manipulators with a SIM(3)-equivariant Vector Neuron Network (VNN) encoder. We extend this to a substantially more complex embodiment, the 43-joint Unitree G1 humanoid, and propose EquivDP3: a two-stage policy where a high-level diffusion planner with a SIM(3)-equivariant VNN encoder emits 6 Hz whole-body command chunks, executed at 50 Hz by a frozen, pre-trained RL locomotion policy and a differential inverse-kinematics module for the arms, trained end-to-end by behavior cloning. Across two simulated IsaacLab benchmarks and four non-equivariant baselines (5-100 demonstrations, in- and out-of-distribution), EquivDP3's advantage concentrates in the low-data regime: at 5-10 demonstrations it reaches 67.1% success versus 38.2-52.4% for the baselines, while by 50-100 all encoders converge (74.3-85.2%) and the ordering is no longer meaningful. A proprioception-only control confirms this gap is genuinely perceptual: with the point cloud removed, success drops to 31% vs. 60% (EquivDP3) at 5 demonstrations and 78% vs. 99% at 10, but vanishes by 50-100, showing the high-data plateau reflects a benchmark ceiling, not five encoders learning the same invariance. The encoder costs only 0.8 ms of extra latency per action chunk over the PointNet encoder it replaces. Baking geometric symmetry into a hierarchical diffusion policy's perception backbone is a practical, nearly free way to improve data efficiency for humanoid loco-manipulation when demonstrations are scarce.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 28 of its 33 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
28 of 33 references.
Closest ancestors · 7
Same direction, newest first
- 2026REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learning14 Mar
- 2024Generalizable Humanoid Manipulation with 3D Diffusion Policies14 Oct
- 2024Diffusion Policy Policy Optimization1 Sep
- 2024Equivariant Diffusion Policy1 Jul
- 2024EquiBot: SIM(3)-Equivariant Diffusion Policy for Generalizable and Data Efficient Learning1 Jul
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusion8 Sep
Other references · 21
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2016Layer Normalizationcited by 5,669
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2020PCT: Point cloud transformercited by 732
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 305
- 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 295
- 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 209
9 more
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 189
- 2021Provably Strict Generalisation Benefit for Equivariant Modelscited by 91
- 2024HOVER: Versatile Neural Whole-Body Controller for Humanoid Robotscited by 91
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 76
- 2022Equivariant Descriptor Fields: SE(3)-Equivariant Energy-Based Models for End-to-End Visual Robotic Manipulation Learningcited by 56
- 2022Equivariant Transporter Networkcited by 46
- 2025ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learningcited by 41
- 2023EquivAct: SIM(3)-Equivariant Visuomotor Policies beyond Rigid Object Manipulationcited by 37
- 2024Fourier Transporter: Bi-Equivariant Robotic Manipulation in 3Dcited by 33
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LEGS: Fine-Tuning Teleop-Free VLAs for Humanoid Loco-manipulation in an Embodied Gaussian Splatting World
- 2026PocketDP3: Efficient Pocket-Scale 3D Visuomotor Policy
- 2026SIMPLE: Simulation-Based Policy Learning and Evaluation for Humanoid Loco-manipulation
- 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulation
- 2026HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning
- 2026SplitAdapter: Load-Aware Humanoid Loco-Manipulation via Factorized Adaptation
- 2025Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfer
- 2025WholeBodyVLA: Towards Unified Latent VLA for Whole-Body Loco-Manipulation Control