mlsanityData to 7 Oct 2026

PredActor: Predictive Action Diffusion for Steerable Onboard Humanoid Control

arXiv 2609.24840 ↗First posted 21 Sep 2026cs.RO cs.LGcited by 0

On the map: Diffusion models → Diffusion and flow policies for robotics

Abstract (arXiv)

Diffusion models provide a flexible framework for motion generation, but turning this flexibility into closed-loop humanoid control remains challenging. Hierarchical generator-tracker systems steer motion through reference trajectories, yet these references may exceed the capabilities of the downstream tracker, leaving physical feasibility and disturbance recovery largely to a separate control module. Action-only diffusion avoids this separation by directly generating executable actions, but provides no explicit future-state trajectory that can be steered toward test-time motion objectives. Joint state-action diffusion offers a natural alternative, but existing controllers often rely on privileged full-body states, while learned behavior selection and test-time motion steering remain only partially integrated. We present PredActor, a predictive action diffusion policy that unifies both steering modes in one directly executed policy using proprioception alone. Given proprioceptive history and optional task context, PredActor jointly predicts actions and an internal future-state trajectory that enables guidance: classifier-free guidance strengthens text-conditioned motion, while classifier guidance steers future states toward test-time objectives. Only actions are executed, requiring neither a motion-reference tracker nor privileged full-body states. In simulation, PredActor reaches 44 of 45 destination targets and achieves a text retrieval score of 0.539 versus 0.424 for conditional action diffusion, with similar disturbance survival. Rolling denoising and computation-preserving runtime optimizations reduce the complete callback to 16.790 ms median and 19.383 ms p95 on a Jetson Orin NX, within the 20 ms control period. Deployed on a Unitree G1, PredActor demonstrates text-conditioned motion, disturbance response, joystick control, and semantic interpolation in simulation and hardware.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 48 of its 55 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

48 of 55 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026SCRIPT: Scalable Diffusion Policy with Multi-stage Training for Language-driven Physics-Based Humanoid Control21 May
  2. 2026REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learning14 Mar
  3. 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusion11 Aug
  4. 2025Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Control14 Mar
  5. 2025Falcon: Fast Visuomotor Policies via Partial Denoising1 Mar
  6. 2024Diffusion Predictive Control with Constraints12 Dec
  7. 2024One-Step Diffusion Policy: Fast Visuomotor Policies via Diffusion Distillation28 Oct
  8. 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character control4 Oct
  9. 2024Diffusion Policy Policy Optimization1 Sep
  10. 2024Streaming Diffusion Policy: Fast Policy Synthesis with Variable Noise Diffusion Models7 Jun
  11. 2024PDP: Physics-Based Character Animation via Diffusion Policy3 Jun
  12. 2024Consistency Policy: Accelerated Visuomotor Policies via Consistency Distillation13 May
2 more
  1. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
  2. 2022Is Conditional Generative Modeling all you need for Decision-Making?28 Nov

Other references · 34

  1. 2020Denoising Diffusion Implicit Modelscited by 9,655
  2. 2022Classifier-Free Diffusion Guidancecited by 5,717
  3. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  4. 2023Consistency Modelscited by 1,778
  5. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  6. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  7. 2022Human Motion Diffusion Modelcited by 1,062
  8. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
  9. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  10. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
  11. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
  12. 2018HG-DAgger: Interactive Imitation Learning with Human Expertscited by 245
22 more
  1. 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 198
  2. 2017DART: Noise Injection for Robust Imitation Learningcited by 187
  3. 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
  4. 2024Learning Human-to-Humanoid Real-Time Whole-Body Teleoperationcited by 112
  5. 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulationcited by 101
  6. 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 101
  7. 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 86
  8. 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
  9. 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesiscited by 48
  10. 2024DiffuseLoco: Real-Time Legged Locomotion Control with Diffusion from Offline Datasetscited by 47
  11. 2025CLONE: Closed-Loop Whole-Body Humanoid Teleoperation for Long-Horizon Taskscited by 35
  12. 2025BFM-Zero: A Promptable Behavioral Foundation Model for Humanoid Control Using Unsupervised Reinforcement Learningcited by 33
  13. 2025Track Any Motions under Any Disturbancescited by 32
  14. 2025UniPhys: Unified Planner and Controller with Diffusion for Flexible Physics-Based Character Controlcited by 24
  15. 2025LangWBC: Language-directed Humanoid Whole-Body Control via End-to-end Learningcited by 19
  16. 2025From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidancecited by 17
  17. 2023H-GAP: Humanoid Control with a Generalist Plannercited by 11
  18. 2026HoloMotion-1 Technical Reportcited by 8
  19. 2025SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Controlcited by 7
  20. 2026MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart Primitivescited by 5
  21. 2026ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generationcited by 5
  22. 2026ReactiveBFM: Reactive Closed-Loop Motion Planning Towards Universal Humanoid Whole-Body Controlcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SCDP: Learning Humanoid Locomotion from Partial Observations via Mixed-Observation Distillation
  2. 2025Enhancing Diffusion Policy with Classifier-Free Guidance for Temporal Robotic Tasks
  3. 2026Heracles: Bridging Precise Tracking and Generative Synthesis for General Humanoid Control
  4. 2026ADAPT: Agile Diffusion Action Priors for Robust and Steerable Online Text-Driven Humanoid Control ↗
  5. 2024The Role of Domain Randomization in Training Diffusion Policies for Whole-Body Humanoid Control
  6. 2024WARPD: World model Assisted Reactive Policy Diffusion
  7. 2025Efficient Task-specific Conditional Diffusion Policies: Shortcut Model Acceleration and SO(3) Optimization
  8. 2026FODMP: Fast One-Step Diffusion of Movement Primitives Generation for Time-Dependent Robot Actions