mlsanityData to 7 Oct 2026

Training-free Controllable Human Motion Generation under Heterogeneous Constraints

arXiv 2607.01990 ↗First posted 2 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Training-free controllable motion generation has attracted growing interest for enabling flexible constraint enforcement without constraint-specific training. However, existing training-free methods require constraints to be continuous objective-based with differentiable losses, while many real-world requirements are criterion-based and provide only discontinuous, sparse, or even black-box feedback. In this paper, we propose Motion-Inference-as-Control (MIC), the first training-free motion generation framework that handles both continuous objective-based and criterion-based motion constraints under a shared mechanism. The key idea is to cast diffusion-based motion generation as a stochastic control problem. This perspective not only provides principled and practically effective step-wise control laws that support criterion-based constraints without requiring differentiability and naturally accommodate objective-based constraints as a special case, but also motivates a control-oriented constraint coordination mechanism that adaptively balances and reconciles motion constraints during generation. Experiments across diverse constraint settings demonstrate the effectiveness of our framework.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 59 of its 85 references that are in the map. First posted on arXiv 2 Jul 2026.

Builds on

59 of 85 references.

References · 59

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  3. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  4. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  5. 2022Human Motion Diffusion Modelcited by 1,062
  6. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  7. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  8. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  9. 2017Evolution Strategies as a Scalable Alternative to Reinforcement Learningcited by 555
  10. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
  11. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  12. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
38 more
  1. 2023Human Motion Diffusion as a Generative Priorcited by 354
  2. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
  3. 2024Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Controlcited by 222
  4. 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
  5. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  6. 2024Expressive Whole-Body Control for Humanoid Robotscited by 117
  7. 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 116
  8. 2023Controllable Human-Object Interaction Synthesiscited by 107
  9. 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 103
  10. 2022DiffPose: Toward More Reliable 3D Pose Estimationcited by 99
  11. 2023Optimizing Diffusion Noise Can Serve As Universal Motion Priorscited by 97
  12. 2023Human Motion Generation: A Surveycited by 95
  13. 2023EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generationcited by 88
  14. 2024Constrained Synthesis with Projected Diffusion Modelscited by 83
  15. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 78
  16. 2025Energy-Weighted Flow Matching for Offline Reinforcement Learningcited by 70
  17. 2024Symbolic Music Generation with Non-Differentiable Rule Guided Diffusioncited by 52
  18. 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 45
  19. 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesiscited by 37
  20. 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 32
  21. 2024Understanding and Improving Training-free Loss-based Diffusion Guidancecited by 31
  22. 2025MotionLab: Unified Human Motion Generation and Editing via the Motion-Condition-Motion Paradigmcited by 30
  23. 2022Embodied Scene-aware Human Pose Estimationcited by 28
  24. 2023Distribution-Aligned Diffusion for Human Mesh Recoverycited by 27
  25. 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Predictioncited by 26
  26. 2024ReinDiffuse: Crafting Physically Plausible Motions with Reinforced Diffusion Modelcited by 25
  27. 20236D-Diff: A Keypoint Diffusion Framework for 6D Object Pose Estimationcited by 24
  28. 2021Generative Adversarial Graph Convolutional Networks for Human Action Synthesiscited by 23
  29. 2025Variational Control for Guidance in Diffusion Modelscited by 22
  30. 2024Programmable Motion Generation for Open-Set Motion Control Taskscited by 20
  31. 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editingcited by 17
  32. 2024SoPo: Text-to-Motion Generation Using Semi-Online Preference Optimizationcited by 14
  33. 2025LongDiff: Training-Free Long Video Generation in One Gocited by 13
  34. 2024Morph: A Motion-free Physics Optimization Framework for Human Motion Generationcited by 12
  35. 2024InfiniDreamer: Arbitrarily Long Human Motion Generation via Segment Score Distillationcited by 12
  36. 2025ReAlign: Text-to-Motion Generation via Step-Aware Reward-Guided Alignmentcited by 10
  37. 2024Free2Guide: Training-Free Text-to-Video Alignment using Image LVLMcited by 9
  38. 2025Motion Synthesis with Sparse and Flexible Keyjoint Controlcited by 9

50 most cited of 59 All 59 (JSON)

Built on by

Not cited yet.