mlsanityData to 14 Oct 2026

WANDR: Intention-guided Human Motion Generation

arXiv 2404.15383 ↗First posted 23 Apr 2024cs.CV cs.AIcited by 26

Not on the map. Why?

Abstract (arXiv)

Synthesizing natural human motions that enable a 3D human avatar to walk and reach for arbitrary goals in 3D space remains an unsolved problem with many applications. Existing methods (data-driven or using reinforcement learning) are limited in terms of generalization and motion naturalness. A primary obstacle is the scarcity of training data that combines locomotion with goal reaching. To address this, we introduce WANDR, a data-driven model that takes an avatar's initial pose and a goal's 3D position and generates natural human motions that place the end effector (wrist) on the goal location. To solve this, we introduce novel intention features that drive rich goal-oriented movement. Intention guides the agent to the goal, and interactively adapts the generation to novel situations without needing to define sub-goals or the entire motion path. Crucially, intention allows training on datasets that have goal-oriented motions as well as those that do not. WANDR is a conditional Variational Auto-Encoder (c-VAE), which we train using the AMASS and CIRCLE datasets. We evaluate our method extensively and demonstrate its ability to generate natural and long-term motions that reach 3D goals and generalize to unseen goal locations. Our models and code are available for research purposes at wandr.is.tue.mpg.de.

Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 32 of its 49 references that are in the map. First posted on arXiv 23 Apr 2024.

Builds on

32 of 49 references.

References · 32

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  3. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  4. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  5. 2022Human Motion Diffusion Modelcited by 1,080
  6. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  7. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
  8. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 405
  9. 2019Learning joint reconstruction of hands and manipulated objectscited by 378
  10. 2017On human motion prediction using recurrent neural networkscited by 338
  11. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
  12. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
20 more
  1. 2021Stochastic Scene-Aware Motion Predictioncited by 203
  2. 2020Long-term Human Motion Prediction with Scene Contextcited by 192
  3. 2021Character Controllers Using Motion VAEscited by 184
  4. 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 180
  5. 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 144
  6. 2022COUCH: Towards Controllable Human-Chair Interactionscited by 135
  7. 2020A Spatio-temporal Transformer for 3D Human Motion Predictioncited by 133
  8. 2023Synthesizing Diverse Human Motions in 3D Indoor Scenescited by 109
  9. 2023Synthesizing Physical Character-Scene Interactionscited by 104
  10. 2022GIMO: Gaze-Informed Human Motion Prediction in Contextcited by 81
  11. 2023CIRCLE: Capture In Rich Contextual Environmentscited by 79
  12. 2022ActFormer: A GAN-based Transformer towards General Action-Conditioned 3D Human Motion Generationcited by 77
  13. 2017Learning Human Motion Models for Long-term Predictionscited by 67
  14. 2021The Wanderings of Odysseus in 3D Scenescited by 59
  15. 2023Physically Plausible Full-Body Hand-Object Interaction Synthesiscited by 52
  16. 2019Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Predictioncited by 47
  17. 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 46
  18. 2023Generating Continual Human Motion in Diverse 3D Scenescited by 39
  19. 2020Structure-Aware Human-Action Generationcited by 28
  20. 2023GRIP: Generating Interaction Poses Using Spatial Cues and Latent Consistencycited by 27

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 15; 2026: 7.

26 papers.

Sort:

By area:

  1. 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesiscited by 38
  2. 2025ChainHOI: Joint-based Kinematic Chain Modeling for Human-Object Interaction Generationcited by 20
  3. 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editingcited by 18
  4. 2025PRIMAL: Physically Reactive and Interactive Motor Model for Avatar Learningcited by 14
  5. 2024SCENIC: Scene-aware Semantic Navigation with Instruction-guided Controlcited by 13
  6. 2025Physical Plausibility-aware Trajectory Prediction via Locomotion Embodimentcited by 10
  7. 2025Progressive Human Motion Generation Based on Text and Few Motion Framescited by 8
  8. 2025Motion Generation: A Survey of Generative Approaches and Benchmarkscited by 8
  9. 20243D Whole-body Grasp Synthesis with Directional Controllabilitycited by 6
  10. 2026ProjFlow: Projection Sampling with Flow Matching for Zero-Shot Exact Spatial Motion Controlcited by 5
  11. 2025Moving by Looking: Towards Vision-Driven Avatar Motion Generationcited by 4
  12. 2026MotionHiFlow: Text-to-motion via hierarchical flow matchingcited by 4
14 more
  1. 2025SIGHT: Synthesizing Image-Text Conditioned and Geometry-Guided 3D Hand-Object Trajectoriescited by 3
  2. 2025JAX-IK: Real-Time Inverse Kinematics for Generating Multi-Constrained Movements of Virtual Human Characterscited by 1
  3. 2025Grounding Intelligence in Movementcited by 1
  4. 2025ScanMove: Motion Prediction and Transfer for Unregistered Body Meshescited by 1
  5. 2025Controllable Long-term Motion Generation with Extended Joint Targetscited by 1
  6. 2025Prime and Reach: Synthesising Body Motion for Gaze-Primed Object Reachcited by 1
  7. 2026FUSION: Full-Body Unified Motion Prior for Body and Hands via Diffusioncited by 1
  8. 20253HANDS Dataset: Learning from Humans for Generating Naturalistic Handovers with Supernumerary Robotic Limbscited by 0
  9. 2025One-shot Adaptation of Humanoid Whole-body Motion with Walking Priorscited by 0
  10. 2025A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniquescited by 0
  11. 2026Multi-scale Coarse-to-fine Modeling for Test-time Human Motion Controlcited by 0
  12. 2026DCGrasp: Distance-aware Controllable Grasp Generationcited by 0
  13. 2026Generative Embodied Multiple Behavior Control Systems for Human-like Agentscited by 0
  14. 2026Generative Interactions: Weaving Multiparty Human Motion with Bilevel Latent Dynamicscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Deep Sensorimotor Control by Imitating Predictive Models of Human Motion
  2. 2026GazeVLA: Learning Human Intention for Robotic Manipulation
  3. 2022PoseGPT: Quantization-based 3D Human Motion Generation and Forecasting
  4. 2025Human-Object Interaction via Automatically Designed VLM-Guided Motion Policy
  5. 2026V-Dreamer: Automating Robotic Simulation and Trajectory Synthesis via Video Generation Priors
  6. 2023Controllable Human-Object Interaction Synthesis
  7. 2025Physically-Grounded Goal Imagination: Physics-Informed Variational Autoencoder for Self-Supervised Reinforcement Learning
  8. 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesis