WANDR: Intention-guided Human Motion Generation
Not on the map. Why?
Abstract (arXiv)
Synthesizing natural human motions that enable a 3D human avatar to walk and reach for arbitrary goals in 3D space remains an unsolved problem with many applications. Existing methods (data-driven or using reinforcement learning) are limited in terms of generalization and motion naturalness. A primary obstacle is the scarcity of training data that combines locomotion with goal reaching. To address this, we introduce WANDR, a data-driven model that takes an avatar's initial pose and a goal's 3D position and generates natural human motions that place the end effector (wrist) on the goal location. To solve this, we introduce novel intention features that drive rich goal-oriented movement. Intention guides the agent to the goal, and interactively adapts the generation to novel situations without needing to define sub-goals or the entire motion path. Crucially, intention allows training on datasets that have goal-oriented motions as well as those that do not. WANDR is a conditional Variational Auto-Encoder (c-VAE), which we train using the AMASS and CIRCLE datasets. We evaluate our method extensively and demonstrate its ability to generate natural and long-term motions that reach 3D goals and generalize to unseen goal locations. Our models and code are available for research purposes at wandr.is.tue.mpg.de.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 32 of its 49 references that are in the map. First posted on arXiv 23 Apr 2024.
Builds on
32 of 49 references.
References · 32
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2022Human Motion Diffusion Modelcited by 1,080
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
- 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 405
- 2019Learning joint reconstruction of hands and manipulated objectscited by 378
- 2017On human motion prediction using recurrent neural networkscited by 338
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
- 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
20 more
- 2021Stochastic Scene-Aware Motion Predictioncited by 203
- 2020Long-term Human Motion Prediction with Scene Contextcited by 192
- 2021Character Controllers Using Motion VAEscited by 184
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 180
- 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 144
- 2022COUCH: Towards Controllable Human-Chair Interactionscited by 135
- 2020A Spatio-temporal Transformer for 3D Human Motion Predictioncited by 133
- 2023Synthesizing Diverse Human Motions in 3D Indoor Scenescited by 109
- 2023Synthesizing Physical Character-Scene Interactionscited by 104
- 2022GIMO: Gaze-Informed Human Motion Prediction in Contextcited by 81
- 2023CIRCLE: Capture In Rich Contextual Environmentscited by 79
- 2022ActFormer: A GAN-based Transformer towards General Action-Conditioned 3D Human Motion Generationcited by 77
- 2017Learning Human Motion Models for Long-term Predictionscited by 67
- 2021The Wanderings of Odysseus in 3D Scenescited by 59
- 2023Physically Plausible Full-Body Hand-Object Interaction Synthesiscited by 52
- 2019Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Predictioncited by 47
- 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 46
- 2023Generating Continual Human Motion in Diverse 3D Scenescited by 39
- 2020Structure-Aware Human-Action Generationcited by 28
- 2023GRIP: Generating Interaction Poses Using Spatial Cues and Latent Consistencycited by 27
Built on by
Citing papers per year: 2024: 4; 2025: 15; 2026: 7.
26 papers.
Sort:
By area:
- 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesiscited by 38
- 2025ChainHOI: Joint-based Kinematic Chain Modeling for Human-Object Interaction Generationcited by 20
- 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editingcited by 18
- 2025PRIMAL: Physically Reactive and Interactive Motor Model for Avatar Learningcited by 14
- 2024SCENIC: Scene-aware Semantic Navigation with Instruction-guided Controlcited by 13
- 2025Physical Plausibility-aware Trajectory Prediction via Locomotion Embodimentcited by 10
- 2025Progressive Human Motion Generation Based on Text and Few Motion Framescited by 8
- 2025Motion Generation: A Survey of Generative Approaches and Benchmarkscited by 8
- 20243D Whole-body Grasp Synthesis with Directional Controllabilitycited by 6
- 2026ProjFlow: Projection Sampling with Flow Matching for Zero-Shot Exact Spatial Motion Controlcited by 5
- 2025Moving by Looking: Towards Vision-Driven Avatar Motion Generationcited by 4
- 2026MotionHiFlow: Text-to-motion via hierarchical flow matchingcited by 4
14 more
- 2025SIGHT: Synthesizing Image-Text Conditioned and Geometry-Guided 3D Hand-Object Trajectoriescited by 3
- 2025JAX-IK: Real-Time Inverse Kinematics for Generating Multi-Constrained Movements of Virtual Human Characterscited by 1
- 2025Grounding Intelligence in Movementcited by 1
- 2025ScanMove: Motion Prediction and Transfer for Unregistered Body Meshescited by 1
- 2025Controllable Long-term Motion Generation with Extended Joint Targetscited by 1
- 2025Prime and Reach: Synthesising Body Motion for Gaze-Primed Object Reachcited by 1
- 2026FUSION: Full-Body Unified Motion Prior for Body and Hands via Diffusioncited by 1
- 20253HANDS Dataset: Learning from Humans for Generating Naturalistic Handovers with Supernumerary Robotic Limbscited by 0
- 2025One-shot Adaptation of Humanoid Whole-body Motion with Walking Priorscited by 0
- 2025A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniquescited by 0
- 2026Multi-scale Coarse-to-fine Modeling for Test-time Human Motion Controlcited by 0
- 2026DCGrasp: Distance-aware Controllable Grasp Generationcited by 0
- 2026Generative Embodied Multiple Behavior Control Systems for Human-like Agentscited by 0
- 2026Generative Interactions: Weaving Multiparty Human Motion with Bilevel Latent Dynamicscited by 0
- 2026Generative Interactions: Weaving Multiparty Human Motion with Bilevel Latent Dynamics29 Sep 2026
- 2026Generative Embodied Multiple Behavior Control Systems for Human-like Agents19 Sep 2026
- 2026DCGrasp: Distance-aware Controllable Grasp Generation29 Jun 2026
- 2026Multi-scale Coarse-to-fine Modeling for Test-time Human Motion Control14 May 2026
- 2026MotionHiFlow: Text-to-motion via hierarchical flow matching25 Apr 2026
- 2026ProjFlow: Projection Sampling with Flow Matching for Zero-Shot Exact Spatial Motion Control26 Feb 2026
- 2026FUSION: Full-Body Unified Motion Prior for Body and Hands via Diffusion7 Jan 2026
- 2025Prime and Reach: Synthesising Body Motion for Gaze-Primed Object Reach18 Dec 2025
- 2025A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniques9 Dec 2025
- 2025Controllable Long-term Motion Generation with Extended Joint Targets4 Dec 2025
- 2025One-shot Adaptation of Humanoid Whole-body Motion with Walking Priors29 Oct 2025
- 2025Moving by Looking: Towards Vision-Driven Avatar Motion Generation23 Sep 2025
14 more
- 2025ScanMove: Motion Prediction and Transfer for Unregistered Body Meshes27 Aug 2025
- 2025Motion Generation: A Survey of Generative Approaches and Benchmarks7 Jul 2025
- 2025Grounding Intelligence in Movement3 Jul 2025
- 2025JAX-IK: Real-Time Inverse Kinematics for Generating Multi-Constrained Movements of Virtual Human Characters1 Jul 2025
- 2025SIGHT: Synthesizing Image-Text Conditioned and Geometry-Guided 3D Hand-Object Trajectories28 Mar 2025
- 2025PRIMAL: Physically Reactive and Interactive Motor Model for Avatar Learning21 Mar 2025
- 2025Physical Plausibility-aware Trajectory Prediction via Locomotion Embodiment21 Mar 2025
- 2025Progressive Human Motion Generation Based on Text and Few Motion Frames17 Mar 2025
- 2025ChainHOI: Joint-based Kinematic Chain Modeling for Human-Object Interaction Generation17 Mar 2025
- 20253HANDS Dataset: Learning from Humans for Generating Naturalistic Handovers with Supernumerary Robotic Limbs6 Mar 2025
- 2024SCENIC: Scene-aware Semantic Navigation with Instruction-guided Control20 Dec 2024
- 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editing24 Oct 2024
- 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesis14 Oct 2024
- 20243D Whole-body Grasp Synthesis with Directional Controllability29 Aug 2024
- 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesiscited by 38
- 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editingcited by 18
- 2024SCENIC: Scene-aware Semantic Navigation with Instruction-guided Controlcited by 13
- 2026ProjFlow: Projection Sampling with Flow Matching for Zero-Shot Exact Spatial Motion Controlcited by 5
- 2026MotionHiFlow: Text-to-motion via hierarchical flow matchingcited by 4
- 2026MotionHiFlow: Text-to-motion via hierarchical flow matching25 Apr 2026
- 2026ProjFlow: Projection Sampling with Flow Matching for Zero-Shot Exact Spatial Motion Control26 Feb 2026
- 2024SCENIC: Scene-aware Semantic Navigation with Instruction-guided Control20 Dec 2024
- 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editing24 Oct 2024
- 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesis14 Oct 2024
- 2025ChainHOI: Joint-based Kinematic Chain Modeling for Human-Object Interaction Generationcited by 20
- 2025PRIMAL: Physically Reactive and Interactive Motor Model for Avatar Learningcited by 14
- 2025Physical Plausibility-aware Trajectory Prediction via Locomotion Embodimentcited by 10
- 2025Progressive Human Motion Generation Based on Text and Few Motion Framescited by 8
- 2025Motion Generation: A Survey of Generative Approaches and Benchmarkscited by 8
- 20243D Whole-body Grasp Synthesis with Directional Controllabilitycited by 6
- 2025Moving by Looking: Towards Vision-Driven Avatar Motion Generationcited by 4
- 2025SIGHT: Synthesizing Image-Text Conditioned and Geometry-Guided 3D Hand-Object Trajectoriescited by 3
- 2025JAX-IK: Real-Time Inverse Kinematics for Generating Multi-Constrained Movements of Virtual Human Characterscited by 1
- 2025Grounding Intelligence in Movementcited by 1
- 2025ScanMove: Motion Prediction and Transfer for Unregistered Body Meshescited by 1
- 2025Controllable Long-term Motion Generation with Extended Joint Targetscited by 1
12 most cited of 21 All 21 (JSON)
- 2026Generative Interactions: Weaving Multiparty Human Motion with Bilevel Latent Dynamics29 Sep 2026
- 2026Generative Embodied Multiple Behavior Control Systems for Human-like Agents19 Sep 2026
- 2026DCGrasp: Distance-aware Controllable Grasp Generation29 Jun 2026
- 2026Multi-scale Coarse-to-fine Modeling for Test-time Human Motion Control14 May 2026
- 2026FUSION: Full-Body Unified Motion Prior for Body and Hands via Diffusion7 Jan 2026
- 2025Prime and Reach: Synthesising Body Motion for Gaze-Primed Object Reach18 Dec 2025
- 2025A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniques9 Dec 2025
- 2025Controllable Long-term Motion Generation with Extended Joint Targets4 Dec 2025
- 2025One-shot Adaptation of Humanoid Whole-body Motion with Walking Priors29 Oct 2025
- 2025Moving by Looking: Towards Vision-Driven Avatar Motion Generation23 Sep 2025
- 2025ScanMove: Motion Prediction and Transfer for Unregistered Body Meshes27 Aug 2025
- 2025Motion Generation: A Survey of Generative Approaches and Benchmarks7 Jul 2025
12 newest of 21 All 21 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Deep Sensorimotor Control by Imitating Predictive Models of Human Motion
- 2026GazeVLA: Learning Human Intention for Robotic Manipulation
- 2022PoseGPT: Quantization-based 3D Human Motion Generation and Forecasting
- 2025Human-Object Interaction via Automatically Designed VLM-Guided Motion Policy
- 2026V-Dreamer: Automating Robotic Simulation and Trajectory Synthesis via Video Generation Priors
- 2023Controllable Human-Object Interaction Synthesis
- 2025Physically-Grounded Goal Imagination: Physics-Informed Variational Autoencoder for Self-Supervised Reinforcement Learning
- 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesis