Conditional Motion In-betweening
Not on the map. Why?
Abstract (arXiv)
Motion in-betweening (MIB) is a process of generating intermediate skeletal movement between the given start and target poses while preserving the naturalness of the motion, such as periodic footstep motion while walking. Although state-of-the-art MIB methods are capable of producing plausible motions given sparse key-poses, they often lack the controllability to generate motions satisfying the semantic contexts required in practical applications. We focus on the method that can handle pose or semantic conditioned MIB tasks using a unified model. We also present a motion augmentation method to improve the quality of pose-conditioned motion generation via defining a distribution over smooth trajectories. Our proposed method outperforms the existing state-of-the-art MIB method in pose prediction errors while providing additional controllability.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 28 of its 55 references that are in the map. First posted on arXiv 9 Feb 2022.
Builds on
28 of 55 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2016Least Squares Generative Adversarial Networkscited by 1,001
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2017Convolutional Sequence to Sequence Learningcited by 552
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
- 2017On human motion prediction using recurrent neural networkscited by 338
- 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
- 2019Depth-Aware Video Frame Interpolationcited by 234
16 more
- 2021Robust Motion In-betweeningcited by 229
- 2021Character Controllers Using Motion VAEscited by 184
- 2020Learning Joint Spatial-Temporal Transformations for Video Inpaintingcited by 163
- 2020A Spatio-temporal Transformer for 3D Human Motion Predictioncited by 133
- 2017Text2Action: Generative Adversarial Synthesis from Language to Actioncited by 106
- 2019Structured Prediction Helps 3D Human Motion Modellingcited by 96
- 2020Unpaired Motion Style Transfer from Video to Animationcited by 94
- 2020Convolutional Autoencoders for Human Motion Infillingcited by 73
- 2017Learning Human Motion Models for Long-term Predictionscited by 67
- 2014Learning Stochastic Recurrent Networkscited by 60
- 2021Single-Shot Motion Completion with Transformercited by 59
- 2018Recurrent Transition Networks for Character Locomotioncited by 52
- 2019MoGlow: Probabilistic and controllable motion synthesis using normalising flowscited by 47
- 2021Pose Transformers (POTR): Human Motion Prediction with Non-Autoregressive Transformerscited by 46
- 2019Spatio-temporal Manifold Learning for Human Motions via Long-horizon Modelingcited by 32
- 2021HUMAN4D: A Human-Centric Multimodal Dataset for Motions and Immersive Mediacited by 29
Built on by
Citing papers per year: 2022: 3; 2023: 7; 2024: 2; 2025: 9; 2026: 4.
25 papers.
Sort:
By area:
- 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
- 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
- 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videoscited by 66
- 2023SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generationcited by 64
- 2023Visibility Aware Human-Object Interaction Tracking from Single RGB Cameracited by 58
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 55
- 2023Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusioncited by 39
- 2025SceneMI: Motion In-betweening for Modeling Human-Scene Interactionscited by 11
- 2024Text-guided 3D Human Motion Generation with Keyframe-based Parallel Skip Transformercited by 9
- 2025Motion Synthesis with Sparse and Flexible Keyjoint Controlcited by 9
- 2025Deep Compositional Phase Diffusion for Long Motion Sequence Generationcited by 6
13 more
- 2026MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart Primitivescited by 6
- 2023A Unified Masked Autoencoder with Patchified Skeletons for Motion Synthesiscited by 4
- 2023Orientation-Aware Leg Movement Learning for Action-Driven Human Motion Predictioncited by 4
- 2022Learning Joint Representation of Human Motion and Languagecited by 3
- 2023Diverse Motion In-betweening with Dual Posture Stitchingcited by 2
- 2025SILK: Smooth InterpoLation frameworK for motion in-betweening A Simplified Computational Approachcited by 1
- 2025A Plug-and-Play Multi-Criteria Guidance for Diverse In-Betweening Human Motion Generationcited by 1
- 2026Learning Context-Adaptive Motion Priors for Masked Motion Diffusion Models with Efficient Kinematic Attention Aggregationcited by 1
- 2025PMG: Progressive Motion Generation via Sparse Anchor Postures Curriculum Learningcited by 0
- 2025From Motion to Behavior: Hierarchical Modeling of Humanoid Generative Behavior Controlcited by 0
- 2025Motion In-Betweening for Densely Interacting Characterscited by 0
- 2026Adaptive Interpolation-Synthesis for Motion In-Betweening on Keyframe-Based Animationcited by 0
- 2026Generative Motion In-betweening by Diffusion over Continuous Implicit Representationscited by 0
- 2026Generative Motion In-betweening by Diffusion over Continuous Implicit Representations12 May 2026
- 2026Adaptive Interpolation-Synthesis for Motion In-Betweening on Keyframe-Based Animation4 May 2026
- 2026MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart Primitives27 Apr 2026
- 2026Learning Context-Adaptive Motion Priors for Masked Motion Diffusion Models with Efficient Kinematic Attention Aggregation8 Mar 2026
- 2025Deep Compositional Phase Diffusion for Long Motion Sequence Generation16 Oct 2025
- 2025Motion In-Betweening for Densely Interacting Characters30 Sep 2025
- 2025A Plug-and-Play Multi-Criteria Guidance for Diverse In-Betweening Human Motion Generation3 Aug 2025
- 2025SILK: Smooth InterpoLation frameworK for motion in-betweening A Simplified Computational Approach9 Jun 2025
- 2025From Motion to Behavior: Hierarchical Modeling of Humanoid Generative Behavior Control28 May 2025
- 2025PMG: Progressive Motion Generation via Sparse Anchor Postures Curriculum Learning23 Apr 2025
- 2025SceneMI: Motion In-betweening for Modeling Human-Scene Interactions20 Mar 2025
- 2025Motion Synthesis with Sparse and Flexible Keyjoint Control18 Mar 2025
13 more
- 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videos6 Jan 2025
- 2024Text-guided 3D Human Motion Generation with Keyframe-based Parallel Skip Transformer24 May 2024
- 2024Seamless Human Motion Composition with Blended Positional Encodings23 Feb 2024
- 2023Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion7 Dec 2023
- 2023Orientation-Aware Leg Movement Learning for Action-Driven Human Motion Prediction23 Oct 2023
- 2023A Unified Masked Autoencoder with Patchified Skeletons for Motion Synthesis14 Aug 2023
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Models1 Jun 2023
- 2023SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generation20 Apr 2023
- 2023Visibility Aware Human-Object Interaction Tracking from Single RGB Camera29 Mar 2023
- 2023Diverse Motion In-betweening with Dual Posture Stitching25 Mar 2023
- 2022Learning Joint Representation of Human Motion and Language27 Oct 2022
- 2022TEACH: Temporal Action Composition for 3D Humans9 Sep 2022
- 2022FLAME: Free-form Language-based Motion Synthesis & Editing1 Sep 2022
- 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 55
- 2023Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusioncited by 39
- 2026Learning Context-Adaptive Motion Priors for Masked Motion Diffusion Models with Efficient Kinematic Attention Aggregationcited by 1
- 2026Generative Motion In-betweening by Diffusion over Continuous Implicit Representationscited by 0
- 2026Generative Motion In-betweening by Diffusion over Continuous Implicit Representations12 May 2026
- 2026Learning Context-Adaptive Motion Priors for Masked Motion Diffusion Models with Efficient Kinematic Attention Aggregation8 Mar 2026
- 2023Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion7 Dec 2023
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Models1 Jun 2023
- 2022FLAME: Free-form Language-based Motion Synthesis & Editing1 Sep 2022
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
- 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
- 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videoscited by 66
- 2023SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generationcited by 64
- 2023Visibility Aware Human-Object Interaction Tracking from Single RGB Cameracited by 58
- 2025SceneMI: Motion In-betweening for Modeling Human-Scene Interactionscited by 11
- 2024Text-guided 3D Human Motion Generation with Keyframe-based Parallel Skip Transformercited by 9
- 2025Motion Synthesis with Sparse and Flexible Keyjoint Controlcited by 9
- 2025Deep Compositional Phase Diffusion for Long Motion Sequence Generationcited by 6
- 2026MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart Primitivescited by 6
- 2023A Unified Masked Autoencoder with Patchified Skeletons for Motion Synthesiscited by 4
- 2023Orientation-Aware Leg Movement Learning for Action-Driven Human Motion Predictioncited by 4
12 most cited of 20 All 20 (JSON)
- 2026Adaptive Interpolation-Synthesis for Motion In-Betweening on Keyframe-Based Animation4 May 2026
- 2026MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart Primitives27 Apr 2026
- 2025Deep Compositional Phase Diffusion for Long Motion Sequence Generation16 Oct 2025
- 2025Motion In-Betweening for Densely Interacting Characters30 Sep 2025
- 2025A Plug-and-Play Multi-Criteria Guidance for Diverse In-Betweening Human Motion Generation3 Aug 2025
- 2025SILK: Smooth InterpoLation frameworK for motion in-betweening A Simplified Computational Approach9 Jun 2025
- 2025From Motion to Behavior: Hierarchical Modeling of Humanoid Generative Behavior Control28 May 2025
- 2025PMG: Progressive Motion Generation via Sparse Anchor Postures Curriculum Learning23 Apr 2025
- 2025SceneMI: Motion In-betweening for Modeling Human-Scene Interactions20 Mar 2025
- 2025Motion Synthesis with Sparse and Flexible Keyjoint Control18 Mar 2025
- 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videos6 Jan 2025
- 2024Text-guided 3D Human Motion Generation with Keyframe-based Parallel Skip Transformer24 May 2024
12 newest of 20 All 20 (JSON)