QuaterNet: A Quaternion-based Recurrent Model for Human Motion
Not on the map. Why?
Abstract (arXiv)
Deep learning for predicting or generating 3D human pose sequences is an active research area. Previous work regresses either joint rotations or joint positions. The former strategy is prone to error accumulation along the kinematic chain, as well as discontinuities when using Euler angle or exponential map parameterizations. The latter requires re-projection onto skeleton constraints to avoid bone stretching and invalid configurations. This work addresses both limitations. Our recurrent network, QuaterNet, represents rotations with quaternions and our loss function performs forward kinematics on a skeleton to penalize absolute position errors instead of angle errors. On short-term predictions, QuaterNet improves the state-of-the-art quantitatively. For long-term generation, our approach is qualitatively judged as realistic as recent neural strategies from the graphics literature.
Key facts. Cited by 109 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 23; 2023: 29; 2024: 15; 2025: 11; 2026: 9.
109 papers.
Sort:
By area:
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2021Synthesis of Compositional Animations from Textual Descriptionscited by 178
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 153
- 2022COUCH: Towards Controllable Human-Chair Interactionscited by 135
- 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 124
- 2021Audio2Gestures: Generating Diverse Gestures from Speech Audio with Conditional Variational Autoencoderscited by 109
- 2023Unified Human-Scene Interaction via Prompted Chain-of-Contactscited by 94
- 2022Towards Diverse and Natural Scene-aware 3D Human Motion Synthesiscited by 91
38 more
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
- 2022NeMF: Neural Motion Fields for Kinematic Animationcited by 68
- 2021Generating Smooth Pose Sequences for Diverse Human Motion Predictioncited by 66
- 2021Multi-Person 3D Motion Prediction with Multi-Range Transformerscited by 63
- 2021The Wanderings of Odysseus in 3D Scenescited by 59
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 55
- 2024ParCo: Part-Coordinating Text-to-Motion Synthesiscited by 55
- 2021Rhythm is a Dancer: Music-Driven Motion Synthesis with Global Structurecited by 53
- 2023HybrIK-X: Hybrid Analytical-Neural Inverse Kinematics for Whole-body Mesh Recoverycited by 49
- 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesiscited by 49
- 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Modelscited by 43
- 2021Multiscale Spatio-Temporal Graph Neural Networks for 3D Skeleton-Based Motion Predictioncited by 37
- 2023PACE: Human and Camera Motion Estimation from in-the-wild Videoscited by 34
- 20223D Human Motion Prediction: A Surveycited by 30
- 2022MyStyle: A Personalized Generative Priorcited by 26
- 2022Weakly-supervised Action Transition Learning for Stochastic Human Motion Predictioncited by 26
- 2023Plan, Posture and Go: Towards Open-World Text-to-Motion Generationcited by 26
- 2022Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimationcited by 25
- 2022PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervisioncited by 25
- 2022GANimator: Neural Motion Synthesis from a Single Sequencecited by 23
- 2023ROAM: Robust and Object-Aware Motion Generation Using Neural Pose Descriptorscited by 23
- 2023HMP: Hand Motion Priors for Pose and Shape Estimation from Videocited by 23
- 2024Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptionscited by 23
- 2021Transflower: probabilistic autoregressive dance generation with multimodal attentioncited by 22
- 2023SparsePoser: Real-time Full-body Motion Reconstruction from Sparse Datacited by 21
- 2021GAN-based Reactive Motion Synthesis with Class-aware Discriminators for Human-human Interactioncited by 18
- 2022Action-conditioned On-demand Motion Generationcited by 18
- 2021ProtoRes: Proto-Residual Network for Pose Authoring via Learned Inverse Kinematicscited by 17
- 2023ReactFace: Online Multiple Appropriate Facial Reaction Generation in Dyadic Interactionscited by 17
- 2023TransFusion: A Practical and Effective Transformer-based Diffusion Model for 3D Human Motion Predictioncited by 17
- 2023Realistic Human Motion Generation with Cross-Diffusion Modelscited by 17
- 2023Example-based Motion Synthesis via Generative Motion Matchingcited by 16
- 2023Joint-Relation Transformer for Multi-Person Motion Predictioncited by 16
- 2023Improving 3D Pose Estimation for Sign Languagecited by 16
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimationcited by 15
- 2021TrajeVAE: Controllable Human Motion Generation from Trajectoriescited by 14
- 2021MUGL: Large Scale Multi Person Conditional Action Generation with Locomotioncited by 14
- 2022MotionAug: Augmentation with Physical Correction for Human Motion Predictioncited by 13
50 most cited of 109 All 109 (JSON)
- 2026CAST: Real-Time Motion Capture for Any Skeleton Topology10 Oct 2026
- 2026STyMo: Fast and Controllable Few-Shot Motion Style Transfer3 Sep 2026
- 2026Modeling Fly Social Behavior with Agent-Centric Pose Forecasting21 Jul 2026
- 2026EquiFusion: Kinematics-Agnostic Human Motion Prediction via Equivariant Latent Diffusion13 Jul 2026
- 2026EggHand: A Multimodal Foundation Model for Egocentric Hand Pose Forecasting8 May 2026
- 2026Next-Scale Autoregressive Models for Text-to-Motion Generation4 Apr 2026
- 2026MotionRFT: Unified Reinforcement Fine-Tuning for Text-to-Motion Generation28 Mar 2026
- 2026Image Rotation Angle Estimation: Comparing Circular-Aware Methods26 Mar 2026
- 2026Semantic Belief-State World Model for 3D Human Motion Prediction7 Jan 2026
- 2025A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniques9 Dec 2025
- 2025Back to Basics: Motion Representation Matters for Human Motion Generation Using Diffusion Model4 Dec 2025
- 2025Tokenizing Loops of Antibodies10 Sep 2025
38 more
- 2025MotionFlux: Efficient Text-Guided Motion Generation through Rectified Flow Matching and Preference Alignment27 Aug 2025
- 2025Towards Skeletal and Signer Noise Reduction in Sign Language Production via Quaternion-Based Pose Encoding and Contrastive Learning20 Aug 2025
- 2025Stochastic Human Motion Prediction with Memory of Action Transition and Action Characteristic5 Jul 2025
- 2025Multimodal Generative AI with Autoregressive LLMs for Human Motion Understanding and Generation: A Way Forward31 May 2025
- 2025CacheFlow: Fast Human Motion Prediction by Cached Normalizing Flow19 May 2025
- 2025HVIS: A Human-like Vision and Inference System for Human Motion Prediction24 Feb 2025
- 2025DIRIGENt: End-To-End Robotic Imitation of Human Demonstrations Based on a Diffusion Model28 Jan 2025
- 2025Nonisotropic Gaussian Diffusion for Realistic 3D Human Motion Prediction10 Jan 2025
- 2024Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions16 Oct 2024
- 2024An Effective, Robust and Fairness-aware Hate Speech Detection Framework25 Sep 2024
- 2024T2M-X: Learning Expressive Text-to-Motion Generation from Partially Annotated Data20 Sep 2024
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation29 Aug 2024
- 2024T2LM: Long-Term 3D Human Motion Generation from Multiple Sentences2 Jun 2024
- 2024Shape Conditioned Human Motion Generation with Diffusion Model10 May 2024
- 2024A Mixture of Experts Approach to 3D Human Motion Prediction9 May 2024
- 2024Quater-GCN: Enhancing 3D Human Pose Estimation with Orientation and Semi-supervised Training30 Apr 2024
- 2024DragPoser: Motion Reconstruction from Variable Sparse Tracking Signals via Latent Space Optimization29 Apr 2024
- 2024An Animation-based Augmentation Approach for Action Recognition from Discontinuous Video10 Apr 2024
- 2024ParCo: Part-Coordinating Text-to-Motion Synthesis27 Mar 2024
- 2024Human Motion Prediction under Unexpected Perturbation23 Mar 2024
- 2024Existence Is Chaos: Enhancing 3D Human Motion Prediction with Uncertainty Consideration21 Mar 2024
- 2024FORCE: Physics-aware Human-object Interaction17 Mar 2024
- 2024AdvMT: Adversarial Motion Transformer for Long-term Human Motion Prediction10 Jan 2024
- 2023HMP: Hand Motion Priors for Pose and Shape Estimation from Video27 Dec 2023
- 2023Plan, Posture and Go: Towards Open-World Text-to-Motion Generation22 Dec 2023
- 2023Realistic Human Motion Generation with Cross-Diffusion Models18 Dec 2023
- 2023T2M-HiFiGPT: Generating High Quality Human Motion from Textual Descriptions with Residual Discrete Representations17 Dec 2023
- 2023AAMDM: Accelerated Auto-regressive Motion Diffusion Model2 Dec 2023
- 2023SparsePoser: Real-time Full-body Motion Reconstruction from Sparse Data3 Nov 2023
- 2023PACE: Human and Camera Motion Estimation from in-the-wild Videos20 Oct 2023
- 2023Dual Quaternion Rotational and Translational Equivariance in 3D Rigid Motion Modelling11 Oct 2023
- 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models3 Oct 2023
- 2023Unified Human-Scene Interaction via Prompted Chain-of-Contacts14 Sep 2023
- 2023ROAM: Robust and Object-Aware Motion Generation Using Neural Pose Descriptors24 Aug 2023
- 20233D Pose Nowcasting: Forecast the Future to Improve the Present24 Aug 2023
- 2023Improving 3D Pose Estimation for Sign Language18 Aug 2023
- 2023Joint-Relation Transformer for Multi-Person Motion Prediction9 Aug 2023
- 2023TransFusion: A Practical and Effective Transformer-based Diffusion Model for 3D Human Motion Prediction30 Jul 2023
50 newest of 109 All 109 (JSON)
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 55
- 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesiscited by 49
- 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Modelscited by 43
- 2023TransFusion: A Practical and Effective Transformer-based Diffusion Model for 3D Human Motion Predictioncited by 17
- 2023Realistic Human Motion Generation with Cross-Diffusion Modelscited by 17
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimationcited by 15
- 2023AAMDM: Accelerated Auto-regressive Motion Diffusion Modelcited by 10
- 2024Shape Conditioned Human Motion Generation with Diffusion Modelcited by 3
- 2025DIRIGENt: End-To-End Robotic Imitation of Human Demonstrations Based on a Diffusion Modelcited by 1
- 2025MotionFlux: Efficient Text-Guided Motion Generation through Rectified Flow Matching and Preference Alignmentcited by 1
12 most cited of 14 All 14 (JSON)
- 2026EquiFusion: Kinematics-Agnostic Human Motion Prediction via Equivariant Latent Diffusion13 Jul 2026
- 2025Back to Basics: Motion Representation Matters for Human Motion Generation Using Diffusion Model4 Dec 2025
- 2025MotionFlux: Efficient Text-Guided Motion Generation through Rectified Flow Matching and Preference Alignment27 Aug 2025
- 2025DIRIGENt: End-To-End Robotic Imitation of Human Demonstrations Based on a Diffusion Model28 Jan 2025
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation29 Aug 2024
- 2024Shape Conditioned Human Motion Generation with Diffusion Model10 May 2024
- 2023Realistic Human Motion Generation with Cross-Diffusion Models18 Dec 2023
- 2023AAMDM: Accelerated Auto-regressive Motion Diffusion Model2 Dec 2023
- 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models3 Oct 2023
- 2023TransFusion: A Practical and Effective Transformer-based Diffusion Model for 3D Human Motion Prediction30 Jul 2023
- 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesis27 Jul 2023
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Models1 Jun 2023
12 newest of 14 All 14 (JSON)
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2021Synthesis of Compositional Animations from Textual Descriptionscited by 178
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 153
- 2022COUCH: Towards Controllable Human-Chair Interactionscited by 135
- 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 124
- 2021Audio2Gestures: Generating Diverse Gestures from Speech Audio with Conditional Variational Autoencoderscited by 109
- 2023Unified Human-Scene Interaction via Prompted Chain-of-Contactscited by 94
- 2022Towards Diverse and Natural Scene-aware 3D Human Motion Synthesiscited by 91
- 2022NeMF: Neural Motion Fields for Kinematic Animationcited by 68
12 most cited of 92 All 92 (JSON)
- 2026CAST: Real-Time Motion Capture for Any Skeleton Topology10 Oct 2026
- 2026STyMo: Fast and Controllable Few-Shot Motion Style Transfer3 Sep 2026
- 2026Modeling Fly Social Behavior with Agent-Centric Pose Forecasting21 Jul 2026
- 2026EggHand: A Multimodal Foundation Model for Egocentric Hand Pose Forecasting8 May 2026
- 2026Next-Scale Autoregressive Models for Text-to-Motion Generation4 Apr 2026
- 2026MotionRFT: Unified Reinforcement Fine-Tuning for Text-to-Motion Generation28 Mar 2026
- 2026Image Rotation Angle Estimation: Comparing Circular-Aware Methods26 Mar 2026
- 2025A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniques9 Dec 2025
- 2025Tokenizing Loops of Antibodies10 Sep 2025
- 2025Towards Skeletal and Signer Noise Reduction in Sign Language Production via Quaternion-Based Pose Encoding and Contrastive Learning20 Aug 2025
- 2025Stochastic Human Motion Prediction with Memory of Action Transition and Action Characteristic5 Jul 2025
- 2025Multimodal Generative AI with Autoregressive LLMs for Human Motion Understanding and Generation: A Way Forward31 May 2025
12 newest of 92 All 92 (JSON)