Action2Motion: Conditioned Generation of 3D Human Motions
Not on the map. Why?
Cited by 91 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Action recognition is a relatively established task, where givenan input sequence of human motion, the goal is to predict its ac-tion category. This paper, on the other hand, considers a relativelynew problem, which could be thought of as an inverse of actionrecognition: given a prescribed action type, we aim to generateplausible human motion sequences in 3D. Importantly, the set ofgenerated motions are expected to maintain itsdiversityto be ableto explore the entire action-conditioned motion space; meanwhile,each sampled sequence faithfully resembles anaturalhuman bodyarticulation dynamics. Motivated by these objectives, we followthe physics law of human kinematics by adopting the Lie Algebratheory to represent thenaturalhuman motions; we also propose atemporal Variational Auto-Encoder (VAE) that encourages adiversesampling of the motion space. A new 3D human motion dataset, HumanAct12, is also constructed. Empirical experiments overthree distinct human motion datasets (including ours) demonstratethe effectiveness of our approach.
Key facts. Cited by 438 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 48; 2023: 84; 2024: 105; 2025: 122; 2026: 69.
438 papers.
Sort:
By area:
- 2022Human Motion Diffusion Modelcited by 1,062
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
- 2022EDGE: Editable Dance Generation From Musiccited by 284
38 more
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
- 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 173
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
- 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 156
- 2023MotionGPT: Finetuned LLMs Are General-Purpose Motion Generatorscited by 145
- 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 142
- 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 137
- 2023MMM: Generative Masked Motion Modelcited by 129
- 2023State of the Art on Diffusion Models for Visual Computingcited by 126
- 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 121
- 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 116
- 2024Motion Mamba: Efficient and Long Sequence Motion Generationcited by 111
- 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 109
- 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
- 2023Optimizing Diffusion Noise Can Serve As Universal Motion Priorscited by 97
- 2023Human Motion Generation: A Surveycited by 95
- 2023TLControl: Trajectory and Language Control for Human Motion Synthesiscited by 93
- 2022Towards Diverse and Natural Scene-aware 3D Human Motion Synthesiscited by 91
- 2023EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generationcited by 88
- 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 88
- 2022Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fieldscited by 85
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
- 2023HumanMAC: Masked Motion Completion for Human Motion Predictioncited by 81
- 2023Fg-T2M: Fine-Grained Text-Driven Human Motion Generation via Diffusion Modelcited by 79
- 2024Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordancecited by 79
- 2022PoseGPT: Quantization-based 3D Human Motion Generation and Forecastingcited by 78
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 78
- 2022ActFormer: A GAN-based Transformer towards General Action-Conditioned 3D Human Motion Generationcited by 77
- 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
- 2023PhysHOI: Physics-Based Imitation of Dynamic Human-Object Interactioncited by 72
50 most cited of 438 All 438 (JSON)
- 2026BiMoGen: Bidirectional Motion-Text Generation via Unified Masked Discrete Diffusion28 Sep 2026
- 2026MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space28 Sep 2026
- 2026MoSAT: Human Motion Generation from Spatial Audio and Textual Description20 Sep 2026
- 2026Open-UniMo: Towards Unified Motion-Language Understanding and Generation in the Open World13 Sep 2026
- 2026UniMo: Unifying Human and Animal Motion Generation11 Sep 2026
- 2026Multi-Modal Controlled Coherent Motion Generation10 Sep 2026
- 2026Flexible Motion Generation from Language and Style References7 Sep 2026
- 2026Inter-X++: A Comprehensive Benchmark for Multimodal Human-Human Interaction Analysis20 Aug 2026
- 2026Learning to Beat: Phenotype-Guided Latent Flow with Regional Motion Priors for Biventricular Motion Synthesis20 Aug 2026
- 2026MRBench: A Comprehensive Benchmark for Human Motion-Text Retrieval8 Aug 2026
- 2026MIME: Multimodal Interactive Motion Encoder18 Jul 2026
- 2026ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation9 Jul 2026
38 more
- 2026ARMS: Anchor-Relational Motion Streaming for Seamless Solo-Social Motion Transitions7 Jul 2026
- 2026InterCMDM: Block-Causal Diffusion for Autoregressive Human Interaction Generation2 Jul 2026
- 2026Generative Learning as a Tool to Improve Perception of Emotional Body Motion Expressions27 Jun 2026
- 2026MindFlow: Harmonizing Cognitive Semantics and Acoustic Dynamics for Facial Animation Generation in Dyadic Conversations26 Jun 2026
- 2026Beyond MoCap: Scaling Motion Tokenizers with Synthetic Human Motion for Generative Modeling25 Jun 2026
- 2026Social Structure Matters in 3D Human-Human Interaction Generation23 Jun 2026
- 2026Context-Aware Autoregressive Diffusion for Gloss-Wise Sign Language Production19 Jun 2026
- 2026Odoriko: A Shape-Aware Multimodal Diffusion Framework for Human Motion19 Jun 2026
- 2026XmoPipe: A Pipeline for Large-Scale In-the-Wild Human Motion Dataset Construction17 Jun 2026
- 2026VideoMDM: Towards 3D Human Motion Generation From 2D Supervision11 Jun 2026
- 2026Cross-Axis Feature Fusion with Joint-Wise Motion Difference Prediction for Text-Based 3D Human Motion Editing31 May 2026
- 2026MultiAct: Text-to-Motion Generation from Composite Text via Tailored Attention Guidance29 May 2026
- 2026SalsaAgent: A multimodal embodied language model for interactive dance generation28 May 2026
- 2026SPRINT: Efficient Spectral Priors for Humanoid Athletic Sprints27 May 2026
- 2026DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcing27 May 2026
- 2026Self-Intersection-Aware 3D Human Motion Generation Using an Efficient Human Sphere Proxy26 May 2026
- 2026EMA: Effort Metric Attention for Anatomical Effort-Guided Human Motion Diffusion23 May 2026
- 2026RePCM: Region-Specific and Phenotype-Adaptive Bi-Ventricular Cardiac Motion Synthesis20 May 2026
- 2026DrawMotion: Generating 3D Human Motions by Freehand Drawing20 May 2026
- 2026MotionMERGE: A Multi-granular Framework for Human Motion Editing, Reasoning, Generation, and Explanation18 May 2026
- 2026HoloMotion-1 Technical Report14 May 2026
- 2026Multi-scale Coarse-to-fine Modeling for Test-time Human Motion Control14 May 2026
- 2026ScaleMoGen: Autoregressive Next-Scale Prediction for Human Motion Generation12 May 2026
- 2026MotionHiFlow: Text-to-motion via hierarchical flow matching25 Apr 2026
- 2026EgoMotion: Hierarchical Reasoning and Diffusion for Egocentric Vision-Language Motion Generation21 Apr 2026
- 2026Towards Human Motion World Models via Executable Behaviour Representations20 Apr 2026
- 2026Toward Universal Skeleton-Based Action Recognition across Heterogeneous Skeletons and Open Vocabularies18 Apr 2026
- 2026Motion-Adapter: A Diffusion Model Adapter for Text-to-Motion Generation of Compound Actions17 Apr 2026
- 2026Generative Data Augmentation for Skeleton Action Recognition16 Apr 2026
- 2026FatigueFusion: Latent Space Fusion for Fatigue-Driven Motion Synthesis11 Apr 2026
- 2026Coordinate-Based Dual-Constrained Autoregressive Motion Generation9 Apr 2026
- 2026Next-Scale Autoregressive Models for Text-to-Motion Generation4 Apr 2026
- 2026Exploring Motion-Language Alignment for Text-driven Motion Generation3 Apr 2026
- 2026SentiAvatar: Towards Expressive and Interactive Digital Humans3 Apr 2026
- 2026ReMoGen: Real-time Human Interaction-to-Reaction Generation via Modular Learning from Diverse Data1 Apr 2026
- 2026Diffusion Path Alignment for Long-Range Motion Generation and Domain Transitions31 Mar 2026
- 2026NOUS: Video-Driven 3D Human Reaction Generation via Observation-Reaction Mutual Steering20 Mar 2026
- 2026Bridging Semantic and Kinematic Conditions with Diffusion-based Discrete Motion Tokenizer19 Mar 2026
50 newest of 438 All 438 (JSON)
- 2022Human Motion Diffusion Modelcited by 1,062
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
- 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
- 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
- 2023State of the Art on Diffusion Models for Visual Computingcited by 126
- 2023Optimizing Diffusion Noise Can Serve As Universal Motion Priorscited by 97
- 2023EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generationcited by 88
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
12 most cited of 89 All 89 (JSON)
- 2026BiMoGen: Bidirectional Motion-Text Generation via Unified Masked Discrete Diffusion28 Sep 2026
- 2026MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space28 Sep 2026
- 2026InterCMDM: Block-Causal Diffusion for Autoregressive Human Interaction Generation2 Jul 2026
- 2026EMA: Effort Metric Attention for Anatomical Effort-Guided Human Motion Diffusion23 May 2026
- 2026MotionHiFlow: Text-to-motion via hierarchical flow matching25 Apr 2026
- 2026Motion-Adapter: A Diffusion Model Adapter for Text-to-Motion Generation of Compound Actions17 Apr 2026
- 2026Bridging Semantic and Kinematic Conditions with Diffusion-based Discrete Motion Tokenizer19 Mar 2026
- 2026Riemannian Motion Generation: A Unified Framework for Human Motion Representation and Generation via Riemannian Flow Matching16 Mar 2026
- 2026ProjFlow: Projection Sampling with Flow Matching for Zero-Shot Exact Spatial Motion Control26 Feb 2026
- 2026Causal Motion Diffusion Models for Autoregressive Motion Generation26 Feb 2026
- 2026Disentangled Hierarchical VAE for 3D Human-Human Interaction Generation24 Feb 2026
- 2026Event-T2M: Event-level Conditioning for Complex Text-to-Motion Synthesis4 Feb 2026
12 newest of 89 All 89 (JSON)
- 2024Motion Mamba: Efficient and Long Sequence Motion Generationcited by 111
- 2024Text-controlled Motion Mamba: Text-Instructed Temporal Grounding of Human Motioncited by 16
- 2025Spatial-Temporal Graph Mamba for Music-Guided Dance Video Synthesiscited by 4
- 2025InterMamba: Efficient Human-Human Interaction Generation with Adaptive Spatio-Temporal Mambacited by 2
- 2026T2M Mamba: Motion Periodicity-Saliency Coupling Approach for Stable Text-Driven Motion Generationcited by 0
- 2026T2M Mamba: Motion Periodicity-Saliency Coupling Approach for Stable Text-Driven Motion Generation1 Feb 2026
- 2025Spatial-Temporal Graph Mamba for Music-Guided Dance Video Synthesis9 Jul 2025
- 2025InterMamba: Efficient Human-Human Interaction Generation with Adaptive Spatio-Temporal Mamba3 Jun 2025
- 2024Text-controlled Motion Mamba: Text-Instructed Temporal Grounding of Human Motion17 Apr 2024
- 2024Motion Mamba: Efficient and Long Sequence Motion Generation12 Mar 2024
- 2025Think-Then-React: Towards Unconstrained Human Action-to-Reaction Generationcited by 7
- 2026EgoMotion: Hierarchical Reasoning and Diffusion for Egocentric Vision-Language Motion Generationcited by 0
- 2026MotionMERGE: A Multi-granular Framework for Human Motion Editing, Reasoning, Generation, and Explanationcited by 0
- 2026MotionMERGE: A Multi-granular Framework for Human Motion Editing, Reasoning, Generation, and Explanation18 May 2026
- 2026EgoMotion: Hierarchical Reasoning and Diffusion for Egocentric Vision-Language Motion Generation21 Apr 2026
- 2025Think-Then-React: Towards Unconstrained Human Action-to-Reaction Generation19 Feb 2025
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
- 2024MoRAG -- Multi-Fusion Retrieval Augmented Generation for Human Motioncited by 11
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
- 2022EDGE: Editable Dance Generation From Musiccited by 284
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
12 most cited of 331 All 331 (JSON)
- 2026MoSAT: Human Motion Generation from Spatial Audio and Textual Description20 Sep 2026
- 2026Open-UniMo: Towards Unified Motion-Language Understanding and Generation in the Open World13 Sep 2026
- 2026UniMo: Unifying Human and Animal Motion Generation11 Sep 2026
- 2026Multi-Modal Controlled Coherent Motion Generation10 Sep 2026
- 2026Flexible Motion Generation from Language and Style References7 Sep 2026
- 2026Inter-X++: A Comprehensive Benchmark for Multimodal Human-Human Interaction Analysis20 Aug 2026
- 2026Learning to Beat: Phenotype-Guided Latent Flow with Regional Motion Priors for Biventricular Motion Synthesis20 Aug 2026
- 2026MRBench: A Comprehensive Benchmark for Human Motion-Text Retrieval8 Aug 2026
- 2026MIME: Multimodal Interactive Motion Encoder18 Jul 2026
- 2026ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation9 Jul 2026
- 2026ARMS: Anchor-Relational Motion Streaming for Seamless Solo-Social Motion Transitions7 Jul 2026
- 2026Generative Learning as a Tool to Improve Perception of Emotional Body Motion Expressions27 Jun 2026
12 newest of 331 All 331 (JSON)