mlsanityData to 14 Oct 2026

FLAME: Free-form Language-based Motion Synthesis & Editing

arXiv 2209.00349 ↗First posted 1 Sep 2022cs.CV cs.GRcited by 217

On the map: Diffusion models → Video generation

Abstract (arXiv)

Text-based motion generation models are drawing a surge of interest for their potential for automating the motion-making process in the game, animation, or robot industries. In this paper, we propose a diffusion-based motion synthesis and editing model named FLAME. Inspired by the recent successes in diffusion models, we integrate diffusion-based generative models into the motion domain. FLAME can generate high-fidelity motions well aligned with the given text. Also, it can edit the parts of the motion, both frame-wise and joint-wise, without any fine-tuning. FLAME involves a new transformer-based architecture we devise to better handle motion data, which is found to be crucial to manage variable-length motions and well attend to free-form text. In experiments, we show that FLAME achieves state-of-the-art generation performances on three text-motion datasets: HumanML3D, BABEL, and KIT. We also demonstrate that editing capability of FLAME can be extended to other tasks such as motion prediction or motion in-betweening, which have been previously covered by dedicated models.

Key facts. Cited by 217 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 33 of its 47 references that are in the map. First posted on arXiv 1 Sep 2022.

Builds on

33 of 47 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  11. 2022Classifier-Free Diffusion Guidancecited by 5,847
  12. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
21 more
  1. 2017Neural Discrete Representation Learningcited by 4,712
  2. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  3. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  5. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  6. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  7. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
  8. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 492
  9. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  10. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
  11. 2016The KIT Motion-Language Datasetcited by 338
  12. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
  13. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  14. 2021Robust Motion In-betweeningcited by 229
  15. 2021Synthesis of Compositional Animations from Textual Descriptionscited by 178
  16. 2017Text2Action: Generative Adversarial Synthesis from Language to Actioncited by 106
  17. 2019Structured Prediction Helps 3D Human Motion Modellingcited by 96
  18. 2022Mutual Information Divergence: A Unified Metric for Multimodal Generative Modelscited by 35
  19. 2019Human Motion Prediction via Learning Local Structure Representations and Temporal Dependenciescited by 34
  20. 2022Conditional Motion In-betweeningcited by 25
  21. 2021Repaint: Improving the Generalization of Down-Stream Visual Tasks by Generating Multiple Instances of Training Examplescited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 11; 2023: 61; 2024: 59; 2025: 52; 2026: 34.

217 papers.

Sort:

By area:

  1. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  2. 2022Human Motion Diffusion Modelcited by 1,080
  3. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  4. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  5. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  6. 2023Human Motion Diffusion as a Generative Priorcited by 357
  7. 2022EDGE: Editable Dance Generation From Musiccited by 287
  8. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  9. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
  10. 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 223
  11. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  12. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
38 more
  1. 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Modelscited by 190
  2. 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 138
  3. 2023MMM: Generative Masked Motion Modelcited by 131
  4. 2023State of the Art on Diffusion Models for Visual Computingcited by 127
  5. 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 107
  6. 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 106
  7. 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 104
  8. 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
  9. 2023Optimizing Diffusion Noise Can Serve As Universal Motion Priorscited by 98
  10. 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
  11. 2023Human Motion Generation: A Surveycited by 96
  12. 2022Ego-Body Pose Estimation via Ego-Head Pose Estimationcited by 94
  13. 2023TLControl: Trajectory and Language Control for Human Motion Synthesiscited by 94
  14. 2023EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generationcited by 89
  15. 2024Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interactioncited by 86
  16. 2023DiffuseStyleGesture: Stylized Audio-Driven Co-Speech Gesture Generation with Diffusion Modelscited by 85
  17. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
  18. 2022ZeroEGGS: Zero-shot Example-based Gesture Generation from Speechcited by 84
  19. 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
  20. 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
  21. 2024Flexible Motion In-betweening with Diffusion Modelscited by 71
  22. 2023Priority-Centric Human Motion Generation in Discrete Latent Spacecited by 67
  23. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 67
  24. 2023Single Motion Diffusioncited by 65
  25. 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
  26. 2023SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generationcited by 64
  27. 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 64
  28. 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 64
  29. 2024Estimating Body and Hand Motion in an Ego-sensed Worldcited by 58
  30. 2024Taming Diffusion Probabilistic Models for Character Controlcited by 57
  31. 2023Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generationcited by 56
  32. 2023FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Modelscited by 55
  33. 2024ParCo: Part-Coordinating Text-to-Motion Synthesiscited by 55
  34. 2024BAMM: Bidirectional Autoregressive Motion Modelcited by 55
  35. 2024ReGenNet: Towards Human Action-Reaction Synthesiscited by 53
  36. 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesiscited by 49
  37. 2024Generating Human Motion in 3D Scenes from Text Descriptionscited by 49
  38. 2023OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllerscited by 47

50 most cited of 217 All 217 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model
  2. 2023Motion Flow Matching for Human Motion Synthesis and Editing
  3. 2023Iterative Motion Editing with Natural Language
  4. 2025MotionFlux: Efficient Text-Guided Motion Generation through Rectified Flow Matching and Preference Alignment
  5. 2025ReAlign: Text-to-Motion Generation via Step-Aware Reward-Guided Alignment
  6. 2025Strong and Controllable 3D Motion Generation
  7. 2025PackDiT: Joint Human Motion and Text Generation via Mutual Prompting
  8. 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generation