mlsanityData to 14 Oct 2026

FreeMotion: A Unified Framework for Number-free Text-to-Motion Synthesis

arXiv 2405.15763 ↗First posted 24 May 2024cs.CVcited by 42

Not on the map. Why?

Abstract (arXiv)

Text-to-motion synthesis is a crucial task in computer vision. Existing methods are limited in their universality, as they are tailored for single-person or two-person scenarios and can not be applied to generate motions for more individuals. To achieve the number-free motion synthesis, this paper reconsiders motion generation and proposes to unify the single and multi-person motion by the conditional motion distribution. Furthermore, a generation module and an interaction module are designed for our FreeMotion framework to decouple the process of conditional motion generation and finally support the number-free motion synthesis. Besides, based on our framework, the current single-person motion spatial control method could be seamlessly integrated, achieving precise control of multi-person motion. Extensive experiments demonstrate the superior performance of our method and our capability to infer single and multi-human motions simultaneously.

Key facts. Cited by 42 papers in the map (data through 14 Oct 2026). Builds on 22 of its 32 references that are in the map. First posted on arXiv 24 May 2024.

Builds on

22 of 32 references.

References · 22

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  8. 2022Human Motion Diffusion Modelcited by 1,080
  9. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  10. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  11. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  12. 2023Human Motion Diffusion as a Generative Priorcited by 357
10 more
  1. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
  2. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
  3. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
  4. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
  5. 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 106
  6. 2021Multi-Person Extreme Motion Predictioncited by 75
  7. 2022Interaction Transformer for Human Reaction Generationcited by 42
  8. 2023Music-Driven Group Choreographycited by 37
  9. 2023Towards Detailed Text-to-Motion Synthesis via Basic-to-Advanced Hierarchical Diffusion Modelcited by 13
  10. 2023Bipartite Graph Diffusion Model for Human Interaction Generationcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 7; 2025: 22; 2026: 13.

42 papers.

Sort:

By area:

  1. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
  2. 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 68
  3. 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 51
  4. 2024InterMask: 3D Human Interaction Generation via Collaborative Masked Modelingcited by 47
  5. 2024TIMotion: Temporal and Interactive Framework for Efficient Human-Human Motion Generationcited by 27
  6. 2025A Survey on Human Interaction Motion Generationcited by 25
  7. 2025DuetGen: Music Driven Two-Person Dance Generation via Hierarchical Masked Modelingcited by 21
  8. 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editingcited by 18
  9. 2024SoPo: Text-to-Motion Generation Using Semi-Online Preference Optimizationcited by 15
  10. 2025HERO: Human Reaction Generation from Videoscited by 15
  11. 2025SocialGen: Modeling Multi-Human Social Interaction with Language Modelscited by 14
  12. 2025SIGMAN:Scaling 3D Human Gaussian Generation with Millions of Assetscited by 12
30 more
  1. 2025Text2Interact: High-Fidelity and Diverse Text-to-Two-Person Interaction Generationcited by 11
  2. 2026Causal Motion Diffusion Models for Autoregressive Motion Generationcited by 10
  3. 2025PINO: Person-Interaction Noise Optimization for Long-Duration and Customizable Motion Generation of Arbitrary-Sized Groupscited by 9
  4. 2024Textual Decomposition Then Sub-motion-space Scattering for Open-Vocabulary Motion Generationcited by 8
  5. 2025Multi-Person Interaction Generation from Two-Person Motion Priorscited by 8
  6. 2025Pulp Motion: Framing-aware multimodal camera and human motion generationcited by 8
  7. 20253D Human Interaction Generation: A Surveycited by 7
  8. 2025Ponimator: Unfolding Interactive Pose for Versatile Human-human Interaction Animationcited by 7
  9. 2024Two-in-One: Unified Multi-Person Interactive Motion Generation by Latent Diffusion Transformercited by 6
  10. 2025MotionVerse: A Unified Multimodal Framework for Motion Comprehension, Generation and Editingcited by 5
  11. 2025InterAgent: Physics-based Multi-agent Command Execution via Diffusion on Interaction Graphscited by 5
  12. 2025PoseAnything: Universal Pose-guided Video Generation with Part-aware Temporal Coherencecited by 5
  13. 2026ProjFlow: Projection Sampling with Flow Matching for Zero-Shot Exact Spatial Motion Controlcited by 5
  14. 2026TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Sizecited by 5
  15. 2026UMO: Unified In-Context Learning Unlocks Motion Foundation Model Priorscited by 5
  16. 2025Dyadic Mamba: Long-term Dyadic Human Motion Synthesiscited by 4
  17. 2025Decoupled Generative Modeling for Human-Object Interaction Synthesiscited by 3
  18. 2026Disentangled Hierarchical VAE for 3D Human-Human Interaction Generationcited by 3
  19. 2026Gloria: Consistent Character Video Generation via Content Anchorscited by 3
  20. 2024Massively Multi-Person 3D Human Motion Forecasting with Scene Contextcited by 2
  21. 2025MARRS: Masked Autoregressive Unit-based Reaction Synthesiscited by 2
  22. 2025Learning to Generate Human-Human-Object Interactions from Textual Descriptionscited by 2
  23. 2026U-Mind: A Unified Framework for Real-Time Multimodal Interaction with Audiovisual Generationcited by 2
  24. 2026ReMoGen: Real-time Human Interaction-to-Reaction Generation via Modular Learning from Diverse Datacited by 1
  25. 2025ChairPose: Pressure-based Chair Morphology Grounded Sitting Pose Estimation through Simulation-Assisted Trainingcited by 0
  26. 2026Talking Together: Synthesizing Co-Located 3D Conversations from Audiocited by 0
  27. 2026Unified Number-Free Text-to-Motion Generation Via Flow Matchingcited by 0
  28. 2026Paper Reconstruction Evaluation: Evaluating Presentation and Hallucination in AI-written Paperscited by 0
  29. 2026SalsaAgent: A multimodal embodied language model for interactive dance generationcited by 0
  30. 2026GNOCHI: Generative Neural mOdel for Close Human-Human Interactionscited by 0