mlsanityData to 7 Oct 2026

Infinite Motion: Extended Motion Generation via Long Text Instructions

arXiv 2407.08443 ↗First posted 11 Jul 2024cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

In the realm of motion generation, the creation of long-duration, high-quality motion sequences remains a significant challenge. This paper presents our groundbreaking work on "Infinite Motion", a novel approach that leverages long text to extended motion generation, effectively bridging the gap between short and long-duration motion synthesis. Our core insight is the strategic extension and reassembly of existing high-quality text-motion datasets, which has led to the creation of a novel benchmark dataset to facilitate the training of models for extended motion sequences. A key innovation of our model is its ability to accept arbitrary lengths of text as input, enabling the generation of motion sequences tailored to specific narratives or scenarios. Furthermore, we incorporate the timestamp design for text which allows precise editing of local segments within the generated sequences, offering unparalleled control and flexibility in motion synthesis. We further demonstrate the versatility and practical utility of "Infinite Motion" through three specific applications: natural language interactive editing, motion sequence editing within long sequences and splicing of independent motion sequences. Each application highlights the adaptability of our approach and broadens the spectrum of possibilities for research and development in motion generation. Through extensive experiments, we demonstrate the superior performance of our model in generating long sequence motions compared to existing methods.Project page: https://shuochengzhai.github.io/Infinite-motion.github.io/

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 30 of its 35 references that are in the map. First posted on arXiv 11 Jul 2024.

Builds on

30 of 35 references.

References · 30

  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  2. 2022Classifier-Free Diffusion Guidancecited by 5,717
  3. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  4. 2022Human Motion Diffusion Modelcited by 1,062
  5. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  6. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  7. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  8. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
  9. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  10. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  11. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  12. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
18 more
  1. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  2. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
  3. 2023Human Motion Diffusion as a Generative Priorcited by 354
  4. 2016The KIT Motion-Language Datasetcited by 334
  5. 2022EDGE: Editable Dance Generation From Musiccited by 284
  6. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
  7. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  8. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  9. 2021Character Controllers Using Motion VAEscited by 182
  10. 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
  11. 2022TEACH: Temporal Action Composition for 3D Humanscited by 173
  12. 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 100
  13. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 88
  14. 2022MoDi: Unconditional Motion Synthesis from Diverse Datacited by 59
  15. 2022MultiAct: Long-Term 3D Human Motion Generation from Multiple Action Labelscited by 45
  16. 2020Perpetual Motion: Generating Unbounded Human Motioncited by 36
  17. 2024Exploring Vision Transformers for 3D Human Motion-Language Models with Motion Patchescited by 22
  18. 2024Tri-Modal Motion Retrieval by Learning a Joint Embedding Spacecited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.