mlsanityData to 14 Oct 2026

InfiniDreamer: Arbitrarily Long Human Motion Generation via Segment Score Distillation

arXiv 2411.18303 ↗First posted 27 Nov 2024cs.CVcited by 12

Not on the map. Why?

Abstract (arXiv)

We present InfiniDreamer, a novel framework for arbitrarily long human motion generation. InfiniDreamer addresses the limitations of current motion generation methods, which are typically restricted to short sequences due to the lack of long motion training data. To achieve this, we first generate sub-motions corresponding to each textual description and then assemble them into a coarse, extended sequence using randomly initialized transition segments. We then introduce an optimization-based method called Segment Score Distillation (SSD) to refine the entire long motion sequence. SSD is designed to utilize an existing motion prior, which is trained only on short clips, in a training-free manner. Specifically, SSD iteratively refines overlapping short segments sampled from the coarsely extended long motion sequence, progressively aligning them with the pre-trained motion diffusion prior. This process ensures local coherence within each segment, while the refined transitions between segments maintain global consistency across the entire sequence. Extensive qualitative and quantitative experiments validate the superiority of our framework, showcasing its ability to generate coherent, contextually aware motion sequences of arbitrary length.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 62 of its 91 references that are in the map. First posted on arXiv 27 Nov 2024.

Builds on

62 of 91 references.

References · 62

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  7. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  8. 2017Neural Discrete Representation Learningcited by 4,712
  9. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  10. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  12. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
38 more
  1. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  2. 2022Human Motion Diffusion Modelcited by 1,080
  3. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  4. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  5. 2023Adversarial Diffusion Distillationcited by 759
  6. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  7. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  8. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  9. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  10. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  11. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
  12. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  13. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
  14. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
  15. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  16. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
  17. 2023Human Motion Diffusion as a Generative Priorcited by 357
  18. 2016The KIT Motion-Language Datasetcited by 338
  19. 2023Text-to-3D using Gaussian Splattingcited by 299
  20. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  21. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
  22. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
  23. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  24. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  25. 2021Character Controllers Using Motion VAEscited by 184
  26. 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
  27. 2023Text-to-3D with Classifier Score Distillationcited by 128
  28. 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 117
  29. 2024Motion Mamba: Efficient and Long Sequence Motion Generationcited by 112
  30. 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 106
  31. 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 103
  32. 2023Noise-Free Score Distillationcited by 99
  33. 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
  34. 2022MultiAct: Long-Term 3D Human Motion Generation from Multiple Action Labelscited by 45
  35. 2020Perpetual Motion: Generating Unbounded Human Motioncited by 36
  36. 2024Knowledge-Enhanced Dual-stream Zero-shot Composed Image Retrievalcited by 36
  37. 2024FreeEdit: Mask-free Reference-based Image Editing with Multi-modal Instructioncited by 36
  38. 2023AMD: Autoregressive Motion Diffusioncited by 30

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 7; 2026: 4.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026FrankenMotion: Part-level Human Motion Generation and Composition
  2. 2024Length-Aware Motion Synthesis via Latent Diffusion
  3. 2023DiffusionPhase: Motion Diffusion in Frequency Domain
  4. 2026PRISM: Streaming Human Motion Generation with Per-Joint Latent Decomposition
  5. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregression
  6. 2025Object-Aware 4D Human Motion Generation
  7. 2023DiverseMotion: Towards Diverse Human Motion Generation via Discrete Diffusion
  8. 2024MotionMix: Weakly-Supervised Diffusion for Controllable Motion Generation