InfiniDreamer: Arbitrarily Long Human Motion Generation via Segment Score Distillation
Not on the map. Why?
Abstract (arXiv)
We present InfiniDreamer, a novel framework for arbitrarily long human motion generation. InfiniDreamer addresses the limitations of current motion generation methods, which are typically restricted to short sequences due to the lack of long motion training data. To achieve this, we first generate sub-motions corresponding to each textual description and then assemble them into a coarse, extended sequence using randomly initialized transition segments. We then introduce an optimization-based method called Segment Score Distillation (SSD) to refine the entire long motion sequence. SSD is designed to utilize an existing motion prior, which is trained only on short clips, in a training-free manner. Specifically, SSD iteratively refines overlapping short segments sampled from the coarsely extended long motion sequence, progressively aligning them with the pre-trained motion diffusion prior. This process ensures local coherence within each segment, while the refined transitions between segments maintain global consistency across the entire sequence. Extensive qualitative and quantitative experiments validate the superiority of our framework, showcasing its ability to generate coherent, contextually aware motion sequences of arbitrary length.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 62 of its 91 references that are in the map. First posted on arXiv 27 Nov 2024.
Builds on
62 of 91 references.
References · 62
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2017Neural Discrete Representation Learningcited by 4,712
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
38 more
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2022Human Motion Diffusion Modelcited by 1,080
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2023Adversarial Diffusion Distillationcited by 759
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
- 2023Human Motion Diffusion as a Generative Priorcited by 357
- 2016The KIT Motion-Language Datasetcited by 338
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
- 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2021Character Controllers Using Motion VAEscited by 184
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
- 2023Text-to-3D with Classifier Score Distillationcited by 128
- 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 117
- 2024Motion Mamba: Efficient and Long Sequence Motion Generationcited by 112
- 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 106
- 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 103
- 2023Noise-Free Score Distillationcited by 99
- 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
- 2022MultiAct: Long-Term 3D Human Motion Generation from Multiple Action Labelscited by 45
- 2020Perpetual Motion: Generating Unbounded Human Motioncited by 36
- 2024Knowledge-Enhanced Dual-stream Zero-shot Composed Image Retrievalcited by 36
- 2024FreeEdit: Mask-free Reference-based Image Editing with Multi-modal Instructioncited by 36
- 2023AMD: Autoregressive Motion Diffusioncited by 30
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 7; 2026: 4.
12 papers.
- 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
- 2025Absolute Coordinates Make Motion Generation Easycited by 29
- 2025PlanGen: Towards Unified Layout Planning and Image Generation in Auto-Regressive Vision Language Modelscited by 18
- 2025DynamicID: Zero-Shot Multi-ID Image Personalization with Flexible Facial Editabilitycited by 10
- 2025Motion-R1: Enhancing Motion Generation with Decomposed Chain-of-Thought and RL Bindingcited by 9
- 2025From Trial to Triumph: Advancing Long Video Understanding via Visual Context Sample Scaling and Self-reward Alignmentcited by 6
- 2025LongAnimation: Long Animation Generation with Dynamic Global-Local Memorycited by 6
- 2025Less is More: Improving Motion Diffusion Models with Sparse Keyframescited by 0
- 2026Multi-scale Coarse-to-fine Modeling for Test-time Human Motion Controlcited by 0
- 2026Training-free Controllable Human Motion Generation under Heterogeneous Constraintscited by 0
- 2026ARMS: Anchor-Relational Motion Streaming for Seamless Solo-Social Motion Transitionscited by 0
- 2026StreamTalk: Streaming Co-Speech Gesture Generation with Key-Pose Anchoringcited by 0
- 2026StreamTalk: Streaming Co-Speech Gesture Generation with Key-Pose Anchoring3 Aug 2026
- 2026ARMS: Anchor-Relational Motion Streaming for Seamless Solo-Social Motion Transitions7 Jul 2026
- 2026Training-free Controllable Human Motion Generation under Heterogeneous Constraints2 Jul 2026
- 2026Multi-scale Coarse-to-fine Modeling for Test-time Human Motion Control14 May 2026
- 2025LongAnimation: Long Animation Generation with Dynamic Global-Local Memory2 Jul 2025
- 2025Motion-R1: Enhancing Motion Generation with Decomposed Chain-of-Thought and RL Binding12 Jun 2025
- 2025Absolute Coordinates Make Motion Generation Easy26 May 2025
- 2025From Trial to Triumph: Advancing Long Video Understanding via Visual Context Sample Scaling and Self-reward Alignment26 Mar 2025
- 2025Less is More: Improving Motion Diffusion Models with Sparse Keyframes18 Mar 2025
- 2025PlanGen: Towards Unified Layout Planning and Image Generation in Auto-Regressive Vision Language Models13 Mar 2025
- 2025DynamicID: Zero-Shot Multi-ID Image Personalization with Flexible Facial Editability9 Mar 2025
- 2024FonTS: Text Rendering with Typography and Style Controls28 Nov 2024
Similar, not cited
Close in wording, no citation either way
- 2026FrankenMotion: Part-level Human Motion Generation and Composition
- 2024Length-Aware Motion Synthesis via Latent Diffusion
- 2023DiffusionPhase: Motion Diffusion in Frequency Domain
- 2026PRISM: Streaming Human Motion Generation with Per-Joint Latent Decomposition
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregression
- 2025Object-Aware 4D Human Motion Generation
- 2023DiverseMotion: Towards Diverse Human Motion Generation via Discrete Diffusion
- 2024MotionMix: Weakly-Supervised Diffusion for Controllable Motion Generation