Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Diffusion-based text-to-motion models synthesize realistic human motions but often exhibit semantic drift from the input text. Motion is inherently temporal, especially in compositional and long-duration sequences that require semantic consistency across multiple action segments and smooth kinematic transitions throughout the trajectory. We posit that the initial noise is central to this consistency: within the Gaussian noise space, certain instances, i.e. winning noise tickets, carry latent structure that biases denoising toward particular motion semantics, even under null prompts. We propose WInning Noise Retrieval and Optimization (WINRO), a training-free, model-agnostic framework that improves text-motion alignment by selecting and refining such tickets before diffusion sampling. WINRO maps random noises to motion features generated under null prompts, retrieves the best-aligned noise for a given text, and refines it via a KL-regularized objective that reduces the residual semantic gap while preserving the Gaussian prior. An optional LoRA-based adapter amortizes this refinement into a single forward pass. WINRO consistently improves text-motion fidelity across different base models, MDM and MotionLCM, on HumanML3D without retraining, improves temporal robustness on the MTT benchmark, and generalizes to applications such as motion stylization and spatial constraint satisfaction.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 37 of its 43 references that are in the map. First posted on arXiv 7 Jul 2026.
Builds on
37 of 43 references.
Closest ancestors · 8
Same direction, newest first
- 2025PINO: Person-Interaction Noise Optimization for Long-Duration and Customizable Motion Generation of Arbitrary-Sized Groups25 Jul
- 2025SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editing18 Mar
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model30 Apr
- 2023Optimizing Diffusion Noise Can Serve As Universal Motion Priors19 Dec
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model3 Apr
- 2022Executing your Commands via Motion Diffusion in Latent Space8 Dec
- 2022Human Motion Diffusion Model29 Sep
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug
Other references · 29
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
- 2016The KIT Motion-Language Datasetcited by 338
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 206
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
- 2020DLow: Diversifying Latent Flows for Diverse Human Motion Predictioncited by 185
- 2021Synthesis of Compositional Animations from Textual Descriptionscited by 178
17 more
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 142
- 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimizationcited by 123
- 2024ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimizationcited by 119
- 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 91
- 2022ActFormer: A GAN-based Transformer towards General Action-Conditioned 3D Human Motion Generationcited by 77
- 2022Real-Time Style Modelling of Human Locomotion via Feature-Wise Transformations and Local Motion Phasescited by 72
- 2023Guided Image Synthesis via Initial Image Editing in Diffusion Modelcited by 63
- 2024Good Seed Makes a Good Crop: Discovering Secret Seeds in Text-to-Image Diffusion Modelscited by 48
- 2024SMooDi: Stylized Motion Diffusion Modelcited by 37
- 2025Noise Hypernetworks: Amortizing Test-Time Compute in Diffusion Modelscited by 35
- 2023The Lottery Ticket Hypothesis in Denoising: Towards Semantic-Driven Initializationcited by 23
- 2024Exploring Vision Transformers for 3D Human Motion-Language Models with Motion Patchescited by 22
- 2024Programmable Motion Generation for Open-Set Motion Control Taskscited by 20
- 2024FIND: Fine-tuning Initial Noise Distribution with Policy Optimization for Diffusion Modelscited by 20
- 2024Chronologically Accurate Retrieval for Temporal Grounding of Motion-Language Modelscited by 12
- 2025ReMoMask: Retrieval-Augmented Masked Motion Generationcited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025ReAlign: Text-to-Motion Generation via Step-Aware Reward-Guided Alignment
- 2024LEAD: Latent Realignment for Human Motion Diffusion
- 2023Towards Detailed Text-to-Motion Synthesis via Basic-to-Advanced Hierarchical Diffusion Model
- 2022Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Model
- 2026Reconstruction-Anchored Diffusion Model for Text-to-Motion Generation
- 2024MotionMix: Weakly-Supervised Diffusion for Controllable Motion Generation
- 2023Priority-Centric Human Motion Generation in Discrete Latent Space
- 2026DiMo: Discrete Diffusion Modeling for Motion Generation and Understanding