mlsanityData to 14 Oct 2026

Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generation

arXiv 2607.06843 ↗First posted 7 Jul 2026cs.CVcited by 1

On the map: Diffusion models → Video generation

Abstract (arXiv)

Diffusion-based text-to-motion models synthesize realistic human motions but often exhibit semantic drift from the input text. Motion is inherently temporal, especially in compositional and long-duration sequences that require semantic consistency across multiple action segments and smooth kinematic transitions throughout the trajectory. We posit that the initial noise is central to this consistency: within the Gaussian noise space, certain instances, i.e. winning noise tickets, carry latent structure that biases denoising toward particular motion semantics, even under null prompts. We propose WInning Noise Retrieval and Optimization (WINRO), a training-free, model-agnostic framework that improves text-motion alignment by selecting and refining such tickets before diffusion sampling. WINRO maps random noises to motion features generated under null prompts, retrieves the best-aligned noise for a given text, and refines it via a KL-regularized objective that reduces the residual semantic gap while preserving the Gaussian prior. An optional LoRA-based adapter amortizes this refinement into a single forward pass. WINRO consistently improves text-motion fidelity across different base models, MDM and MotionLCM, on HumanML3D without retraining, improves temporal robustness on the MTT benchmark, and generalizes to applications such as motion stylization and spatial constraint satisfaction.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 37 of its 43 references that are in the map. First posted on arXiv 7 Jul 2026.

Builds on

37 of 43 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025PINO: Person-Interaction Noise Optimization for Long-Duration and Customizable Motion Generation of Arbitrary-Sized Groups25 Jul
  2. 2025SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editing18 Mar
  3. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model30 Apr
  4. 2023Optimizing Diffusion Noise Can Serve As Universal Motion Priors19 Dec
  5. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model3 Apr
  6. 2022Executing your Commands via Motion Diffusion in Latent Space8 Dec
  7. 2022Human Motion Diffusion Model29 Sep
  8. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug

Other references · 29

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
  4. 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
  5. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  6. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  7. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
  8. 2016The KIT Motion-Language Datasetcited by 338
  9. 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 206
  10. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
  11. 2020DLow: Diversifying Latent Flows for Diverse Human Motion Predictioncited by 185
  12. 2021Synthesis of Compositional Animations from Textual Descriptionscited by 178
17 more
  1. 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
  2. 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 142
  3. 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimizationcited by 123
  4. 2024ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimizationcited by 119
  5. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 91
  6. 2022ActFormer: A GAN-based Transformer towards General Action-Conditioned 3D Human Motion Generationcited by 77
  7. 2022Real-Time Style Modelling of Human Locomotion via Feature-Wise Transformations and Local Motion Phasescited by 72
  8. 2023Guided Image Synthesis via Initial Image Editing in Diffusion Modelcited by 63
  9. 2024Good Seed Makes a Good Crop: Discovering Secret Seeds in Text-to-Image Diffusion Modelscited by 48
  10. 2024SMooDi: Stylized Motion Diffusion Modelcited by 37
  11. 2025Noise Hypernetworks: Amortizing Test-Time Compute in Diffusion Modelscited by 35
  12. 2023The Lottery Ticket Hypothesis in Denoising: Towards Semantic-Driven Initializationcited by 23
  13. 2024Exploring Vision Transformers for 3D Human Motion-Language Models with Motion Patchescited by 22
  14. 2024Programmable Motion Generation for Open-Set Motion Control Taskscited by 20
  15. 2024FIND: Fine-tuning Initial Noise Distribution with Policy Optimization for Diffusion Modelscited by 20
  16. 2024Chronologically Accurate Retrieval for Temporal Grounding of Motion-Language Modelscited by 12
  17. 2025ReMoMask: Retrieval-Augmented Masked Motion Generationcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReAlign: Text-to-Motion Generation via Step-Aware Reward-Guided Alignment
  2. 2024LEAD: Latent Realignment for Human Motion Diffusion
  3. 2023Towards Detailed Text-to-Motion Synthesis via Basic-to-Advanced Hierarchical Diffusion Model
  4. 2022Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Model
  5. 2026Reconstruction-Anchored Diffusion Model for Text-to-Motion Generation
  6. 2024MotionMix: Weakly-Supervised Diffusion for Controllable Motion Generation
  7. 2023Priority-Centric Human Motion Generation in Discrete Latent Space
  8. 2026DiMo: Discrete Diffusion Modeling for Motion Generation and Understanding