mlsanityData to 7 Oct 2026

ReAlign: Text-to-Motion Generation via Step-Aware Reward-Guided Alignment

arXiv 2511.19217 ↗First posted 24 Nov 2025cs.CVcited by 10

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Text-to-motion generation, which synthesizes 3D human motions from text inputs, holds immense potential for applications in gaming, film, and robotics. Recently, diffusion-based methods have been shown to generate more diversity and realistic motion. However, there exists a misalignment between text and motion distributions in diffusion models, which leads to semantically inconsistent or low-quality motions. To address this limitation, we propose Reward-guided sampling Alignment (ReAlign), comprising a step-aware reward model to assess alignment quality during the denoising sampling and a reward-guided strategy that directs the diffusion process toward an optimally aligned distribution. This reward model integrates step-aware tokens and combines a text-aligned module for semantic consistency and a motion-aligned module for realism, refining noisy motions at each timestep to balance probability density and alignment. Extensive experiments of both motion generation and retrieval tasks demonstrate that our approach significantly improves text-motion alignment and motion quality compared to existing state-of-the-art methods.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 41 of its 46 references that are in the map. First posted on arXiv 24 Nov 2025.

Builds on

41 of 46 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024SoPo: Text-to-Motion Generation Using Semi-Online Preference Optimization6 Dec
  2. 2024MotionRL: Align Text-to-Motion Generation to Human Preferences with Multi-Reward Reinforcement Learning9 Oct
  3. 2024Aesthetic Post-Training Diffusion Models from Generic Preferences with Step-by-step Preference Optimization6 Jun

Other references · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  8. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  9. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  10. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  11. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  12. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
26 more
  1. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  2. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  3. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
  4. 2016The KIT Motion-Language Datasetcited by 334
  5. 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Trainingcited by 291
  6. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
  7. 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
  8. 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 211
  9. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
  10. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
  11. 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 137
  12. 2024Unlocking Guidance for Discrete State-Space Diffusion and Flow Modelscited by 124
  13. 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 105
  14. 2023Score Regularized Policy Optimization through Diffusion Behaviorcited by 67
  15. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 66
  16. 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
  17. 2024LaMP: Language-Motion Pretraining for Motion Generation, Retrieval, and Captioningcited by 58
  18. 2024ParCo: Part-Coordinating Text-to-Motion Synthesiscited by 51
  19. 2023OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllerscited by 47
  20. 2024MoGenTS: Motion Generation based on Spatial-Temporal Joint Modelingcited by 40
  21. 2024EnergyMoGen: Compositional Human Motion Generation with Energy-Based Diffusion Model in Latent Spacecited by 30
  22. 2025MG-MotionLLM: A Unified Framework for Motion Comprehension and Generation across Multiple Granularitiescited by 29
  23. 2024Towards a mathematical theory for consistency training in diffusion modelscited by 25
  24. 2024ReinDiffuse: Crafting Physically Plausible Motions with Reinforced Diffusion Modelcited by 25
  25. 2025Foundation Model for Skeleton-Based Human Action Understandingcited by 11
  26. 2025FineMotion: A Dataset and Benchmark with both Spatial and Temporal Annotation for Fine-grained Motion Generation and Editingcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReAlign: Bilingual Text-to-Motion Generation via Step-Aware Reward-Guided Alignment
  2. 2024LEAD: Latent Realignment for Human Motion Diffusion
  3. 2026Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generation
  4. 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generation
  5. 2025MotionFlux: Efficient Text-Guided Motion Generation through Rectified Flow Matching and Preference Alignment
  6. 2024MoDiPO: text-to-motion alignment via AI-feedback-driven Direct Preference Optimization
  7. 2023Towards Detailed Text-to-Motion Synthesis via Basic-to-Advanced Hierarchical Diffusion Model
  8. 2022Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Model