ReAlign: Text-to-Motion Generation via Step-Aware Reward-Guided Alignment
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Text-to-motion generation, which synthesizes 3D human motions from text inputs, holds immense potential for applications in gaming, film, and robotics. Recently, diffusion-based methods have been shown to generate more diversity and realistic motion. However, there exists a misalignment between text and motion distributions in diffusion models, which leads to semantically inconsistent or low-quality motions. To address this limitation, we propose Reward-guided sampling Alignment (ReAlign), comprising a step-aware reward model to assess alignment quality during the denoising sampling and a reward-guided strategy that directs the diffusion process toward an optimally aligned distribution. This reward model integrates step-aware tokens and combines a text-aligned module for semantic consistency and a motion-aligned module for realism, refining noisy motions at each timestep to balance probability density and alignment. Extensive experiments of both motion generation and retrieval tasks demonstrate that our approach significantly improves text-motion alignment and motion quality compared to existing state-of-the-art methods.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 41 of its 46 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
41 of 46 references.
Closest ancestors · 3
Same direction, newest first
- 2024SoPo: Text-to-Motion Generation Using Semi-Online Preference Optimization6 Dec
- 2024MotionRL: Align Text-to-Motion Generation to Human Preferences with Multi-Reward Reinforcement Learning9 Oct
- 2024Aesthetic Post-Training Diffusion Models from Generic Preferences with Step-by-step Preference Optimization6 Jun
Other references · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
26 more
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
- 2016The KIT Motion-Language Datasetcited by 334
- 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Trainingcited by 291
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
- 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
- 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 211
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 137
- 2024Unlocking Guidance for Discrete State-Space Diffusion and Flow Modelscited by 124
- 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 105
- 2023Score Regularized Policy Optimization through Diffusion Behaviorcited by 67
- 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 66
- 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
- 2024LaMP: Language-Motion Pretraining for Motion Generation, Retrieval, and Captioningcited by 58
- 2024ParCo: Part-Coordinating Text-to-Motion Synthesiscited by 51
- 2023OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllerscited by 47
- 2024MoGenTS: Motion Generation based on Spatial-Temporal Joint Modelingcited by 40
- 2024EnergyMoGen: Compositional Human Motion Generation with Energy-Based Diffusion Model in Latent Spacecited by 30
- 2025MG-MotionLLM: A Unified Framework for Motion Comprehension and Generation across Multiple Granularitiescited by 29
- 2024Towards a mathematical theory for consistency training in diffusion modelscited by 25
- 2024ReinDiffuse: Crafting Physically Plausible Motions with Reinforced Diffusion Modelcited by 25
- 2025Foundation Model for Skeleton-Based Human Action Understandingcited by 11
- 2025FineMotion: A Dataset and Benchmark with both Spatial and Temporal Annotation for Fine-grained Motion Generation and Editingcited by 9
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026ConsistentRFT: Reducing Visual Hallucinations in Flow-based Reinforcement Fine-Tuningcited by 5
- 2026Temporal Consistency-Aware Text-to-Motion Generationcited by 5
- 2026EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generationcited by 3
- 2026Attribution as Retrieval: Model-Agnostic AI-Generated Image Attributioncited by 3
- 2026Coordinate-Based Dual-Constrained Autoregressive Motion Generationcited by 1
- 2026Reconstruction-Anchored Diffusion Model for Text-to-Motion Generationcited by 0
- 2026MotionRFT: Unified Reinforcement Fine-Tuning for Text-to-Motion Generationcited by 0
- 2026MultiAct: Text-to-Motion Generation from Composite Text via Tailored Attention Guidancecited by 0
- 2026Training-free Controllable Human Motion Generation under Heterogeneous Constraintscited by 0
- 2026BiMoGen: Bidirectional Motion-Text Generation via Unified Masked Discrete Diffusioncited by 0
- 2026BiMoGen: Bidirectional Motion-Text Generation via Unified Masked Discrete Diffusion28 Sep 2026
- 2026Training-free Controllable Human Motion Generation under Heterogeneous Constraints2 Jul 2026
- 2026MultiAct: Text-to-Motion Generation from Composite Text via Tailored Attention Guidance29 May 2026
- 2026Coordinate-Based Dual-Constrained Autoregressive Motion Generation9 Apr 2026
- 2026MotionRFT: Unified Reinforcement Fine-Tuning for Text-to-Motion Generation28 Mar 2026
- 2026Attribution as Retrieval: Model-Agnostic AI-Generated Image Attribution11 Mar 2026
- 2026Temporal Consistency-Aware Text-to-Motion Generation20 Feb 2026
- 2026EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generation8 Feb 2026
- 2026ConsistentRFT: Reducing Visual Hallucinations in Flow-based Reinforcement Fine-Tuning3 Feb 2026
- 2026Reconstruction-Anchored Diffusion Model for Text-to-Motion Generation21 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025ReAlign: Bilingual Text-to-Motion Generation via Step-Aware Reward-Guided Alignment
- 2024LEAD: Latent Realignment for Human Motion Diffusion
- 2026Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generation
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generation
- 2025MotionFlux: Efficient Text-Guided Motion Generation through Rectified Flow Matching and Preference Alignment
- 2024MoDiPO: text-to-motion alignment via AI-feedback-driven Direct Preference Optimization
- 2023Towards Detailed Text-to-Motion Synthesis via Basic-to-Advanced Hierarchical Diffusion Model
- 2022Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Model