FineXtrol: Controllable Motion Generation via Fine-Grained Text
Not on the map. Why?
Abstract (arXiv)
Recent works have sought to enhance the controllability and precision of text-driven motion generation. Some approaches leverage large language models (LLMs) to produce more detailed texts, while others incorporate global 3D coordinate sequences as additional control signals. However, the former often introduces misaligned details and lacks explicit temporal cues, and the latter incurs significant computational cost when converting coordinates to standard motion representations. To address these issues, we propose FineXtrol, a novel control framework for efficient motion generation guided by temporally-aware, precise, user-friendly, and fine-grained textual control signals that describe specific body part movements over time. In support of this framework, we design a hierarchical contrastive learning module that encourages the text encoder to produce more discriminative embeddings for our novel control signals, thereby improving motion controllability. Quantitative results show that FineXtrol achieves strong performance in controllable motion generation, while qualitative analysis demonstrates its flexibility in directing specific body part movements.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 34 of its 44 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
34 of 44 references.
References · 34
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,135
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
22 more
- 2022Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Taskscited by 511
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
- 2023Human Motion Diffusion as a Generative Priorcited by 357
- 2015Skip-Thought Vectorscited by 322
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
- 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 223
- 2018An efficient framework for learning sentence representationscited by 198
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 138
- 2017Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Featurescited by 104
- 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 67
- 2023PADL: Language-Directed Physics-Based Character Controlcited by 48
- 2022Action-GPT: Leveraging Large-scale Language Models for Improved and Generalized Action Generationcited by 28
- 2023InterControl: Zero-shot Human Interaction Generation by Controlling Every Jointcited by 23
- 2025Fg-T2M++: LLMs-Augmented Fine-Grained Text Driven Human Motion Generationcited by 21
- 2024SoPo: Text-to-Motion Generation Using Semi-Online Preference Optimizationcited by 15
- 2025FineMotion: A Dataset and Benchmark with both Spatial and Temporal Annotation for Fine-grained Motion Generation and Editingcited by 11
- 2025Foundation Model for Skeleton-Based Human Action Understandingcited by 11
- 2025DisFaceRep: Representation Disentanglement for Co-occurring Facial Components in Weakly Supervised Face Parsingcited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generationcited by 4
- 2026MotionRFT: Unified Reinforcement Fine-Tuning for Text-to-Motion Generationcited by 1
- 2026Reconstruction-Anchored Diffusion Model for Text-to-Motion Generationcited by 0
- 2026Per-Stroke Temporal Control for Text-to-Motion via Action Units and Action-Detection Guidancecited by 0
- 2026Per-Stroke Temporal Control for Text-to-Motion via Action Units and Action-Detection Guidance17 Jul 2026
- 2026MotionRFT: Unified Reinforcement Fine-Tuning for Text-to-Motion Generation28 Mar 2026
- 2026EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generation8 Feb 2026
- 2026Reconstruction-Anchored Diffusion Model for Text-to-Motion Generation21 Jan 2026