T2M Mamba: Motion Periodicity-Saliency Coupling Approach for Stable Text-Driven Motion Generation
On the map: State-space sequence models (S4, Mamba) → Video, motion and generative Mamba models
Abstract (arXiv)
Text-to-motion generation, which converts motion language descriptions into coherent 3D human motion sequences, has attracted increasing attention in fields, such as avatar animation and humanoid robotic interaction. Though existing models have achieved significant fidelity, they still suffer from two core limitations: (i) They treat motion periodicity and keyframe saliency as independent factors, overlooking their coupling and causing generation drift in long sequences. (ii) They are fragile to semantically equivalent paraphrases, where minor synonym substitutions distort textual embeddings, propagating through the decoder and producing unstable or erroneous motions. In this work, we propose T2M Mamba to address these limitations by (i) proposing Periodicity-Saliency Aware Mamba, which utilizes novel algorithms for keyframe weight estimation via enhanced Density Peaks Clustering and motion periodicity estimation via FFT-accelerated autocorrelation to capture coupled dynamics with minimal computational overhead, and (ii) constructing a Periodic Differential Cross-modal Alignment Module (PDCAM) to enhance robust alignment of textual and motion embeddings. Extensive experiments on HumanML3D and KIT-ML datasets have been conducted, confirming the effectiveness of our approach, achieving an FID of 0.068 and consistent gains on all other metrics.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video, motion and generative Mamba models, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 27 of its 32 references that are in the map. First posted on arXiv 1 Feb 2026.
Builds on
27 of 32 references.
Closest ancestors · 5
Same direction, newest first
- 2025Multi-granular body modeling with Redundancy-Free Spatiotemporal Fusion for Text-Driven Motion Generation10 Mar
- 2024KMM: Key Frame Mask Mamba for Extended Motion Generation10 Nov
- 2024InfiniMotion: Mamba Boosts Memory in Transformer for Arbitrary Long Motion Generation14 Jul
- 2024Text-controlled Motion Mamba: Text-Instructed Temporal Grounding of Human Motion17 Apr
- 2024Motion Mamba: Efficient and Long Sequence Motion Generation12 Mar
Other references · 22
- 2017Attention Is All You Needcited by 59,932
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2022Human Motion Diffusion Modelcited by 1,062
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
10 more
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
- 2016The KIT Motion-Language Datasetcited by 334
- 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 116
- 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 77
- 2024SATO: Stable Text-to-Motion Frameworkcited by 20
- 2023DiffusionPhase: Motion Diffusion in Frequency Domaincited by 16
- 2022Deep Unsupervised Key Frame Extraction for Efficient Video Classificationcited by 14
- 2024Text-guided 3D Human Motion Generation with Keyframe-based Parallel Skip Transformercited by 8
- 2024Text-driven Human Motion Generation with Motion Masked Diffusion Modelcited by 8
- 2023Robust Dominant Periodicity Detection for Time Series with Missing Datacited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023MMM: Generative Masked Motion Model
- 2023Priority-Centric Human Motion Generation in Discrete Latent Space
- 2026Timo: Taming Multimodal Diffusion Transformer for Human Motion Generation
- 2024LEAD: Latent Realignment for Human Motion Diffusion
- 2023DiverseMotion: Towards Diverse Human Motion Generation via Discrete Diffusion
- 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Models
- 2024FTMoMamba: Motion Generation with Frequency and Text State Space Models
- 2026MotionHiFlow: Text-to-motion via hierarchical flow matching