mlsanityData to 14 Oct 2026

Multi-granular body modeling with Redundancy-Free Spatiotemporal Fusion for Text-Driven Motion Generation

arXiv 2503.06897 ↗First posted 10 Mar 2025cs.CVcited by 1

On the map: State-space sequence models (S4, Mamba) → Video, motion and generative Mamba models

Abstract (arXiv)

Text-to-motion generation is a rapidly growing field at the nexus of multimodal learning and computer graphics, enabling flexible and cost-effective applications in gaming, animation, robotics, and virtual reality. Existing part-aware pipelines typically split the body into segments and then recover whole-body coordination via attention-based fusion, which incurs quadratic complexity and fails to model part-level and whole-body cues simultaneously. Moreover, we observe that naively stacking spatial and temporal modules accumulates redundant features, thereby requiring deeper networks to achieve competitive fidelity. To address these issues, we propose HiSTF Mamba, a linear-time framework composed of Dual-Spatial Mamba, Bi-Temporal Mamba, and the Dynamic Spatiotemporal Fusion Module (DSFM). Dual-Spatial Mamba performs parallel part-based and whole-based modeling to simultaneously capture local joint dynamics and global coordination. Bi-Temporal Mamba employs bidirectional scanning to encode both short-term motion details and long-term dependencies. DSFM further removes redundancy and extracts complementary temporal information before fusing it with spatial features, yielding an expressive spatiotemporal representation. Extensive experiments on HumanML3D and KIT-ML demonstrate that HiSTF Mamba improves generation fidelity and semantic alignment while requiring substantially fewer parameters than existing segment-based architectures.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video, motion and generative Mamba models, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 51 of its 61 references that are in the map. First posted on arXiv 10 Mar 2025.

Builds on

51 of 61 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024SpikeMba: Multi-Modal Spiking Saliency Mamba for Temporal Video Grounding1 Apr
  2. 2024Motion Mamba: Efficient and Long Sequence Motion Generation12 Mar
  3. 2024VideoMamba: State Space Model for Efficient Video Understanding11 Mar

Other references · 48

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2022Generative Adversarial Networkscited by 5,627
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  5. 2017Neural Discrete Representation Learningcited by 4,712
  6. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  7. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  8. 2022Human Motion Diffusion Modelcited by 1,080
  9. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  10. 2024VMamba: Visual State Space Modelcited by 969
  11. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  12. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
36 more
  1. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
  2. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
  3. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  4. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  5. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  6. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
  7. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  8. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
  9. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
  10. 2016The KIT Motion-Language Datasetcited by 338
  11. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  12. 2024LocalMamba: Visual State Space Model with Windowed Selective Scancited by 236
  13. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  14. 2021Synthesis of Compositional Animations from Textual Descriptionscited by 178
  15. 2017HP-GAN: Probabilistic 3D human motion prediction via GANcited by 176
  16. 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
  17. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
  18. 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mambacited by 146
  19. 2024PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognitioncited by 141
  20. 2023MMM: Generative Masked Motion Modelcited by 131
  21. 2017Text2Action: Generative Adversarial Synthesis from Language to Actioncited by 106
  22. 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 106
  23. 2023EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generationcited by 89
  24. 2018MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamicscited by 86
  25. 2023Fg-T2M: Fine-Grained Text-Driven Human Motion Generation via Diffusion Modelcited by 79
  26. 2022ActFormer: A GAN-based Transformer towards General Action-Conditioned 3D Human Motion Generationcited by 77
  27. 2024FreqMamba: Viewing Mamba from a Frequency Perspective for Image Derainingcited by 57
  28. 2018BiHMP-GAN: Bidirectional 3D Human Motion Prediction GANcited by 55
  29. 2024ParCo: Part-Coordinating Text-to-Motion Synthesiscited by 55
  30. 2024BAMM: Bidirectional Autoregressive Motion Modelcited by 55
  31. 2020High-Fidelity Neural Human Motion Transfer from Monocular Videocited by 31
  32. 2024Res-VMamba: Fine-Grained Food Category Visual Classification Using Selective State Space Models with Deep Residual Learningcited by 22
  33. 2022HiT-DVAE: Human Motion Generation via Hierarchical Transformer Dynamical VAEcited by 16
  34. 2024SparX: A Sparse Cross-Layer Connection Mechanism for Hierarchical Vision Mamba and Transformer Networkscited by 14
  35. 2024Text-driven Human Motion Generation with Motion Masked Diffusion Modelcited by 8
  36. 2024LS-GAN: Human Motion Synthesis with Latent-space GANscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understanding
  2. 2024FTMoMamba: Motion Generation with Frequency and Text State Space Models
  3. 2025M4V: Multimodal Mamba for Efficient Text-to-Video Generation
  4. 2023A Unified Framework for Multimodal, Multi-Part Human Motion Synthesis
  5. 2026Motion-Adapter: A Diffusion Model Adapter for Text-to-Motion Generation of Compound Actions
  6. 2024MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controls
  7. 2026Timo: Taming Multimodal Diffusion Transformer for Human Motion Generation
  8. 2024KMM: Key Frame Mask Mamba for Extended Motion Generation