mlsanityData to 14 Oct 2026

BiMoGen: Bidirectional Motion-Text Generation via Unified Masked Discrete Diffusion

arXiv 2609.35407 ↗First posted 28 Sep 2026cs.CVcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Text-to-motion generation and motion-to-text captioning are two fundamental tasks in human motion modeling, both grounded in the same underlying motion-text correspondence. Existing unified approaches mostly rely on autoregressive modeling, which imposes a fixed generation order and is therefore poorly suited to the bidirectional dependencies between language and motion, allowing early prediction errors to persist as fixed context and degrade both temporal coherence and cross-modal consistency. Masked discrete diffusion, which models sequences through iterative bidirectional prediction, offers a natural remedy. We therefore propose BiMoGen (Bidirectional Motion-text Generation), a unified masked discrete diffusion framework for bidirectional motion-text modeling. To stabilize training, we design Decoupled Uni- and Cross-Modal Training, in which masked pretraining first establishes cross-modal correspondence on paired motion-text sequences, after which supervised fine-tuning specializes the model for bidirectional generation. Masked diffusion nonetheless introduces its own source of error, as the model is trained on clean ground-truth context yet encounters self-generated and potentially erroneous context at inference, with errors committed under heavily masked states propagating through subsequent steps. We further introduce Generation-Aware Self-Correction that exposes the model to its own predictions during training and applies correction passes at early sampling steps to revise unreliably committed tokens. Extensive experiments on HumanML3D and KIT-ML demonstrate competitive performance on both tasks, validating the effectiveness of the proposed two-stage training and self-correction designs. The project page is available at https://wengwanjiang.github.io/BiMoGen-Page.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 60 of its 66 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

60 of 66 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026DiMo: Discrete Diffusion Modeling for Motion Generation and Understanding4 Feb
  2. 2025MixerMDM: Learnable Composition of Human Motion Diffusion Models1 Apr
  3. 2024EnergyMoGen: Compositional Human Motion Generation with Energy-Based Diffusion Model in Latent Space19 Dec
  4. 2024MoTe: Learning Motion-Text Diffusion Model for Multiple Generation Tasks29 Nov
  5. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model30 Apr
  6. 2023EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generation4 Dec
  7. 2023Priority-Centric Human Motion Generation in Discrete Latent Space28 Aug
  8. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model3 Apr
  9. 2022Executing your Commands via Motion Diffusion in Latent Space8 Dec
  10. 2022Human Motion Diffusion Model29 Sep
  11. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug

Other references · 49

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2022Classifier-Free Diffusion Guidancecited by 5,847
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  4. 2017Neural Discrete Representation Learningcited by 4,712
  5. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  6. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  7. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  8. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  9. 2025Large Language Diffusion Modelscited by 912
  10. 2024Simple and Effective Masked Diffusion Language Modelscited by 848
  11. 2024Genie: Generative Interactive Environmentscited by 747
  12. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 745
37 more
  1. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  2. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  3. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  4. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
  5. 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 409
  6. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
  7. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  8. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
  9. 2016The KIT Motion-Language Datasetcited by 338
  10. 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 274
  11. 2022DiffusionBERT: Improving Generative Masked Language Models with Diffusion Modelscited by 214
  12. 2022Continuous diffusion for categorical datacited by 214
  13. 2023AR-Diffusion: Auto-Regressive Diffusion Model for Text Generationcited by 118
  14. 2024Motion Mamba: Efficient and Long Sequence Motion Generationcited by 112
  15. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
  16. 2025LaViDa: A Large Diffusion Language Model for Multimodal Understandingcited by 84
  17. 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 68
  18. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 67
  19. 2024LaMP: Language-Motion Pretraining for Motion Generation, Retrieval, and Captioningcited by 59
  20. 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 59
  21. 2024ParCo: Part-Coordinating Text-to-Motion Synthesiscited by 55
  22. 2024BAMM: Bidirectional Autoregressive Motion Modelcited by 55
  23. 2024The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motioncited by 46
  24. 2025FUDOKI: Discrete Flow-based Unified Understanding and Generation via Kinetic-Optimal Velocitiescited by 46
  25. 2024MoGenTS: Motion Generation based on Spatial-Temporal Joint Modelingcited by 41
  26. 2022Unified Discrete Diffusion for Simultaneous Vision-Language Generationcited by 39
  27. 2025MotionGPT3: Human Motion as a Second Modalitycited by 37
  28. 2025MG-MotionLLM: A Unified Framework for Motion Comprehension and Generation across Multiple Granularitiescited by 30
  29. 2025Absolute Coordinates Make Motion Generation Easycited by 29
  30. 2024KinMo: Kinematic-aware Human Motion Understanding and Generationcited by 21
  31. 2025ReAlign: Text-to-Motion Generation via Step-Aware Reward-Guided Alignmentcited by 13
  32. 2025FineMotion: A Dataset and Benchmark with both Spatial and Temporal Annotation for Fine-grained Motion Generation and Editingcited by 11
  33. 2025ReMoMask: Retrieval-Augmented Masked Motion Generationcited by 11
  34. 2024VersatileMotion: A Unified Framework for Motion Synthesis and Comprehensioncited by 9
  35. 2026UniMotion: A Unified Framework for Motion-Text-Vision Understanding and Generationcited by 4
  36. 2026Next-Scale Autoregressive Models for Text-to-Motion Generationcited by 4
  37. 2026UniMo: Unified Motion Generation and Understanding with Chain of Thoughtcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Models
  2. 2024Text-driven Human Motion Generation with Motion Masked Diffusion Model
  3. 2022Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Model
  4. 2023MMM: Generative Masked Motion Model
  5. 2025PackDiT: Joint Human Motion and Text Generation via Mutual Prompting
  6. 2023DiffusionPhase: Motion Diffusion in Frequency Domain
  7. 2023Towards Detailed Text-to-Motion Synthesis via Basic-to-Advanced Hierarchical Diffusion Model
  8. 2026Timo: Taming Multimodal Diffusion Transformer for Human Motion Generation