mlsanityData to 7 Oct 2026

BAMM: Bidirectional Autoregressive Motion Model

arXiv 2403.19435 ↗First posted 28 Mar 2024cs.CVcited by 54

Not on the map. Why?

Abstract (arXiv)

Generating human motion from text has been dominated by denoising motion models either through diffusion or generative masking process. However, these models face great limitations in usability by requiring prior knowledge of the motion length. Conversely, autoregressive motion models address this limitation by adaptively predicting motion endpoints, at the cost of degraded generation quality and editing capabilities. To address these challenges, we propose Bidirectional Autoregressive Motion Model (BAMM), a novel text-to-motion generation framework. BAMM consists of two key components: (1) a motion tokenizer that transforms 3D human motion into discrete tokens in latent space, and (2) a masked self-attention transformer that autoregressively predicts randomly masked tokens via a hybrid attention masking strategy. By unifying generative masked modeling and autoregressive modeling, BAMM captures rich and bidirectional dependencies among motion tokens, while learning the probabilistic mapping from textual inputs to motion outputs with dynamically-adjusted motion sequence length. This feature enables BAMM to simultaneously achieving high-quality motion generation with enhanced usability and built-in motion editability. Extensive experiments on HumanML3D and KIT-ML datasets demonstrate that BAMM surpasses current state-of-the-art methods in both qualitative and quantitative measures. Our project page is available at https://exitudio.github.io/BAMM-page

Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). Builds on 44 of its 49 references that are in the map. First posted on arXiv 28 Mar 2024.

Builds on

44 of 49 references.

References · 44

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  8. 2022Classifier-Free Diffusion Guidancecited by 5,717
  9. 2017Neural Discrete Representation Learningcited by 4,650
  10. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  11. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  12. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
32 more
  1. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  2. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  3. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  4. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  5. 2022Human Motion Diffusion Modelcited by 1,062
  6. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
  7. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  8. 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
  9. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
  10. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
  11. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  12. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  13. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
  14. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  15. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
  16. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
  17. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
  18. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  19. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
  20. 2016The KIT Motion-Language Datasetcited by 334
  21. 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 305
  22. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  23. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  24. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
  25. 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
  26. 2023MMM: Generative Masked Motion Modelcited by 129
  27. 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 116
  28. 2023SoundStorm: Efficient Parallel Audio Generationcited by 111
  29. 2020Glancing Transformer for Non-Autoregressive Neural Machine Translationcited by 103
  30. 2023Fg-T2M: Fine-Grained Text-Driven Human Motion Generation via Diffusion Modelcited by 79
  31. 2023Priority-Centric Human Motion Generation in Discrete Latent Spacecited by 66
  32. 2021M6-UFC: Unifying Multi-Modal Controls for Conditional Image Synthesis via Non-Autoregressive Generative Transformerscited by 36

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 23; 2026: 22.

54 papers.

Sort:

By area:

  1. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 82
  2. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 78
  3. 2025Motion Anything: Any to Motion Generationcited by 40
  4. 2024SMooDi: Stylized Motion Diffusion Modelcited by 37
  5. 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesiscited by 37
  6. 2025Absolute Coordinates Make Motion Generation Easycited by 27
  7. 2025ChainHOI: Joint-based Kinematic Chain Modeling for Human-Object Interaction Generationcited by 19
  8. 2024CoMA: Compositional Human Motion Generation with Multi-modal Agentscited by 18
  9. 2024DisCoRD: Discrete Tokens to Continuous Motion via Rectified Flow Decodingcited by 17
  10. 2025EchoMask: Speech-Queried Attention-based Mask Modeling for Holistic Co-Speech Motion Generationcited by 17
  11. 2025HERO: Human Reaction Generation from Videoscited by 15
  12. 2024BAD: Bidirectional Auto-regressive Diffusion for Text-to-Motion Generationcited by 12
38 more
  1. 2024MoLA: Motion Generation and Editing with Latent Diffusion Enhanced by Adversarial Trainingcited by 9
  2. 2025Progressive Human Motion Generation Based on Text and Few Motion Framescited by 8
  3. 2025Text-driven Motion Generation: Overview, Challenges and Directionscited by 8
  4. 2025StyleMotif: Multi-Modal Motion Stylization using Style-Content Cross Fusioncited by 7
  5. 2024MoDiPO: text-to-motion alignment via AI-feedback-driven Direct Preference Optimizationcited by 6
  6. 2024BiPO: Bidirectional Partial Occlusion Network for Text-to-Motion Synthesiscited by 6
  7. 2026SafeMo: Linguistically Grounded Unlearning for Trustworthy Text-to-Motion Generationcited by 6
  8. 2025MoSa: Motion Generation with Scalable Autoregressive Modelingcited by 5
  9. 2026Temporal Consistency-Aware Text-to-Motion Generationcited by 5
  10. 2025Dyadic Mamba: Long-term Dyadic Human Motion Synthesiscited by 4
  11. 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generationcited by 4
  12. 2026BiMotion: B-spline Motion for Text-guided Dynamic 3D Character Generationcited by 4
  13. 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planningcited by 4
  14. 2026Next-Scale Autoregressive Models for Text-to-Motion Generationcited by 4
  15. 2026LiveGesture Streamable Co-Speech Gesture Generation Modelcited by 4
  16. 2025Human Motion Unlearningcited by 3
  17. 2025Think Before You Move: Latent Motion Reasoning for Text-to-Motion Generationcited by 3
  18. 2026SentiAvatar: Towards Expressive and Interactive Digital Humanscited by 3
  19. 2026MotionHiFlow: Text-to-motion via hierarchical flow matchingcited by 3
  20. 2026ScaleMoGen: Autoregressive Next-Scale Prediction for Human Motion Generationcited by 3
  21. 2025Efficient Explicit Joint-level Interaction Modeling with Mamba for Text-guided HOI Generationcited by 2
  22. 2025MoCLIP: Motion-Aware Fine-Tuning and Distillation of CLIP for Human Motion Generationcited by 2
  23. 2025PlanMoGPT: Flow-Enhanced Progressive Planning for Text to Motion Synthesiscited by 2
  24. 2025MoLingo: Motion-Language Alignment for Text-to-Human Motion Generationcited by 2
  25. 2026Language-Guided Transformer Tokenizer for Human Motion Generationcited by 2
  26. 2025Multi-granular body modeling with Redundancy-Free Spatiotemporal Fusion for Text-Driven Motion Generationcited by 1
  27. 2025Multimodal Generative AI with Autoregressive LLMs for Human Motion Understanding and Generation: A Way Forwardcited by 1
  28. 2025ClusterStyle: Modeling Intra-Style Diversity with Prototypical Clustering for Stylized Motion Generationcited by 1
  29. 2026Coordinate-Based Dual-Constrained Autoregressive Motion Generationcited by 1
  30. 2026AnyMo: Scaling Any-Modality Conditional Motion Generation with Masked Modelingcited by 1
  31. 2026HOIMask: Towards Generative Masked Modeling for Human Object Interaction Generationcited by 1
  32. 2025MoGIC: Boosting Motion Generation via Intention Understanding and Visual Contextcited by 0
  33. 2025SceneAdapt: Scene-aware Adaptation of Human Motion Diffusioncited by 0
  34. 2026Reconstruction-Anchored Diffusion Model for Text-to-Motion Generationcited by 0
  35. 2026TriC-Motion: Tri-Domain Causal Modeling Grounded Text-to-Motion Generationcited by 0
  36. 2026ParTY: Part-Guidance for Expressive Text-to-Motion Synthesiscited by 0
  37. 2026NOUS: Video-Driven 3D Human Reaction Generation via Observation-Reaction Mutual Steeringcited by 0
  38. 2026Marrying Text-to-Motion Generation with Skeleton-Based Action Recognitioncited by 0

50 most cited of 54 All 54 (JSON)