mlsanityData to 14 Oct 2026

Bilingual Text-to-Motion Generation: A New Benchmark and Baselines

arXiv 2603.25178 ↗First posted 26 Mar 2026cs.CV cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-to-motion generation holds significant potential for cross-linguistic applications, yet it is hindered by the lack of bilingual datasets and the poor cross-lingual semantic understanding of existing language models. To address these gaps, we introduce BiHumanML3D, the first bilingual text-to-motion benchmark, constructed via LLM-assisted annotation and rigorous manual correction. Furthermore, we propose a simple yet effective baseline, Bilingual Motion Diffusion (BiMD), featuring Cross-Lingual Alignment (CLA). CLA explicitly aligns semantic representations across languages, creating a robust conditional space that enables high-quality motion generation from bilingual inputs, including zero-shot code-switching scenarios. Extensive experiments demonstrate that BiMD with CLA achieves an FID of 0.045 vs. 0.169 and R@3 of 82.8% vs. 80.8%, significantly outperforms monolingual diffusion models and translation baselines on BiHumanML3D, underscoring the critical necessity and reliability of our dataset and the effectiveness of our alignment strategy for cross-lingual motion synthesis. The dataset and code are released at hrefhttps://wengwanjiang.github.io/BilingualT2M-pagehttps://wengwanjiang.github.io/BilingualT2M-page

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 53 references that are in the map. First posted on arXiv 26 Mar 2026.

Builds on

15 of 53 references.

References · 15

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024Qwen2.5 Technical Reportcited by 4,942
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  4. 2017Decoupled Weight Decay Regularizationcited by 1,831
  5. 2024DeepSeek-V3 Technical Reportcited by 811
  6. 2019How multilingual is Multilingual BERT?cited by 645
  7. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
  8. 2022Chinese CLIP: Contrastive Vision-Language Pretraining in Chinesecited by 109
  9. 2022AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilitiescited by 85
  10. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
  11. 2025Seedream 2.0: A Native Chinese-English Bilingual Image Generation Foundation Modelcited by 62
  12. 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 51
3 more
  1. 2024Language Imbalance Driven Rewarding for Multilingual Self-improvingcited by 28
  2. 2024Signs as Tokens: A Retrieval-Enhanced Multilingual Sign Language Generatorcited by 21
  3. 2024Taiyi-Diffusion-XL: Advancing Bilingual Text-to-Image Generation with Large Vision-Language Model Supportcited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReAlign: Bilingual Text-to-Motion Generation via Step-Aware Reward-Guided Alignment
  2. 2024LEAD: Latent Realignment for Human Motion Diffusion
  3. 2024LGTM: Local-to-Global Text-Driven Human Motion Diffusion Model
  4. 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokens
  5. 2025MotionGPT3: Human Motion as a Second Modality
  6. 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Models
  7. 2024LaserHuman: Language-guided Scene-aware Human Motion Generation in Free Environment
  8. 2025PackDiT: Joint Human Motion and Text Generation via Mutual Prompting