Bilingual Text-to-Motion Generation: A New Benchmark and Baselines
Not on the map. Why?
Abstract (arXiv)
Text-to-motion generation holds significant potential for cross-linguistic applications, yet it is hindered by the lack of bilingual datasets and the poor cross-lingual semantic understanding of existing language models. To address these gaps, we introduce BiHumanML3D, the first bilingual text-to-motion benchmark, constructed via LLM-assisted annotation and rigorous manual correction. Furthermore, we propose a simple yet effective baseline, Bilingual Motion Diffusion (BiMD), featuring Cross-Lingual Alignment (CLA). CLA explicitly aligns semantic representations across languages, creating a robust conditional space that enables high-quality motion generation from bilingual inputs, including zero-shot code-switching scenarios. Extensive experiments demonstrate that BiMD with CLA achieves an FID of 0.045 vs. 0.169 and R@3 of 82.8% vs. 80.8%, significantly outperforms monolingual diffusion models and translation baselines on BiHumanML3D, underscoring the critical necessity and reliability of our dataset and the effectiveness of our alignment strategy for cross-lingual motion synthesis. The dataset and code are released at hrefhttps://wengwanjiang.github.io/BilingualT2M-pagehttps://wengwanjiang.github.io/BilingualT2M-page
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 53 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
15 of 53 references.
References · 15
- 2023GPT-4 Technical Reportcited by 18,396
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2019How multilingual is Multilingual BERT?cited by 645
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
- 2022Chinese CLIP: Contrastive Vision-Language Pretraining in Chinesecited by 109
- 2022AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilitiescited by 85
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
- 2025Seedream 2.0: A Native Chinese-English Bilingual Image Generation Foundation Modelcited by 62
- 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 51
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ReAlign: Bilingual Text-to-Motion Generation via Step-Aware Reward-Guided Alignment
- 2024LEAD: Latent Realignment for Human Motion Diffusion
- 2024LGTM: Local-to-Global Text-Driven Human Motion Diffusion Model
- 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokens
- 2025MotionGPT3: Human Motion as a Second Modality
- 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Models
- 2024LaserHuman: Language-guided Scene-aware Human Motion Generation in Free Environment
- 2025PackDiT: Joint Human Motion and Text Generation via Mutual Prompting