MRBench: A Comprehensive Benchmark for Human Motion-Text Retrieval
Not on the map. Why?
Abstract (arXiv)
Human motion-text retrieval provides a rigorous means of assessing cross-modal alignment. Prevailing benchmarks are dominated by homogeneous indoor motions, imbalanced motion distributions, and oversimplified, repetitive texts, which hinder the reliable measurement of cross-domain and cross-granularity alignment. We thus introduce MRBench, a comprehensive motion-text retrieval benchmark featuring heterogeneous motions, broad and balanced category coverage, and reliable, discriminative, multi-granular descriptions. MRBench is constructed through a meticulously designed multi-stage data curation pipeline, which filters and balances candidates, verifies unambiguous semantic alignment, and generates motion-grounded descriptions at multiple granularities. The resulting benchmark contains 3,390 motions drawn from motion capture, in-the-wild videos, synthetic videos, and motion generative models, covering 118 fine-grained categories. Each motion is paired with concise, standard, and fine-grained descriptions, yielding 10,170 captions. Extensive evaluations of representative retrieval baselines on MRBench reveal a substantial cross-dataset generalization gap and pronounced sensitivity to query granularity. We propose a lightweight granularity-aware model anchored at a frozen standard-caption-aligned retrieval model. LLM-based concise and fine-grained captions provide pseudo-supervision for extra-branch granularity-specific motion extractors and text adapters. For inference, granularity-aware score fusion integrates global and adapted similarities while strictly maintaining score comparability across all description levels. The resulting model improves mixed-granularity retrieval without compromising standard-caption performance. We believe that our MRBench provides a comprehensive testbed for advancing motion-language alignment evaluation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 42 references that are in the map. First posted on arXiv 8 Aug 2026.
Builds on
36 of 42 references.
References · 36
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
- 2016The KIT Motion-Language Datasetcited by 334
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
24 more
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
- 2020Fine-grained Video-Text Retrieval with Hierarchical Graph Reasoningcited by 180
- 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 105
- 2022PyramidCLIP: Hierarchical Feature Alignment for Vision-language Model Pretrainingcited by 104
- 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 103
- 2020COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learningcited by 100
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
- 2024Making Text Embedders Few-Shot Learnerscited by 78
- 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
- 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 52
- 2025SnapMoGen: Human Motion Generation from Expressive Textscited by 44
- 2025GENMO: A GENeralist Model for Human MOtioncited by 43
- 2025MotionGPT3: Human Motion as a Second Modalitycited by 36
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 32
- 2025Motion-X++: A Large-Scale Multimodal 3D Whole-body Human Motion Datasetcited by 30
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluationcited by 20
- 2022Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representationscited by 19
- 2025LangWBC: Language-directed Humanoid Whole-Body Control via End-to-end Learningcited by 19
- 2025Being-M0.5: A Real-Time Controllable Vision-Language-Motion Modelcited by 9
- 2024Benchmark Granularity and Model Robustness for Image-Text Retrievalcited by 5
- 2025UniAct: Unified Motion Generation and Action Streaming for Humanoid Robotscited by 5
- 2026MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart Primitivescited by 5
- 2024Motion Generation from Fine-grained Textual Descriptionscited by 4
- 2025Dense Motion Captioningcited by 2
Built on by
Not cited yet.