mlsanityData to 7 Oct 2026

MRBench: A Comprehensive Benchmark for Human Motion-Text Retrieval

arXiv 2608.07993 ↗First posted 8 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Human motion-text retrieval provides a rigorous means of assessing cross-modal alignment. Prevailing benchmarks are dominated by homogeneous indoor motions, imbalanced motion distributions, and oversimplified, repetitive texts, which hinder the reliable measurement of cross-domain and cross-granularity alignment. We thus introduce MRBench, a comprehensive motion-text retrieval benchmark featuring heterogeneous motions, broad and balanced category coverage, and reliable, discriminative, multi-granular descriptions. MRBench is constructed through a meticulously designed multi-stage data curation pipeline, which filters and balances candidates, verifies unambiguous semantic alignment, and generates motion-grounded descriptions at multiple granularities. The resulting benchmark contains 3,390 motions drawn from motion capture, in-the-wild videos, synthetic videos, and motion generative models, covering 118 fine-grained categories. Each motion is paired with concise, standard, and fine-grained descriptions, yielding 10,170 captions. Extensive evaluations of representative retrieval baselines on MRBench reveal a substantial cross-dataset generalization gap and pronounced sensitivity to query granularity. We propose a lightweight granularity-aware model anchored at a frozen standard-caption-aligned retrieval model. LLM-based concise and fine-grained captions provide pseudo-supervision for extra-branch granularity-specific motion extractors and text adapters. For inference, granularity-aware score fusion integrates global and adapted similarities while strictly maintaining score comparability across all description levels. The resulting model improves mixed-granularity retrieval without compromising standard-caption performance. We believe that our MRBench provides a comprehensive testbed for advancing motion-language alignment evaluation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 42 references that are in the map. First posted on arXiv 8 Aug 2026.

Builds on

36 of 42 references.

References · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  4. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  5. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  6. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  7. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
  8. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
  9. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  10. 2016The KIT Motion-Language Datasetcited by 334
  11. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
  12. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
24 more
  1. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
  2. 2020Fine-grained Video-Text Retrieval with Hierarchical Graph Reasoningcited by 180
  3. 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 105
  4. 2022PyramidCLIP: Hierarchical Feature Alignment for Vision-language Model Pretrainingcited by 104
  5. 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 103
  6. 2020COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learningcited by 100
  7. 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
  8. 2024Making Text Embedders Few-Shot Learnerscited by 78
  9. 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
  10. 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 52
  11. 2025SnapMoGen: Human Motion Generation from Expressive Textscited by 44
  12. 2025GENMO: A GENeralist Model for Human MOtioncited by 43
  13. 2025MotionGPT3: Human Motion as a Second Modalitycited by 36
  14. 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 32
  15. 2025Motion-X++: A Large-Scale Multimodal 3D Whole-body Human Motion Datasetcited by 30
  16. 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluationcited by 20
  17. 2022Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representationscited by 19
  18. 2025LangWBC: Language-directed Humanoid Whole-Body Control via End-to-end Learningcited by 19
  19. 2025Being-M0.5: A Real-Time Controllable Vision-Language-Motion Modelcited by 9
  20. 2024Benchmark Granularity and Model Robustness for Image-Text Retrievalcited by 5
  21. 2025UniAct: Unified Motion Generation and Action Streaming for Humanoid Robotscited by 5
  22. 2026MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart Primitivescited by 5
  23. 2024Motion Generation from Fine-grained Textual Descriptionscited by 4
  24. 2025Dense Motion Captioningcited by 2

Built on by

Not cited yet.