mlsanityData to 14 Oct 2026

MoCHA: Denoising Caption Supervision for Motion-Text Retrieval

arXiv 2603.23684 ↗First posted 24 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-motion retrieval systems learn shared embedding spaces from motion-caption pairs via contrastive objectives. However, each caption is not a deterministic label but a sample from a distribution of valid descriptions: different annotators produce different text for the same motion, mixing motion-recoverable semantics (action type, body parts, directionality) with annotator-specific style and inferred context that cannot be determined from 3D joint coordinates alone. Standard contrastive training treats each caption as the single positive target, overlooking this distributional structure and inducing within-motion embedding variance that weakens alignment. We propose MoCHA, a text canonicalization framework that reduces this variance by projecting each caption onto its motion-recoverable content prior to encoding, producing tighter positive clusters and better-separated embeddings. Canonicalization is a general principle: even deterministic rule-based methods improve cross-dataset transfer, though learned canonicalizers provide substantially larger gains. We present two learned variants: an LLM-based approach (GPT-5.2) and a distilled FlanT5 model requiring no LLM at inference time. MoCHA operates as a preprocessing step compatible with any retrieval architecture. Applied to MoPa (MotionPatches), MoCHA sets a new state of the art on both HumanML3D (H) and KIT-ML (K): the LLM variant achieves 13.9% T2M R@1 on H (+3.1pp) and 24.3% on K (+10.3pp), while the LLM-free T5 variant achieves gains of +2.5pp and +8.1pp. Canonicalization reduces within-motion text-embedding variance by 11-19% and improves cross-dataset transfer substantially, with H to K improving by 94% and K to H by 52%, demonstrating that standardizing the language space yields more transferable motion-language representations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 24 Mar 2026.

Builds on

20 of 28 references.

References · 20

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  4. 2022Human Motion Diffusion Modelcited by 1,080
  5. 2013Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programmingcited by 724
  6. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  7. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  8. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  9. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  10. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
  11. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  12. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
8 more
  1. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  2. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
  3. 2016The KIT Motion-Language Datasetcited by 338
  4. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
  5. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
  6. 2024LaMP: Language-Motion Pretraining for Motion Generation, Retrieval, and Captioningcited by 59
  7. 2024Exploring Vision Transformers for 3D Human Motion-Language Models with Motion Patchescited by 22
  8. 2024Tri-Modal Motion Retrieval by Learning a Joint Embedding Spacecited by 16

Built on by

Not cited yet.