mlsanityData to 14 Oct 2026

ELMA: Benchmarking Anaphoric Compositions for Long-Term Text-to-Motion Generation

arXiv 2610.13549 ↗First posted 9 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-guided long-term human motion generation is essential for applications such as continuously operating digital avatars. Despite recent progress on short clips, existing models struggle with multi-segment instructions that involve anaphora, where constraints established in earlier segments must be preserved over time. In this paper, we introduce a novel task of long-term motion generation from such anaphoric compositions. To mitigate this, we present ELMA, an episodic long-term motion dataset with dense segment-level annotations that preserve cross-segment dependencies. Built via a fully automated collection and filtering pipeline, ELMA extracts high-quality, continuous 30-second clips from in-the-wild videos, capturing the episodic narratives necessary for long-range state modeling. Leveraging this dataset, we fine-tune state-of-the-art motion generation models to incorporate long-range context. Extensive experiments reveal fundamental shortcomings in current models when handling context-dependent instructions. We demonstrate that ELMA enables significant improvements in both global physical realism and semantic alignment, setting a robust new baseline for long-term motion synthesis.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 34 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

31 of 34 references.

References · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  5. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  6. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  7. 2022Human Motion Diffusion Modelcited by 1,080
  8. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
  9. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  10. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  11. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  12. 2023Human Motion Diffusion as a Generative Priorcited by 357
19 more
  1. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
  2. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
  3. 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
  4. 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 137
  5. 2020A Short Note on the Kinetics-700-2020 Human Action Datasetcited by 92
  6. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 91
  7. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
  8. 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 84
  9. 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
  10. 2022YOLO-Pose: Enhancing YOLO for Multi Person Pose Estimation Using Object Keypoint Similarity Losscited by 68
  11. 2023PoseFix: Correcting 3D Human Poses with Natural Languagecited by 40
  12. 2024Unimotion: Unifying 3D Human Motion Synthesis and Understandingcited by 30
  13. 2022PoseScript: Linking 3D Human Poses and Natural Languagecited by 14
  14. 2024T2LM: Long-Term 3D Human Motion Generation from Multiple Sentencescited by 12
  15. 2025FineMotion: A Dataset and Benchmark with both Spatial and Temporal Annotation for Fine-grained Motion Generation and Editingcited by 11
  16. 2026FrankenMotion: Part-level Human Motion Generation and Compositioncited by 10
  17. 2025Deep Compositional Phase Diffusion for Long Motion Sequence Generationcited by 6
  18. 2025Dense Motion Captioningcited by 3
  19. 2026OpenT2M: No-frill Motion Generation with Open-source,Large-scale, High-quality Datacited by 2

Built on by

Not cited yet.