mlsanityData to 7 Oct 2026

GestureFAR: Streaming Co-Speech Gesture Generation with Flow Autoregression

arXiv 2609.21576 ↗First posted 18 Sep 2026cs.CV cs.GR cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Generating natural co-speech gestures from streaming speech is essential for embodied conversational agents, where motion must be produced while a user is still speaking. Recent streaming gesture systems make online generation possible by autoregressing over discrete motion tokens, but this design compresses high-dimensional continuous motion into finite codebooks and can limit the realism and diversity of generated gestures. To preserve both causality and continuous expressiveness, we propose GestureFAR, a flow-autoregressive framework for streaming co-speech gesture generation. First, GestureFAR autoregresses over causal continuous motion latents, using a transformer to model streaming audio-motion context and a per-token flow-matching head to sample the next latent from a continuous distribution. Second, we introduce a head-only flow distillation strategy that freezes the causal backbone and distills the multi-step per-token flow head into a single network evaluation using consistency and distribution-matching objectives. This keeps the model token-causal while removing the main latency bottleneck for live interaction. Experiments on BEAT2 show that GestureFAR significantly improves the quality--latency trade-off among streaming-capable methods, preserving strong gesture quality while enabling real-time token-causal generation. Project Page: https://andypinxinliu.github.io/GestureFAR

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 27 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

18 of 27 references.

References · 18

  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  2. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  3. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  4. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  5. 2024One Step Diffusion via Shortcut Modelscited by 373
  6. 2020Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identitycited by 199
  7. 2022Generating Holistic 3D Human Motion from Speechcited by 180
  8. 2024Autoregressive Video Generation without Vector Quantizationcited by 180
  9. 2022Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generationcited by 106
  10. 2024From Audio to Photoreal Embodiment: Synthesizing Humans in Conversationscited by 82
  11. 2024DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generationcited by 61
  12. 2025GestureLSM: Latent Shortcut based Co-Speech Gesture Generation with Spatial-Temporal Modelingcited by 43
6 more
  1. 2024Enabling Synergistic Full-Body Control in Prompt-Based Co-Speech Motion Generationcited by 35
  2. 2024TANGO: Co-Speech Gesture Video Reenactment with Hierarchical Audio Motion Embedding and Diffusion Interpolationcited by 32
  3. 2025SemGes: Semantics-aware Co-Speech Gesture Generation using Semantic Coherence and Relevance Learningcited by 17
  4. 2025Contextual Gesture: Co-Speech Gesture Video Generation through Context-aware Gesture Representationcited by 12
  5. 2026MIBURI: Towards Expressive Interactive Gesture Synthesiscited by 9
  6. 2025Streaming Generation of Co-Speech Gestures via Accelerated Rolling Diffusioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Super Star: Towards Streaming Real-time Interactive Agents for Digital Humans
  2. 2026InteractGesture: Progressive Chunk Guidance for Continuous Streaming Co-Speech Gesture Control
  3. 2023LivelySpeaker: Towards Semantic-Aware Co-Speech Gesture Generation
  4. 2026Puppeteer: Object-Grounded Posture-Aware Co-Speech Gesture Generation
  5. 2023C2G2: Controllable Co-speech Gesture Generation with Latent Diffusion Model
  6. 2025GestureHYDRA: Semantic Co-speech Gesture Synthesis via Hybrid Modality Diffusion Transformer and Cascaded-Synchronized Retrieval-Augmented Generation
  7. 2025Audio-driven Gesture Generation via Deviation Feature in the Latent Space
  8. 2025Co-speech Gesture Video Generation via Motion-Based Graph Retrieval