GestureFAR: Streaming Co-Speech Gesture Generation with Flow Autoregression
Not on the map. Why?
Abstract (arXiv)
Generating natural co-speech gestures from streaming speech is essential for embodied conversational agents, where motion must be produced while a user is still speaking. Recent streaming gesture systems make online generation possible by autoregressing over discrete motion tokens, but this design compresses high-dimensional continuous motion into finite codebooks and can limit the realism and diversity of generated gestures. To preserve both causality and continuous expressiveness, we propose GestureFAR, a flow-autoregressive framework for streaming co-speech gesture generation. First, GestureFAR autoregresses over causal continuous motion latents, using a transformer to model streaming audio-motion context and a per-token flow-matching head to sample the next latent from a continuous distribution. Second, we introduce a head-only flow distillation strategy that freezes the causal backbone and distills the multi-step per-token flow head into a single network evaluation using consistency and distribution-matching objectives. This keeps the model token-causal while removing the main latency bottleneck for live interaction. Experiments on BEAT2 show that GestureFAR significantly improves the quality--latency trade-off among streaming-capable methods, preserving strong gesture quality while enabling real-time token-causal generation. Project Page: https://andypinxinliu.github.io/GestureFAR
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 27 references that are in the map. First posted on arXiv 18 Sep 2026.
Builds on
18 of 27 references.
References · 18
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
- 2024One Step Diffusion via Shortcut Modelscited by 373
- 2020Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identitycited by 199
- 2022Generating Holistic 3D Human Motion from Speechcited by 180
- 2024Autoregressive Video Generation without Vector Quantizationcited by 180
- 2022Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generationcited by 106
- 2024From Audio to Photoreal Embodiment: Synthesizing Humans in Conversationscited by 82
- 2024DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generationcited by 61
- 2025GestureLSM: Latent Shortcut based Co-Speech Gesture Generation with Spatial-Temporal Modelingcited by 43
6 more
- 2024Enabling Synergistic Full-Body Control in Prompt-Based Co-Speech Motion Generationcited by 35
- 2024TANGO: Co-Speech Gesture Video Reenactment with Hierarchical Audio Motion Embedding and Diffusion Interpolationcited by 32
- 2025SemGes: Semantics-aware Co-Speech Gesture Generation using Semantic Coherence and Relevance Learningcited by 17
- 2025Contextual Gesture: Co-Speech Gesture Video Generation through Context-aware Gesture Representationcited by 12
- 2026MIBURI: Towards Expressive Interactive Gesture Synthesiscited by 9
- 2025Streaming Generation of Co-Speech Gestures via Accelerated Rolling Diffusioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Super Star: Towards Streaming Real-time Interactive Agents for Digital Humans
- 2026InteractGesture: Progressive Chunk Guidance for Continuous Streaming Co-Speech Gesture Control
- 2023LivelySpeaker: Towards Semantic-Aware Co-Speech Gesture Generation
- 2026Puppeteer: Object-Grounded Posture-Aware Co-Speech Gesture Generation
- 2023C2G2: Controllable Co-speech Gesture Generation with Latent Diffusion Model
- 2025GestureHYDRA: Semantic Co-speech Gesture Synthesis via Hybrid Modality Diffusion Transformer and Cascaded-Synchronized Retrieval-Augmented Generation
- 2025Audio-driven Gesture Generation via Deviation Feature in the Latent Space
- 2025Co-speech Gesture Video Generation via Motion-Based Graph Retrieval