VISTA: Video-Injected Stylized Text-to-Animation
Not on the map. Why?
Abstract (arXiv)
We present VISTA, a two-stage framework for generating stylized 3D human motion by fusing structural content from text prompts with expressive style from reference videos, without requiring jointly paired (text, video, stylized motion) triplets. A Dual-channel Autoencoder first maps motion sequences and video clips into a shared latent manifold. A masked autoregressive diffusion backbone then operates within this manifold, injecting video-derived style through a dedicated late-fusion Dual-AdaLN pathway while preserving text-conditioned content structure. A cross-batch unpaired training protocol with latent cycle consistency enables joint learning across separate semantically rich and stylistically diverse datasets. As a proof-of-concept for controllable animation synthesis, we validate VISTA on rendered motion-capture references: it achieves the highest style recognition accuracy among video-conditioned methods while preserving competitive content alignment, and its decomposed 3-way classifier-free guidance provides independent, user-controllable calibration of the content-style balance at inference time.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 14 references that are in the map. First posted on arXiv 20 Sep 2026.
Builds on
10 of 14 references.
References · 10
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2022Human Motion Diffusion Modelcited by 1,080
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
- 2022Real-Time Style Modelling of Human Locomotion via Feature-Wise Transformations and Local Motion Phasescited by 72
- 2024SMooDi: Stylized Motion Diffusion Modelcited by 37
- 2025Dance Like a Chicken: Low-Rank Stylization for Human Motion Diffusioncited by 16
- 2025StyleMotif: Multi-Modal Motion Stylization using Style-Content Cross Fusioncited by 7
Built on by
Not cited yet.