mlsanityData to 14 Oct 2026

Real-time Animation Generation and Control on Rigged Models via Large Language Models

arXiv 2310.17838 ↗First posted 27 Oct 2023cs.GR cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

We introduce a novel method for real-time animation control and generation on rigged models using natural language input. First, we embed a large language model (LLM) in Unity to output structured texts that can be parsed into diverse and realistic animations. Second, we illustrate LLM's potential to enable flexible state transition between existing animations. We showcase the robustness of our approach through qualitative results on various rigged models and motions.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 20 of its 39 references that are in the map. First posted on arXiv 27 Oct 2023.

Builds on

20 of 39 references.

References · 20

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  6. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  7. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  8. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  9. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  10. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
  11. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
  12. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
8 more
  1. 2022Diffusion Probabilistic Modeling for Video Generationcited by 238
  2. 2023Text-To-4D Dynamic Scene Generationcited by 205
  3. 2022NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)cited by 158
  4. 20223DDesigner: Towards Photorealistic 3D Object Generation and Editing with Text-guided Diffusion Modelscited by 57
  5. 2022Structure-Aware Motion Transfer with Deformable Anchor Modelcited by 34
  6. 2019Chart Auto-Encoders for Manifold Structured Datacited by 33
  7. 2021MoCaNet: Motion Retargeting in-the-wild via Canonicalization Networkscited by 13
  8. 2022Steps towards prompt-based creation of virtual worldscited by 7

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 2.

5 papers.

  1. 2024DreamGarden: A Designer Assistant for Growing Games from a Single Promptcited by 10
  2. 2025LLMER: Crafting Interactive Extended Reality Worlds with JSON Data Generated by Large Language Modelscited by 7
  3. 2024Characterizing the Accuracy -- Efficiency Trade-off of Low-rank Decomposition in Language Modelscited by 4
  4. 2024Towards Kinetic Manipulation of the Latent Spacecited by 0
  5. 2025Exploring User Acceptance and Concerns toward LLM-powered Conversational Agents in Immersive Extended Realitycited by 0