mlsanityData to 7 Oct 2026

LottieGPT: Tokenizing Vector Animation for Autoregressive Generation

arXiv 2604.11792 ↗First posted 13 Apr 2026cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Despite rapid progress in video generation, existing models are incapable of producing vector animation, a dominant and highly expressive form of multimedia on the Internet. Vector animations offer resolution-independence, compactness, semantic structure, and editable parametric motion representations, yet current generative models operate exclusively in raster space and thus cannot synthesize them. Meanwhile, recent advances in large multimodal models demonstrate strong capabilities in generating structured data such as slides, 3D meshes, LEGO sequences, and indoor layouts, suggesting that native vector animation generation may be achievable. In this work, we present the first framework for tokenizing and autoregressively generating vector animations. We adopt Lottie, a widely deployed JSON-based animation standard, and design a tailored Lottie Tokenizer that encodes layered geometric primitives, transforms, and keyframe-based motion into a compact and semantically aligned token sequence. To support large-scale training, we also construct LottieAnimation-660K, the largest and most diverse vector animation dataset to date, consisting of 660k real-world Lottie animation and 15M static Lottie image files curated from broad Internet sources. Building upon these components, we finetune Qwen-VL to create LottieGPT, a native multimodal model capable of generating coherent, editable vector animations directly from natural language or visual prompts. Experiments show that our tokenizer dramatically reduces sequence length while preserving structural fidelity, enabling effective autoregressive learning of dynamic vector content. LottieGPT exhibits strong generalization across diverse animation styles and outperforms previous state-of-the-art models on SVG generation (a special case of single-frame vector animation).

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 82 of its 106 references that are in the map. First posted on arXiv 13 Apr 2026.

Builds on

82 of 106 references.

References · 82

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2025Qwen2.5-VL Technical Reportcited by 5,418
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  12. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
38 more
  1. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  2. 2025Qwen-Image Technical Reportcited by 973
  3. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  4. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  5. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  6. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  7. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  8. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
  9. 2025VACE: All-in-One Video Creation and Editingcited by 467
  10. 2023Pix2Video: Video Editing using Image Diffusioncited by 318
  11. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
  12. 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
  13. 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 262
  14. 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
  15. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
  16. 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 158
  17. 2025Native and Compact Structured Latents for 3D Generationcited by 157
  18. 2021Im2Vec: Synthesizing Vector Graphics without Vector Supervisioncited by 114
  19. 2022VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Modelscited by 112
  20. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
  21. 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 96
  22. 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 95
  23. 2024LLaMA-Mesh: Unifying 3D Mesh Generation with Language Modelscited by 87
  24. 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 87
  25. 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 84
  26. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 82
  27. 2023SVGDreamer: Text Guided SVG Generation with Diffusion Modelcited by 75
  28. 2023IconShop: Text-Guided Vector Icon Synthesis with Autoregressive Transformerscited by 73
  29. 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 71
  30. 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
  31. 2024Empowering LLMs to Understand and Generate Complex Vector Graphicscited by 63
  32. 2025AutoPresent: Designing Structured Visuals from Scratchcited by 63
  33. 2025SpatialLM: Training Large Language Models for Structured Indoor Modelingcited by 63
  34. 2023Word-As-Image for Semantic Typographycited by 62
  35. 2024Generating CAD Code with Vision-Language Models for 3D Designscited by 61
  36. 2025Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action Modelscited by 60
  37. 2023Breathing Life Into Sketches Using Text-to-Video Priorscited by 47
  38. 2025MagicArticulate: Make Your 3D Models Articulation-Readycited by 43

50 most cited of 82 All 82 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026OmniLottie: Generating Vector Animations via Parameterized Lottie Tokens
  2. 2026ActionMesh: Animated 3D Mesh Generation with Temporal 3D Diffusion
  3. 2023LatentMan: Generating Consistent Animated Characters using Image Diffusion Models
  4. 2025NextStep-1: Toward Autoregressive Image Generation with Continuous Tokens at Scale
  5. 2025Knot Forcing: Taming Autoregressive Video Diffusion Models for Real-time Infinite Interactive Portrait Animation
  6. 2026ConsID-Gen: View-Consistent and Identity-Preserving Image-to-Video Generation
  7. 2026FastSTAR: Spatiotemporal Token Pruning for Efficient Autoregressive Video Synthesis
  8. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model