LottieGPT: Tokenizing Vector Animation for Autoregressive Generation
Not on the map. Why?
Abstract (arXiv)
Despite rapid progress in video generation, existing models are incapable of producing vector animation, a dominant and highly expressive form of multimedia on the Internet. Vector animations offer resolution-independence, compactness, semantic structure, and editable parametric motion representations, yet current generative models operate exclusively in raster space and thus cannot synthesize them. Meanwhile, recent advances in large multimodal models demonstrate strong capabilities in generating structured data such as slides, 3D meshes, LEGO sequences, and indoor layouts, suggesting that native vector animation generation may be achievable. In this work, we present the first framework for tokenizing and autoregressively generating vector animations. We adopt Lottie, a widely deployed JSON-based animation standard, and design a tailored Lottie Tokenizer that encodes layered geometric primitives, transforms, and keyframe-based motion into a compact and semantically aligned token sequence. To support large-scale training, we also construct LottieAnimation-660K, the largest and most diverse vector animation dataset to date, consisting of 660k real-world Lottie animation and 15M static Lottie image files curated from broad Internet sources. Building upon these components, we finetune Qwen-VL to create LottieGPT, a native multimodal model capable of generating coherent, editable vector animations directly from natural language or visual prompts. Experiments show that our tokenizer dramatically reduces sequence length while preserving structural fidelity, enabling effective autoregressive learning of dynamic vector content. LottieGPT exhibits strong generalization across diverse animation styles and outperforms previous state-of-the-art models on SVG generation (a special case of single-frame vector animation).
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 82 of its 106 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
82 of 106 references.
References · 82
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
38 more
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023Pix2Video: Video Editing using Image Diffusioncited by 318
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 262
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
- 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 158
- 2025Native and Compact Structured Latents for 3D Generationcited by 157
- 2021Im2Vec: Synthesizing Vector Graphics without Vector Supervisioncited by 114
- 2022VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Modelscited by 112
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
- 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 96
- 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 95
- 2024LLaMA-Mesh: Unifying 3D Mesh Generation with Language Modelscited by 87
- 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 87
- 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 84
- 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 82
- 2023SVGDreamer: Text Guided SVG Generation with Diffusion Modelcited by 75
- 2023IconShop: Text-Guided Vector Icon Synthesis with Autoregressive Transformerscited by 73
- 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 71
- 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
- 2024Empowering LLMs to Understand and Generate Complex Vector Graphicscited by 63
- 2025AutoPresent: Designing Structured Visuals from Scratchcited by 63
- 2025SpatialLM: Training Large Language Models for Structured Indoor Modelingcited by 63
- 2023Word-As-Image for Semantic Typographycited by 62
- 2024Generating CAD Code with Vision-Language Models for 3D Designscited by 61
- 2025Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action Modelscited by 60
- 2023Breathing Life Into Sketches Using Text-to-Video Priorscited by 47
- 2025MagicArticulate: Make Your 3D Models Articulation-Readycited by 43
50 most cited of 82 All 82 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Engine-Native Editable 3D World Reconstruction with Objects and Lightingcited by 3
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenescited by 2
- 2026PairCoder++: Pair Programming as a Universal Paradigm for Verified Code-Driven Multimodal and Structured-Artifact Generationcited by 2
- 2026Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Meshcited by 2
- 2026Reinforcement Learning from Intermediate Renders for Image-to-Code Generationcited by 0
- 2026Reinforcement Learning from Intermediate Renders for Image-to-Code Generation28 Sep 2026
- 2026Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Mesh30 Jul 2026
- 2026Engine-Native Editable 3D World Reconstruction with Objects and Lighting23 Jul 2026
- 2026PairCoder++: Pair Programming as a Universal Paradigm for Verified Code-Driven Multimodal and Structured-Artifact Generation2 Jul 2026
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenes30 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026OmniLottie: Generating Vector Animations via Parameterized Lottie Tokens
- 2026ActionMesh: Animated 3D Mesh Generation with Temporal 3D Diffusion
- 2023LatentMan: Generating Consistent Animated Characters using Image Diffusion Models
- 2025NextStep-1: Toward Autoregressive Image Generation with Continuous Tokens at Scale
- 2025Knot Forcing: Taming Autoregressive Video Diffusion Models for Real-time Infinite Interactive Portrait Animation
- 2026ConsID-Gen: View-Consistent and Identity-Preserving Image-to-Video Generation
- 2026FastSTAR: Spatiotemporal Token Pruning for Efficient Autoregressive Video Synthesis
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model