mlsanityData to 14 Oct 2026

FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animations

arXiv 2411.10818 ↗First posted 16 Nov 2024cs.GR cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Sketch animations offer a powerful medium for visual storytelling, from simple flip-book doodles to professional studio productions. While traditional animation requires teams of skilled artists to draw key frames and in-between frames, existing automation attempts still demand significant artistic effort through precise motion paths or keyframe specification. We present FlipSketch, a system that brings back the magic of flip-book animation -- just draw your idea and describe how you want it to move! Our approach harnesses motion priors from text-to-video diffusion models, adapting them to generate sketch animations through three key innovations: (i) fine-tuning for sketch-style frame generation, (ii) a reference frame mechanism that preserves visual integrity of input sketch through noise refinement, and (iii) a dual-attention composition that enables fluid motion without losing visual consistency. Unlike constrained vector animations, our raster frames support dynamic sketch transformations, capturing the expressive freedom of traditional animation. The result is an intuitive system that makes sketch animation as simple as doodling and describing, while maintaining the artistic essence of hand-drawn animation.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 54 of its 69 references that are in the map. First posted on arXiv 16 Nov 2024.

Builds on

54 of 69 references.

References · 54

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  10. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  12. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
38 more
  1. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  2. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  3. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
  4. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  5. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  6. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  7. 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 671
  8. 2023ModelScope Text-to-Video Technical Reportcited by 658
  9. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  10. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  11. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 350
  12. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 327
  13. 2017A Neural Representation of Sketch Drawingscited by 313
  14. 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 280
  15. 2018Stochastic Video Generation with a Learned Priorcited by 245
  16. 2023LCM-LoRA: A Universal Stable-Diffusion Acceleration Modulecited by 211
  17. 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
  18. 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
  19. 2024InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generationcited by 170
  20. 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesiscited by 163
  21. 2022FILM: Frame Interpolation for Large Motioncited by 153
  22. 2024Low-Rank Few-Shot Adaptation of Vision-Language Modelscited by 104
  23. 2023InstructVideo: Instructing Video Diffusion Models with Human Feedbackcited by 86
  24. 2022Learning to generate line drawings that convey geometry and semanticscited by 83
  25. 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
  26. 2022Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfercited by 66
  27. 2022CLIPascene: Scene Sketching with Different Types and Levels of Abstractioncited by 64
  28. 2022Third Time's the Charm? Image and Video Editing with StyleGAN3cited by 54
  29. 2022FS-COCO: Towards Understanding of Freehand Sketches of Common Objects in Contextcited by 49
  30. 2023Breathing Life Into Sketches Using Text-to-Video Priorscited by 48
  31. 2020B'ezierSketch: A generative model for scalable vector sketchescited by 43
  32. 2024It's All About Your Sketch: Democratising Sketch Control in Diffusion Modelscited by 29
  33. 20243Doodle: Compact Abstraction of Objects with 3D Strokescited by 21
  34. 2023A Method for Animating Children's Drawings of the Human Figurecited by 20
  35. 2020SketchEmbedNet: Learning Novel Concepts by Imitating Drawingscited by 18
  36. 2023Wired Perspectives: Multi-View Wire Art Embraces Generative AIcited by 17
  37. 2023Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapescited by 14
  38. 2024SketchINR: A First Look into Sketches as Implicit Neural Representationscited by 13

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 5.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025SketchAnimator: Animate Sketch via Motion Customization of Text-to-Video Diffusion Models
  2. 2026SketchDynamics: Exploring Free-Form Sketches for Dynamic Intent Expression in Animation Generation ↗
  3. 2024Enhancing Sketch Animation: Text-to-Video Diffusion Models with Temporal Consistency and Rigidity Constraints
  4. 2025Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animation
  5. 20254-Doodle: Text to 3D Sketches that Move!
  6. 2026VideoSketcher: Sequential Sketch Generation Using Video Model Priors
  7. 2024Sketch-Guided Stylized Landscape Cinemagraph Synthesis
  8. 2024AirSketch: Generative Motion to Sketch