mlsanityData to 7 Oct 2026

Improving the Perceptual Quality of 2D Animation Interpolation

arXiv 2111.12792 ↗First posted 24 Nov 2021cs.CVcited by 20

Not on the map. Why?

Abstract (arXiv)

Traditional 2D animation is labor-intensive, often requiring animators to manually draw twelve illustrations per second of movement. While automatic frame interpolation may ease this burden, 2D animation poses additional difficulties compared to photorealistic video. In this work, we address challenges unexplored in previous animation interpolation systems, with a focus on improving perceptual quality. Firstly, we propose SoftsplatLite (SSL), a forward-warping interpolation architecture with fewer trainable parameters and better perceptual performance. Secondly, we design a Distance Transform Module (DTM) that leverages line proximity cues to correct aberrations in difficult solid-color regions. Thirdly, we define a Restricted Relative Linear Discrepancy metric (RRLD) to automate the previously manual training data collection process. Lastly, we explore evaluation of 2D animation generation through a user study, and establish that the LPIPS perceptual metric and chamfer line distance (CD) are more appropriate measures of quality than PSNR and SSIM used in prior art.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 24 Nov 2021.

Builds on

30 of 49 references.

References · 30

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  7. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  8. 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
  9. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
  10. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
  11. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
  12. 2017The Perception-Distortion Tradeoffcited by 582
18 more
  1. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
  2. 2020Softmax Splatting for Video Frame Interpolationcited by 276
  3. 2019Depth-Aware Video Frame Interpolationcited by 232
  4. 2019Kornia: an Open Source Differentiable Computer Vision Library for PyTorchcited by 231
  5. 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 211
  6. 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 166
  7. 2017Video Frame Interpolation via Adaptive Convolutioncited by 158
  8. 2019Quadratic video interpolationcited by 143
  9. 2020Learning by Analogy: Reliable Supervision from Transformations for Unsupervised Optical Flow Estimationcited by 120
  10. 2018MEMC-Net: Motion Estimation and Motion Compensation Driven Neural Network for Video Interpolation and Enhancementcited by 111
  11. 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
  12. 2021Deep Animation Video Interpolation in the Wildcited by 65
  13. 2018PhaseNet for Video Frame Interpolationcited by 61
  14. 2017Residual Conv-Deconv Grid Network for Semantic Segmentationcited by 57
  15. 2021The Animation Transformer: Visual Correspondence via Segment Matchingcited by 20
  16. 2017Mastering Sketching: Adversarial Augmentation for Structured Predictioncited by 12
  17. 2017A filter based approach for inbetweeningcited by 1
  18. 2020Line Art Correlation Matching Feature Transfer Network for Automatic Animation Colorizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 6; 2024: 9; 2025: 2; 2026: 1.

20 papers.

Sort:

By area:

  1. 2023Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenescited by 68
  2. 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
  3. 2024LVCD: Reference-based Lineart Video Colorization with Diffusion Modelscited by 27
  4. 2024Generative Inbetweening through Frame-wise Conditions-Driven Video Generationcited by 23
  5. 2024AniDoc: Animation Creation Made Easiercited by 22
  6. 2024AniClipart: Clipart Animation with Text-to-Video Priorscited by 17
  7. 2023PAniC-3D: Stylized Single-view 3D Reconstruction from Portraits of Anime Characterscited by 16
  8. 2024APISR: Anime Production Inspired Real-World Anime Super-Resolutioncited by 16
  9. 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motionscited by 13
  10. 2022AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Moviescited by 11
  11. 2024Disentangled Motion Modeling for Video Frame Interpolationcited by 11
  12. 2023Deep Geometrized Cartoon Line Inbetweeningcited by 9
8 more
  1. 2022Collaborative Neural Rendering using Anime Character Sheetscited by 8
  2. 2023Video Frame Interpolation with Densely Queried Bilateral Correlationcited by 8
  3. 2023Scale-Adaptive Feature Aggregation for Efficient Space-Time Video Super-Resolutioncited by 8
  4. 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolationcited by 8
  5. 2024Thin-Plate Spline-based Interpolation for Animation Line Inbetweeningcited by 4
  6. 2025Time-adaptive Video Frame Interpolation based on Residual Diffusioncited by 2
  7. 2023Velocity Disambiguation for Video Frame Interpolationcited by 0
  8. 2026SketchKeyAnime: Reference-anchored Sparse Key-Sketch Animation Synthesiscited by 0