Improving the Perceptual Quality of 2D Animation Interpolation
Not on the map. Why?
Abstract (arXiv)
Traditional 2D animation is labor-intensive, often requiring animators to manually draw twelve illustrations per second of movement. While automatic frame interpolation may ease this burden, 2D animation poses additional difficulties compared to photorealistic video. In this work, we address challenges unexplored in previous animation interpolation systems, with a focus on improving perceptual quality. Firstly, we propose SoftsplatLite (SSL), a forward-warping interpolation architecture with fewer trainable parameters and better perceptual performance. Secondly, we design a Distance Transform Module (DTM) that leverages line proximity cues to correct aberrations in difficult solid-color regions. Thirdly, we define a Restricted Relative Linear Discrepancy metric (RRLD) to automate the previously manual training data collection process. Lastly, we explore evaluation of 2D animation generation through a user study, and establish that the LPIPS perceptual metric and chamfer line distance (CD) are more appropriate measures of quality than PSNR and SSIM used in prior art.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 24 Nov 2021.
Builds on
30 of 49 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
- 2017The Perception-Distortion Tradeoffcited by 582
18 more
- 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
- 2020Softmax Splatting for Video Frame Interpolationcited by 276
- 2019Depth-Aware Video Frame Interpolationcited by 232
- 2019Kornia: an Open Source Differentiable Computer Vision Library for PyTorchcited by 231
- 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 211
- 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 166
- 2017Video Frame Interpolation via Adaptive Convolutioncited by 158
- 2019Quadratic video interpolationcited by 143
- 2020Learning by Analogy: Reliable Supervision from Transformations for Unsupervised Optical Flow Estimationcited by 120
- 2018MEMC-Net: Motion Estimation and Motion Compensation Driven Neural Network for Video Interpolation and Enhancementcited by 111
- 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
- 2021Deep Animation Video Interpolation in the Wildcited by 65
- 2018PhaseNet for Video Frame Interpolationcited by 61
- 2017Residual Conv-Deconv Grid Network for Semantic Segmentationcited by 57
- 2021The Animation Transformer: Visual Correspondence via Segment Matchingcited by 20
- 2017Mastering Sketching: Adversarial Augmentation for Structured Predictioncited by 12
- 2017A filter based approach for inbetweeningcited by 1
- 2020Line Art Correlation Matching Feature Transfer Network for Automatic Animation Colorizationcited by 1
Built on by
Citing papers per year: 2022: 2; 2023: 6; 2024: 9; 2025: 2; 2026: 1.
20 papers.
Sort:
By area:
- 2023Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenescited by 68
- 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
- 2024LVCD: Reference-based Lineart Video Colorization with Diffusion Modelscited by 27
- 2024Generative Inbetweening through Frame-wise Conditions-Driven Video Generationcited by 23
- 2024AniDoc: Animation Creation Made Easiercited by 22
- 2024AniClipart: Clipart Animation with Text-to-Video Priorscited by 17
- 2023PAniC-3D: Stylized Single-view 3D Reconstruction from Portraits of Anime Characterscited by 16
- 2024APISR: Anime Production Inspired Real-World Anime Super-Resolutioncited by 16
- 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motionscited by 13
- 2022AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Moviescited by 11
- 2024Disentangled Motion Modeling for Video Frame Interpolationcited by 11
- 2023Deep Geometrized Cartoon Line Inbetweeningcited by 9
8 more
- 2022Collaborative Neural Rendering using Anime Character Sheetscited by 8
- 2023Video Frame Interpolation with Densely Queried Bilateral Correlationcited by 8
- 2023Scale-Adaptive Feature Aggregation for Efficient Space-Time Video Super-Resolutioncited by 8
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolationcited by 8
- 2024Thin-Plate Spline-based Interpolation for Animation Line Inbetweeningcited by 4
- 2025Time-adaptive Video Frame Interpolation based on Residual Diffusioncited by 2
- 2023Velocity Disambiguation for Video Frame Interpolationcited by 0
- 2026SketchKeyAnime: Reference-anchored Sparse Key-Sketch Animation Synthesiscited by 0
- 2026SketchKeyAnime: Reference-anchored Sparse Key-Sketch Animation Synthesis18 Jun 2026
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation1 Jun 2025
- 2025Time-adaptive Video Frame Interpolation based on Residual Diffusion7 Apr 2025
- 2024AniDoc: Animation Creation Made Easier18 Dec 2024
- 2024Generative Inbetweening through Frame-wise Conditions-Driven Video Generation16 Dec 2024
- 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions16 Dec 2024
- 2024LVCD: Reference-based Lineart Video Colorization with Diffusion Models19 Sep 2024
- 2024Thin-Plate Spline-based Interpolation for Animation Line Inbetweening17 Aug 2024
- 2024Disentangled Motion Modeling for Video Frame Interpolation25 Jun 2024
- 2024ToonCrafter: Generative Cartoon Interpolation28 May 2024
- 2024AniClipart: Clipart Animation with Text-to-Video Priors18 Apr 2024
- 2024APISR: Anime Production Inspired Real-World Anime Super-Resolution3 Mar 2024
8 more
- 2023Velocity Disambiguation for Video Frame Interpolation14 Nov 2023
- 2023Scale-Adaptive Feature Aggregation for Efficient Space-Time Video Super-Resolution26 Oct 2023
- 2023Deep Geometrized Cartoon Line Inbetweening28 Sep 2023
- 2023Video Frame Interpolation with Densely Queried Bilateral Correlation26 Apr 2023
- 2023PAniC-3D: Stylized Single-view 3D Reconstruction from Portraits of Anime Characters25 Mar 2023
- 2023Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenes5 Mar 2023
- 2022AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies10 Nov 2022
- 2022Collaborative Neural Rendering using Anime Character Sheets12 Jul 2022
- 2023Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenescited by 68
- 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
- 2024Generative Inbetweening through Frame-wise Conditions-Driven Video Generationcited by 23
- 2024AniDoc: Animation Creation Made Easiercited by 22
- 2024AniClipart: Clipart Animation with Text-to-Video Priorscited by 17
- 2023PAniC-3D: Stylized Single-view 3D Reconstruction from Portraits of Anime Characterscited by 16
- 2024APISR: Anime Production Inspired Real-World Anime Super-Resolutioncited by 16
- 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motionscited by 13
- 2022AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Moviescited by 11
- 2024Disentangled Motion Modeling for Video Frame Interpolationcited by 11
- 2023Deep Geometrized Cartoon Line Inbetweeningcited by 9
- 2022Collaborative Neural Rendering using Anime Character Sheetscited by 8
12 most cited of 19 All 19 (JSON)
- 2026SketchKeyAnime: Reference-anchored Sparse Key-Sketch Animation Synthesis18 Jun 2026
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation1 Jun 2025
- 2025Time-adaptive Video Frame Interpolation based on Residual Diffusion7 Apr 2025
- 2024AniDoc: Animation Creation Made Easier18 Dec 2024
- 2024Generative Inbetweening through Frame-wise Conditions-Driven Video Generation16 Dec 2024
- 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions16 Dec 2024
- 2024Thin-Plate Spline-based Interpolation for Animation Line Inbetweening17 Aug 2024
- 2024Disentangled Motion Modeling for Video Frame Interpolation25 Jun 2024
- 2024ToonCrafter: Generative Cartoon Interpolation28 May 2024
- 2024AniClipart: Clipart Animation with Text-to-Video Priors18 Apr 2024
- 2024APISR: Anime Production Inspired Real-World Anime Super-Resolution3 Mar 2024
- 2023Velocity Disambiguation for Video Frame Interpolation14 Nov 2023
12 newest of 19 All 19 (JSON)