mlsanityData to 7 Oct 2026

Regenerating Arbitrary Video Sequences with Distillation Path-Finding

arXiv 2311.07170 ↗First posted 13 Nov 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

If the video has long been mentioned as a widespread visualization form, the animation sequence in the video is mentioned as storytelling for people. Producing an animation requires intensive human labor from skilled professional artists to obtain plausible animation in both content and motion direction, incredibly for animations with complex content, multiple moving objects, and dense movement. This paper presents an interactive framework to generate new sequences according to the users' preference on the starting frame. The critical contrast of our approach versus prior work and existing commercial applications is that novel sequences with arbitrary starting frame are produced by our system with a consistent degree in both content and motion direction. To achieve this effectively, we first learn the feature correlation on the frameset of the given video through a proposed network called RSFNet. Then, we develop a novel path-finding algorithm, SDPF, which formulates the knowledge of motion directions of the source video to estimate the smooth and plausible sequences. The extensive experiments show that our framework can produce new animations on the cartoon and natural scenes and advance prior works and commercial applications to enable users to obtain more predictable results.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 35 references that are in the map. First posted on arXiv 13 Nov 2023.

Builds on

11 of 35 references.

References · 11

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  5. 2016Identity Mappings in Deep Residual Networkscited by 1,960
  6. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
  7. 2018Activation Functions: Comparison of trends in Practice and Research for Deep Learningcited by 130
  8. 2013Learning by Transductioncited by 120
  9. 2019Local Deep-Feature Alignment for Unsupervised Dimension Reductioncited by 12
  10. 2021Optical Flow Estimation via Motion Feature Recoverycited by 3
  11. 2021Learning a perceptual manifold with deep features for animation video resequencingcited by 1

Built on by

Not cited yet.