mlsanityData to 7 Oct 2026

ANVIL: Accelerator-Native Video Interpolation via Codec Motion Vector Priors

arXiv 2603.26835 ↗First posted 27 Mar 2026eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Real-time 30-to-60 fps video frame interpolation on mobile neural processing units (NPUs) requires each synthesized frame within 33.3 ms. We show that mainstream flow-based video frame interpolation faces three structural deployment barriers on mobile NPUs: spatial sampling operators exceed the frame budget or lack hardware support, iterative flow refinement collapses under 8-bit integer post-training quantization, and memory-bound operators dominate the inference graph. ANVIL addresses these barriers by reusing motion vectors from the H.264/AVC decoder to prealign input frames, removing learned optical flow, spatial sampling, and iterative accumulation from the accelerator graph. The remaining residual is refined by a convolution-dominated network composed almost entirely of compute-bound operators. On a Snapdragon 8 Gen 3 device, ANVIL achieves 12.8 ms 1080p inference at 8-bit integer precision; an open-source Android player sustains 28.4 ms median end-to-end latency over 30-minute continuous playback. Per-operator causal analysis identifies quantized accumulation on recurrent flow states as a key mechanism behind integer quantization failure in iterative methods. The current design targets H.264/AVC playback with decoder-exposed motion vectors.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 45 references that are in the map. First posted on arXiv 27 Mar 2026.

Builds on

28 of 45 references.

References · 28

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  5. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
  6. 2015Spatial Transformer Networkscited by 1,423
  7. 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 798
  8. 2022Simple Baselines for Image Restorationcited by 701
  9. 2017Video Enhancement with Task-Oriented Flowcited by 612
  10. 2021A White Paper on Neural Network Quantizationcited by 453
  11. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
  12. 2019Depth-Aware Video Frame Interpolationcited by 232
16 more
  1. 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 211
  2. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
  3. 2023EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attentioncited by 172
  4. 2022RepQ-ViT: Scale Reparameterization for Post-Training Quantization of Vision Transformerscited by 134
  5. 2022MobileOne: An Improved One millisecond Mobile Backbonecited by 109
  6. 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 107
  7. 2017Compressed Video Action Recognitioncited by 102
  8. 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
  9. 2020FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolationcited by 97
  10. 2024Fast On-device LLM Inference with NPUscited by 58
  11. 2021CDFI: Compression-Driven Network Design for Frame Interpolationcited by 55
  12. 2022A Unified Pyramid Recurrent Network for Video Frame Interpolationcited by 39
  13. 2018Deep Frame Prediction for Video Codingcited by 13
  14. 2023MobileNVC: Real-time 1080p Neural Video Compression on a Mobile Devicecited by 11
  15. 2023MVFlow: Deep Optical Flow Estimation of Compressed Videos with Motion Vector Priorcited by 7
  16. 2022A Codec Information Assisted Framework for Efficient Compressed Video Super-Resolutioncited by 6

Built on by

Not cited yet.