ANVIL: Accelerator-Native Video Interpolation via Codec Motion Vector Priors
Not on the map. Why?
Abstract (arXiv)
Real-time 30-to-60 fps video frame interpolation on mobile neural processing units (NPUs) requires each synthesized frame within 33.3 ms. We show that mainstream flow-based video frame interpolation faces three structural deployment barriers on mobile NPUs: spatial sampling operators exceed the frame budget or lack hardware support, iterative flow refinement collapses under 8-bit integer post-training quantization, and memory-bound operators dominate the inference graph. ANVIL addresses these barriers by reusing motion vectors from the H.264/AVC decoder to prealign input frames, removing learned optical flow, spatial sampling, and iterative accumulation from the accelerator graph. The remaining residual is refined by a convolution-dominated network composed almost entirely of compute-bound operators. On a Snapdragon 8 Gen 3 device, ANVIL achieves 12.8 ms 1080p inference at 8-bit integer precision; an open-source Android player sustains 28.4 ms median end-to-end latency over 30-minute continuous playback. Per-operator causal analysis identifies quantized accumulation on recurrent flow states as a key mechanism behind integer quantization failure in iterative methods. The current design targets H.264/AVC playback with decoder-exposed motion vectors.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 45 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
28 of 45 references.
References · 28
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
- 2015Spatial Transformer Networkscited by 1,423
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 798
- 2022Simple Baselines for Image Restorationcited by 701
- 2017Video Enhancement with Task-Oriented Flowcited by 612
- 2021A White Paper on Neural Network Quantizationcited by 453
- 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
- 2019Depth-Aware Video Frame Interpolationcited by 232
16 more
- 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 211
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
- 2023EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attentioncited by 172
- 2022RepQ-ViT: Scale Reparameterization for Post-Training Quantization of Vision Transformerscited by 134
- 2022MobileOne: An Improved One millisecond Mobile Backbonecited by 109
- 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 107
- 2017Compressed Video Action Recognitioncited by 102
- 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
- 2020FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolationcited by 97
- 2024Fast On-device LLM Inference with NPUscited by 58
- 2021CDFI: Compression-Driven Network Design for Frame Interpolationcited by 55
- 2022A Unified Pyramid Recurrent Network for Video Frame Interpolationcited by 39
- 2018Deep Frame Prediction for Video Codingcited by 13
- 2023MobileNVC: Real-time 1080p Neural Video Compression on a Mobile Devicecited by 11
- 2023MVFlow: Deep Optical Flow Estimation of Compressed Videos with Motion Vector Priorcited by 7
- 2022A Codec Information Assisted Framework for Efficient Compressed Video Super-Resolutioncited by 6
Built on by
Not cited yet.