Video Compression through Image Interpolation
Not on the map. Why?
Abstract (arXiv)
An ever increasing amount of our digital communication, media consumption, and content creation revolves around videos. We share, watch, and archive many aspects of our lives through them, all of which are powered by strong video compression. Traditional video compression is laboriously hand designed and hand optimized. This paper presents an alternative in an end-to-end deep learning codec. Our codec builds on one simple idea: Video compression is repeated image interpolation. It thus benefits from recent advances in deep image interpolation and generation. Our deep video codec outperforms today's prevailing codecs, such as H.261, MPEG-4 Part 2, and performs on par with H.264.
Key facts. Cited by 143 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 28; 2022: 42; 2023: 24; 2024: 25; 2025: 15; 2026: 8.
143 papers.
Sort:
By area:
- 2021NeRV: Neural Representations for Videoscited by 256
- 2021Deep Contextual Video Compressioncited by 221
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 175
- 2023Neural Video Compression with Diverse Contextscited by 165
- 2021FVC: A New Framework towards Deep Video Compression in Feature Spacecited by 153
- 2021TimeLens: Event-based Video Frame Interpolationcited by 151
- 2022Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compressioncited by 128
- 2021Temporal Context Mining for Learned Video Compressioncited by 117
- 2023HNeRV: A Hybrid Neural Representation for Videoscited by 100
- 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 98
- 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 89
38 more
- 2022An Introduction to Neural Data Compressioncited by 79
- 2022VCT: A Video Compression Transformercited by 74
- 2021ELF-VC: Efficient Learned Flexible-Rate Video Codingcited by 69
- 2021VoxelContext-Net: An Octree based Framework for Point Cloud Compressioncited by 61
- 2022Coarse-to-fine Deep Video Coding with Hyperprior-guided Mode Predictioncited by 55
- 2021Implicit Neural Video Compressioncited by 52
- 2021DeepWiVe: Deep-Learning-Aided Wireless Video Transmissioncited by 45
- 2022Many-to-many Splatting for Efficient Video Frame Interpolationcited by 42
- 2021Perceptual Learned Video Compression with Recurrent Conditional GANcited by 41
- 2021Overfitting for Fun and Profit: Instance-Adaptive Data Compressioncited by 38
- 2022FloLPIPS: A Bespoke Video Quality Metric for Frame Interpoationcited by 37
- 2023Towards Scalable Neural Representation for Diverse Videoscited by 37
- 2021Neural Video Compression using GANs for Detail Synthesis and Propagationcited by 36
- 2021ST-MFNet: A Spatio-Temporal Multi-Flow Network for Frame Interpolationcited by 35
- 2023A Residual Diffusion Model for High Perceptual Quality Codec Augmentationcited by 35
- 2022PS-NeRV: Patch-wise Stylized Neural Representations for Videoscited by 32
- 2021Extending Neural P-frame Codecs for B-frame Codingcited by 30
- 2024Sparse Global Matching for Video Frame Interpolation with Large Motioncited by 28
- 2023A Unified Framework for Event-based Frame Interpolation with Ad-hoc Deblurring in the Wildcited by 27
- 2021Efficient Video Compression via Content-Adaptive Super-Resolutioncited by 26
- 2024DS-NeRV: Implicit Neural Video Representation with Decomposed Static and Dynamic Codescited by 25
- 2022Imposing Consistency for Optical Flow Estimationcited by 24
- 2023BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolationcited by 23
- 2024Spatial Decomposition and Temporal Fusion based Inter Prediction for Learned Video Compressioncited by 23
- 2022CNeRV: Content-adaptive Neural Representation for Visual Datacited by 21
- 2022Splatting-based Synthesis for Video Frame Interpolationcited by 20
- 2024Bi-Directional Deep Contextual Video Compressioncited by 20
- 2022MobileCodec: Neural Inter-frame Video Compression on Mobile Devicescited by 19
- 2024Frame Interpolation with Consecutive Brownian Bridge Diffusioncited by 19
- 2025EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolationcited by 19
- 2021Instance-Adaptive Video Compression: Improving Neural Codecs by Training on the Test Setcited by 18
- 2022B-CANF: Adaptive B-frame Coding with Conditional Augmented Normalizing Flowscited by 18
- 2022A Coding Framework and Benchmark towards Low-Bitrate Video Understandingcited by 17
- 2024Generalizable Implicit Motion Modeling for Video Frame Interpolationcited by 16
- 2022SC2 Benchmark: Supervised Compression for Split Computingcited by 15
- 2022A Perceptual Quality Metric for Video Frame Interpolationcited by 15
- 2022TTVFI: Learning Trajectory-Aware Transformer for Video Frame Interpolationcited by 14
- 2022Advancing Learned Video Compression with In-loop Frame Predictioncited by 14
50 most cited of 143 All 143 (JSON)
- 2026Accurate Motion Estimation with B'ezier Control Point for Efficient Frame Interpolation20 Sep 2026
- 2026Multiple Hypothesis Flow Estimation for Video Frame Interpolation under Matching Ambiguity7 Aug 2026
- 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation17 Jul 2026
- 2026MASS: Motion-Aligned Selective Scan for Refinement in Flow-Based Video Frame Interpolation26 Jun 2026
- 2026Active Sampling for Ultra-Low-Bit-Rate Video Compression via Conditional Controlled Diffusion4 May 2026
- 2026Efficient Video Diffusion with Sparse Information Transmission for Video Compression19 Mar 2026
- 2026Attend Before Attention: Efficient and Scalable Video Understanding via Autoregressive Gazing12 Mar 2026
- 2026N4MC: Neural 4D Mesh Compression23 Feb 2026
- 2025Neural B-frame Video Compression with Bi-directional Reference Harmonization12 Nov 2025
- 2025TLB-VFI: Temporal-Aware Latent Brownian Bridge Diffusion for Video Frame Interpolation7 Jul 2025
- 2025Fine-Grained Motion Compression and Selective Temporal Fusion for Neural B-Frame Video Coding9 Jun 2025
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation1 Jun 2025
38 more
- 2025Improving Optical Flow and Stereo Depth Estimation by Leveraging Uncertainty-Based Learning Difficulties31 May 2025
- 2025GANCompress: GAN-Enhanced Neural Image Compression with Binary Spherical Quantization19 May 2025
- 2025BiECVC: Gated Diversification of Bidirectional Contexts for Learned Video Compression14 May 2025
- 2025Neural Stereo Video Compression with Hybrid Disparity Compensation29 Apr 2025
- 2025L-LBVC: Long-Term Motion Estimation and Prediction for Learned Bi-Directional Video Compression3 Apr 2025
- 2025Hierarchical Flow Diffusion for Efficient Frame Interpolation1 Apr 2025
- 2025EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolation20 Mar 2025
- 2025Residual Learning and Filtering Networks for End-to-End Lossless Video Compression11 Mar 2025
- 2025UAR-NVC: A Unified AutoRegressive Framework for Memory-Efficient Neural Video Compression4 Mar 2025
- 2025CANeRV: Content Adaptive Neural Representation for Video Compression10 Feb 2025
- 2025MetaNeRV: Meta Neural Representations for Videos with Spatial-Temporal Guidance5 Jan 2025
- 2024FlexCache: Flexible Approximate Cache System for Video Diffusion18 Dec 2024
- 2024Motion Free B-frame Coding for Neural Video Compression26 Nov 2024
- 2024EPS: Efficient Patch Sampling for Video Overfitting in Deep Super-Resolution Model Training25 Nov 2024
- 2024Fast-OMRA: Fast Online Motion Resolution Adaptation for Neural B-Frame Coding29 Oct 2024
- 2024Fast Encoding and Decoding for Implicit Video Representation28 Sep 2024
- 2024Bi-Directional Deep Contextual Video Compression16 Aug 2024
- 2024NVC-1B: A Large Neural Video Coding Model28 Jul 2024
- 2024Neural-based Video Compression on Solar Dynamics Observatory Images12 Jul 2024
- 2024Generalizable Implicit Motion Modeling for Video Frame Interpolation11 Jul 2024
- 2024PNeRV: A Polynomial Neural Representation for Videos27 Jun 2024
- 2024Disentangled Motion Modeling for Video Frame Interpolation25 Jun 2024
- 2024Prediction and Reference Quality Adaptation for Learned Video Compression20 Jun 2024
- 2024Survey on Visual Signal Coding and Processing with Generative Models: Technologies, Standards and Optimization23 May 2024
- 2024Frame Interpolation with Consecutive Brownian Bridge Diffusion9 May 2024
- 2024Event-based Video Frame Interpolation with Edge Guided Motion Refinement28 Apr 2024
- 2024Motion-aware Latent Diffusion Models for Video Frame Interpolation21 Apr 2024
- 2024LADDER: An Efficient Framework for Video Frame Interpolation17 Apr 2024
- 2024SciFlow: Empowering Lightweight Optical Flow Models with Self-Cleaning Iterations11 Apr 2024
- 2024Sparse Global Matching for Video Frame Interpolation with Large Motion10 Apr 2024
- 2024OCAI: Improving Optical Flow Estimation by Occlusion and Consistency Aware Interpolation26 Mar 2024
- 2024Low-Latency Neural Stereo Streaming26 Mar 2024
- 2024Benchmarking Video Frame Interpolation25 Mar 2024
- 2024DS-NeRV: Implicit Neural Video Representation with Decomposed Static and Dynamic Codes23 Mar 2024
- 2024UCVC: A Unified Contextual Video Compression Framework with Joint P-frame and B-frame Coding2 Feb 2024
- 2024Spatial Decomposition and Temporal Fusion based Inter Prediction for Learned Video Compression29 Jan 2024
- 2023Velocity Disambiguation for Video Frame Interpolation14 Nov 2023
- 2023Blurry Video Compression: A Trade-off between Visual Enhancement and Data Compression8 Nov 2023
50 newest of 143 All 143 (JSON)
- 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 89
- 2023A Residual Diffusion Model for High Perceptual Quality Codec Augmentationcited by 35
- 2025EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolationcited by 19
- 2024Motion-aware Latent Diffusion Models for Video Frame Interpolationcited by 14
- 2025Hierarchical Flow Diffusion for Efficient Frame Interpolationcited by 7
- 2025TLB-VFI: Temporal-Aware Latent Brownian Bridge Diffusion for Video Frame Interpolationcited by 7
- 2024FlexCache: Flexible Approximate Cache System for Video Diffusioncited by 5
- 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolationcited by 2
- 2026Efficient Video Diffusion with Sparse Information Transmission for Video Compressioncited by 1
- 2026Active Sampling for Ultra-Low-Bit-Rate Video Compression via Conditional Controlled Diffusioncited by 0
- 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation17 Jul 2026
- 2026Active Sampling for Ultra-Low-Bit-Rate Video Compression via Conditional Controlled Diffusion4 May 2026
- 2026Efficient Video Diffusion with Sparse Information Transmission for Video Compression19 Mar 2026
- 2025TLB-VFI: Temporal-Aware Latent Brownian Bridge Diffusion for Video Frame Interpolation7 Jul 2025
- 2025Hierarchical Flow Diffusion for Efficient Frame Interpolation1 Apr 2025
- 2025EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolation20 Mar 2025
- 2024FlexCache: Flexible Approximate Cache System for Video Diffusion18 Dec 2024
- 2024Motion-aware Latent Diffusion Models for Video Frame Interpolation21 Apr 2024
- 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Models16 Mar 2023
- 2023A Residual Diffusion Model for High Perceptual Quality Codec Augmentation13 Jan 2023
- 2021NeRV: Neural Representations for Videoscited by 256
- 2021Deep Contextual Video Compressioncited by 221
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 175
- 2023Neural Video Compression with Diverse Contextscited by 165
- 2021FVC: A New Framework towards Deep Video Compression in Feature Spacecited by 153
- 2021TimeLens: Event-based Video Frame Interpolationcited by 151
- 2022Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compressioncited by 128
- 2021Temporal Context Mining for Learned Video Compressioncited by 117
- 2023HNeRV: A Hybrid Neural Representation for Videoscited by 100
- 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 98
- 2022An Introduction to Neural Data Compressioncited by 79
12 most cited of 131 All 131 (JSON)
- 2026Accurate Motion Estimation with B'ezier Control Point for Efficient Frame Interpolation20 Sep 2026
- 2026Multiple Hypothesis Flow Estimation for Video Frame Interpolation under Matching Ambiguity7 Aug 2026
- 2026MASS: Motion-Aligned Selective Scan for Refinement in Flow-Based Video Frame Interpolation26 Jun 2026
- 2026N4MC: Neural 4D Mesh Compression23 Feb 2026
- 2025Neural B-frame Video Compression with Bi-directional Reference Harmonization12 Nov 2025
- 2025Fine-Grained Motion Compression and Selective Temporal Fusion for Neural B-Frame Video Coding9 Jun 2025
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation1 Jun 2025
- 2025Improving Optical Flow and Stereo Depth Estimation by Leveraging Uncertainty-Based Learning Difficulties31 May 2025
- 2025GANCompress: GAN-Enhanced Neural Image Compression with Binary Spherical Quantization19 May 2025
- 2025BiECVC: Gated Diversification of Bidirectional Contexts for Learned Video Compression14 May 2025
- 2025Neural Stereo Video Compression with Hybrid Disparity Compensation29 Apr 2025
- 2025L-LBVC: Long-Term Motion Estimation and Prediction for Learned Bi-Directional Video Compression3 Apr 2025
12 newest of 131 All 131 (JSON)