mlsanityData to 7 Oct 2026

Extending Neural P-frame Codecs for B-frame Coding

arXiv 2104.00531 ↗First posted 30 Mar 2021eess.IV cs.CV cs.LGcited by 30

Not on the map. Why?

Abstract (arXiv)

While most neural video codecs address P-frame coding (predicting each frame from past ones), in this paper we address B-frame compression (predicting frames using both past and future reference frames). Our B-frame solution is based on the existing P-frame methods. As a result, B-frame coding capability can easily be added to an existing neural codec. The basic idea of our B-frame coding method is to interpolate the two reference frames to generate a single reference frame and then use it together with an existing P-frame codec to encode the input B-frame. Our studies show that the interpolated frame is a much better reference for the P-frame codec compared to using the previous frame as is usually done. Our results show that using the proposed method with an existing P-frame codec can lead to 28.5%saving in bit-rate on the UVG dataset compared to the P-frame codec while generating the same video quality.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 31 of its 48 references that are in the map. First posted on arXiv 30 Mar 2021.

Builds on

31 of 48 references.

References · 31

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
  4. 2018Variational image compression with a scale hyperpriorcited by 910
  5. 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
  6. 2017Video Enhancement with Task-Oriented Flowcited by 612
  7. 2018DVC: An End-to-end Deep Video Compression Frameworkcited by 324
  8. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
  9. 2020Channel-wise Autoregressive Entropy Models for Learned Image Compressioncited by 255
  10. 2016Full Resolution Image Compression with Recurrent Neural Networkscited by 170
  11. 2015Variable Rate Image Compression with Recurrent Neural Networkscited by 168
  12. 2017Soft-to-Hard Vector Quantization for End-to-End Learning Compressible Representationscited by 149
19 more
  1. 2018Video Compression through Image Interpolationcited by 143
  2. 2019Quadratic video interpolationcited by 143
  3. 2018Conditional Probability Models for Deep Image Compressioncited by 128
  4. 2017Real-Time Adaptive Image Compressioncited by 127
  5. 2015Density Modeling of Images using a Generalized Normalization Transformationcited by 123
  6. 2019Variable Rate Deep Image Compression With a Conditional Autoencodercited by 109
  7. 2020M-LVC: Multiple Frames Prediction for Learned Video Compressioncited by 106
  8. 2019Video Compression With Rate-Distortion Autoencoderscited by 97
  9. 2018Learned Video Compressioncited by 89
  10. 2019Non-local Attention Optimized Deep Image Compressioncited by 86
  11. 2016End-to-end optimization of nonlinear transform codes for perceptual qualitycited by 72
  12. 2020Neural Video Coding using Multiscale Motion Compensation and Spatiotemporal Context Modelcited by 38
  13. 2020Feedback Recurrent Autoencoder for Video Compressioncited by 30
  14. 2019Learned Video Compression via Joint Spatial-Temporal Correlation Explorationcited by 28
  15. 2020Hierarchical Autoregressive Modeling for Neural Video Compressioncited by 28
  16. 2019Learning Image and Video Compression through Spatial-Temporal Energy Compactioncited by 26
  17. 2021Progressive Neural Image Compression with Nested Quantization and Latent Orderingcited by 24
  18. 2018Deep Generative Video Compressioncited by 23
  19. 2020Learning to Compress Videos without Computing Motioncited by 7

Built on by

Cited by year

Citing papers per year: 2021: 4; 2022: 10; 2023: 5; 2024: 5; 2025: 6.

30 papers.

Sort:

By area:

  1. 2023HiNeRV: Video Compression with Hierarchical Encoding-based Neural Representationcited by 70
  2. 2021Implicit Neural Video Compressioncited by 52
  3. 2022AlphaVC: High-Performance and Efficient Learned Video Compressioncited by 28
  4. 2021Instance-Adaptive Video Compression: Improving Neural Codecs by Training on the Test Setcited by 18
  5. 2022B-CANF: Adaptive B-frame Coding with Conditional Augmented Normalizing Flowscited by 18
  6. 2022MobileCodec: Neural Inter-frame Video Compression on Mobile Devicescited by 15
  7. 2023Hierarchical B-frame Video Coding Using Two-Layer CANF without Motion Codingcited by 14
  8. 2021Learning Cross-Scale Weighted Prediction for Efficient Neural Video Compressioncited by 12
  9. 2022Neighbor Correspondence Matching for Flow-based Video Frame Synthesiscited by 12
  10. 2023IBVC: Interpolation-driven B-frame Video Compressioncited by 12
  11. 2025BiECVC: Gated Diversification of Bidirectional Contexts for Learned Video Compressioncited by 8
  12. 2021Versatile Learned Video Compressioncited by 7
18 more
  1. 2022JNMR: Joint Non-linear Motion Regression for Video Frame Interpolationcited by 7
  2. 2023High Visual-Fidelity Learned Video Compressioncited by 7
  3. 2022Boosting neural video codecs by exploiting hierarchical redundancycited by 5
  4. 2025Semantic-Aware Adaptive Video Streaming Using Latent Diffusion Models for Wireless Networkscited by 4
  5. 2022Non-linear Motion Estimation for Video Frame Interpolation using Space-time Convolutionscited by 3
  6. 2024NU-Class Net: A Novel Approach for Video Quality Enhancementcited by 3
  7. 2025L-LBVC: Long-Term Motion Estimation and Prediction for Learned Bi-Directional Video Compressioncited by 3
  8. 2022Region-of-Interest Based Neural Video Compressioncited by 2
  9. 2022Reducing The Mismatch Between Marginal and Learned Distributions in Neural Video Compressioncited by 2
  10. 2023Neural Video Compression with Temporal Layer-Adaptive Hierarchical B-frame Codingcited by 2
  11. 2024Low-Latency Neural Stereo Streamingcited by 2
  12. 2024Survey on Visual Signal Coding and Processing with Generative Models: Technologies, Standards and Optimizationcited by 2
  13. 2025Fine-Grained Motion Compression and Selective Temporal Fusion for Neural B-Frame Video Codingcited by 2
  14. 2024Motion Free B-frame Coding for Neural Video Compressioncited by 1
  15. 2022Learned Hierarchical B-frame Coding with Adaptive Feature Modulation for YUV 4:2:0 Contentcited by 0
  16. 2024Neural-based Video Compression on Solar Dynamics Observatory Imagescited by 0
  17. 2025Exploiting Latent Properties to Optimize Neural Codecscited by 0
  18. 2025Neural B-Frame Coding: Tackling Domain Shift Issues with Lightweight Online Motion Resolution Adaptationcited by 0