MLVC: Multi-platform Learned Video Codec for Real-World Deployment
Not on the map. Why?
Abstract (arXiv)
Neural video codecs have surpassed classical codecs in coding efficiency but remain impractical for deployment due to cross-platform incompatibility and high computational cost. Existing quantization-based solutions fail to produce deterministic results across diverse hardware platforms, leading to catastrophic decoding failures. We introduce MLVC, a hardware-robust neural video codec designed for practical cross-platform inference. The key idea is to explicitly transmit scale parameters through the hyperprior, which guarantees entropy coding consistency across devices without requiring bit-exact arithmetic. While this increases bitrate overhead, we recover most of the coding efficiency through architectural improvements (gated memory, ReGLU activation), a long-term reference recovery mechanism, and domain-specific perceptual training. On the VCD video conferencing benchmark, MLVC achieves >70% BD-rate (MOS) improvement over hardware HEVC, the strongest deployable baseline, while reaching subjective quality competitive with DCVC-RT, which cannot operate across diverse platforms. Both the encoder and decoder run at 100 FPS on average on commodity NPUs from Apple, Intel, and Qualcomm. MLVC is the first neural video codec to combine competitive compression performance, real-time speed, and cross-platform robustness across diverse consumer devices, making it suitable for widespread deployment. Code is available at https://github.com/microsoft/mlvc.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 37 of its 51 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
37 of 51 references.
References · 37
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020GLU Variants Improve Transformercited by 1,724
- 2018Variational image compression with a scale hyperpriorcited by 910
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
- 2017Video Enhancement with Task-Oriented Flowcited by 612
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
- 2020High-Fidelity Generative Image Compressioncited by 331
- 2018DVC: An End-to-end Deep Video Compression Frameworkcited by 324
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
- 2020Channel-wise Autoregressive Entropy Models for Learned Image Compressioncited by 255
- 2021Deep Contextual Video Compressioncited by 216
- 2018Generative Adversarial Networks for Extreme Learned Image Compressioncited by 213
25 more
- 2021Checkerboard Context Model for Efficient Learned Image Compressioncited by 193
- 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 193
- 2023Neural Video Compression with Diverse Contextscited by 155
- 2021FVC: A New Framework towards Deep Video Compression in Feature Spacecited by 149
- 2022Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compressioncited by 123
- 2024Neural Video Compression with Feature Modulationcited by 115
- 2021Temporal Context Mining for Learned Video Compressioncited by 112
- 2020M-LVC: Multiple Frames Prediction for Learned Video Compressioncited by 106
- 2020Learning for Video Compression with Hierarchical Quality and Recurrent Enhancementcited by 90
- 2025Towards Practical Real-Time Neural Video Compressioncited by 72
- 2023C3: High-performance and low-complexity neural compression from a single image or videocited by 54
- 2021Neural Video Compression using GANs for Detail Synthesis and Propagationcited by 35
- 2022AlphaVC: High-Performance and Efficient Learned Video Compressioncited by 28
- 2022MobileCodec: Neural Inter-frame Video Compression on Mobile Devicescited by 15
- 2022Post-Training Quantization for Cross-Platform Learned Image Compressioncited by 12
- 2023MobileNVC: Real-time 1080p Neural Video Compression on a Mobile Devicecited by 11
- 2024Cool-chic video: Learned video coding with 800 parameterscited by 11
- 2023Towards Real-Time Neural Video Codec for Cross-Platform Application Using Calibration Informationcited by 9
- 2022A crowdsourcing approach to video quality assessmentcited by 8
- 2022Device Interoperability for Learned Image Compression with Weights and Activations Quantizationcited by 8
- 2023VCD: A Video Conferencing Dataset for Video Compressioncited by 8
- 2025Generative Latent Video Compressioncited by 8
- 2023Quantized Decoder in Learned Image Compression for Deterministic Reconstructioncited by 3
- 2024TLIC: Learned Image Compression with ROI-Weighted Distortion and Bit Allocationcited by 2
- 2023Effortless Cross-Platform Video Codec: A Codebook-Based Methodcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.