Uni-LVC: A Unified Method for Intra- and Inter-Mode Learned Video Compression
Not on the map. Why?
Abstract (arXiv)
Recent advances in learned video compression (LVC) have led to significant performance gains, with codecs such as DCVC-RT surpassing the H.266/VVC low-delay mode in compression efficiency. However, existing LVCs still exhibit key limitations: they often require separate models for intra and inter coding modes, and their performance degrades when temporal references are unreliable. To address this, we introduce Uni-LVC, a unified LVC method that supports both intra and inter coding with low-delay and random-access in a single model. Building on a strong intra-codec, Uni-LVC formulates inter-coding as intra-coding conditioned on temporal information extracted from reference frames. We design an efficient cross-attention adaptation module that integrates temporal cues, enabling seamless support for both unidirectional (low-delay) and bidirectional (random-access) prediction modes. A reliability-aware classifier is proposed to selectively scale the temporal cues, making Uni-LVC behave closer to intra coding when references are unreliable. We further propose a multistage training strategy to facilitate adaptive learning across various coding modes. Extensive experiments demonstrate that Uni-LVC achieves superior rate-distortion performance in intra and inter configurations while maintaining comparable computational efficiency.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 66 of its 87 references that are in the map. First posted on arXiv 5 Mar 2026.
Builds on
66 of 87 references.
References · 66
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,194
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
- 2017Video Enhancement with Task-Oriented Flowcited by 612
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
- 2018DVC: An End-to-end Deep Video Compression Frameworkcited by 324
- 2024xLSTM: Extended Long Short-Term Memorycited by 320
- 2020Do Adversarially Robust ImageNet Models Transfer Better?cited by 315
38 more
- 2020CompressAI: a PyTorch library and evaluation platform for end-to-end compression researchcited by 271
- 2022Neighborhood Attention Transformercited by 235
- 2021Deep Contextual Video Compressioncited by 216
- 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 205
- 2020Nonlinear Transform Codingcited by 132
- 2022Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compressioncited by 123
- 2021Temporal Context Mining for Learned Video Compressioncited by 112
- 2020M-LVC: Multiple Frames Prediction for Learned Video Compressioncited by 106
- 2021Enhanced Invertible Encoding for Learned Image Compressioncited by 102
- 2021S2-MLP: Spatial-Shift MLP Architecture for Visioncited by 83
- 2023FAMO: Fast Adaptive Multitask Optimizationcited by 74
- 2025Towards Practical Real-Time Neural Video Compressioncited by 72
- 2021ELF-VC: Efficient Learned Flexible-Rate Video Codingcited by 68
- 2024Exponential Moving Average of Weights in Deep Learning: Dynamics and Benefitscited by 65
- 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compressioncited by 56
- 2023Frequency-Aware Transformer for Learned Image Compressioncited by 56
- 2022Coarse-to-fine Deep Video Coding with Hyperprior-guided Mode Predictioncited by 55
- 2024Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applicationscited by 49
- 2022Unified Multivariate Gaussian Mixture for Efficient Neural Image Compressioncited by 43
- 2022Contextformer: A Transformer with Spatio-Channel Attention for Context Modeling in Learned Image Compressioncited by 42
- 2023QARV: Quantization-Aware ResNet VAE for Lossy Image Compressioncited by 30
- 2025PolaFormer: Polarity-aware Linear Attention for Vision Transformerscited by 30
- 2025Learned Image Compression with Dictionary-based Entropy Modelcited by 29
- 2024MambaVC: Learned Visual Compression with Selective State Spacescited by 28
- 2021Towards Robust Neural Image Compression: Adversarial Attack and Model Finetuningcited by 24
- 2025Linear Attention Modeling for Learned Image Compressioncited by 22
- 2025Generative Latent Coding for Ultra-Low Bitrate Image and Video Compressioncited by 22
- 2024Bi-Directional Deep Contextual Video Compressioncited by 20
- 2025Learned Image Compression with Hierarchical Progressive Context Modelingcited by 20
- 2024PNVC: Towards Practical INR-based Video Compressioncited by 19
- 2024ECVC: Exploiting Non-Local Correlations in Multiple Frames for Contextual Video Compressioncited by 18
- 2025MambaIC: State Space Models for High-Performance Learned Image Compressioncited by 18
- 2025Neural Video Compression with Context Modulationcited by 15
- 2024BVI-AOM: A New Training Dataset for Deep Video Compression Optimizationcited by 12
- 2023QVRF: A Quantization-error-aware Variable Rate Framework for Learned Image Compressioncited by 11
- 2023MobileNVC: Real-time 1080p Neural Video Compression on a Mobile Devicecited by 11
- 2024LAVIB: A Large-scale Video Interpolation Benchmarkcited by 11
- 2024I2VC: A Unified Framework for Intra- & Inter-frame Video Compressioncited by 10
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.