High-Frequency Enhanced Hybrid Neural Representation for Video Compression
Not on the map. Why?
Abstract (arXiv)
Neural Representations for Videos (NeRV) have simplified the video codec process and achieved swift decoding speeds by encoding video content into a neural network, presenting a promising solution for video compression. However, existing work overlooks the crucial issue that videos reconstructed by these methods lack high-frequency details. To address this problem, this paper introduces a High-Frequency Enhanced Hybrid Neural Representation Network. Our method focuses on leveraging high-frequency information to improve the synthesis of fine details by the network. Specifically, we design a wavelet high-frequency encoder that incorporates Wavelet Frequency Decomposer (WFD) blocks to generate high-frequency feature embeddings. Next, we design the High-Frequency Feature Modulation (HFM) block, which leverages the extracted high-frequency embeddings to enhance the fitting process of the decoder. Finally, with the refined Harmonic decoder block and a Dynamic Weighted Frequency Loss, we further reduce the potential loss of high-frequency information. Experiments on the Bunny and UVG datasets demonstrate that our method outperforms other methods, showing notable improvements in detail preservation and compression performance.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 32 of its 47 references that are in the map. First posted on arXiv 11 Nov 2024.
Builds on
32 of 47 references.
References · 32
- 2022A ConvNet for the 2020scited by 3,579
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
- 2018DVC: An End-to-end Deep Video Compression Frameworkcited by 332
- 2021NeRV: Neural Representations for Videoscited by 256
- 2021COIN: COmpression with Implicit Neural representationscited by 233
- 2021Deep Contextual Video Compressioncited by 221
- 2023WIRE: Wavelet Implicit Neural Representationscited by 220
20 more
- 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 206
- 2022Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Modelscited by 174
- 2021Implicit Neural Representations for Image Compressioncited by 162
- 2020Layer-adaptive sparsity for the Magnitude-based Pruningcited by 126
- 2022GARF: Gaussian Activated Radiance Fields for High Fidelity Reconstruction and Pose Estimationcited by 86
- 2022COIN++: Neural Compression Across Modalitiescited by 82
- 2022E-NeRV: Expedite Neural Video Representation with Disentangled Spatial-Temporal Contextcited by 76
- 2021Implicit Neural Video Compressioncited by 52
- 2022FFNeRV: Flow-Guided Frame-Wise Neural Representations for Videoscited by 46
- 2024IRSAM: Advancing Segment Anything Model for Infrared Small Target Detectioncited by 46
- 2021WaveFill: A Wavelet-based Generation Network for Image Inpaintingcited by 44
- 2023DNeRV: Modeling Inherent Dynamics via Difference Neural Representation for Videoscited by 42
- 2021On the Out-of-distribution Generalization of Probabilistic Image Modellingcited by 33
- 2022PS-NeRV: Patch-wise Stylized Neural Representations for Videoscited by 32
- 2024Boosting Neural Representations for Videos with a Conditional Decodercited by 29
- 2022WaveGAN: Frequency-aware GAN for High-Fidelity Few-shot Image Generationcited by 22
- 2022Neural Residual Flow Fields for Efficient Video Representationscited by 16
- 2022FreGAN: Exploiting Frequency Components for Training GANs under Limited Datacited by 16
- 2023Implicit-explicit Integrated Representations for Multi-view Video Compressioncited by 8
- 2023Improved Positional Encoding for Implicit Neural Representation based Compact Data Representationcited by 4
Built on by
Citing papers per year: 2025: 2.
2 papers.