mlsanityData to 7 Oct 2026

Fast Encoding and Decoding for Implicit Video Representation

arXiv 2409.19429 ↗First posted 28 Sep 2024cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

Despite the abundant availability and content richness for video data, its high-dimensionality poses challenges for video research. Recent advancements have explored the implicit representation for videos using neural networks, demonstrating strong performance in applications such as video compression and enhancement. However, the prolonged encoding time remains a persistent challenge for video Implicit Neural Representations (INRs). In this paper, we focus on improving the speed of video encoding and decoding within implicit representations. We introduce two key components: NeRV-Enc, a transformer-based hyper-network for fast encoding; and NeRV-Dec, a parallel decoder for efficient video loading. NeRV-Enc achieves an impressive speed-up of 104× by eliminating gradient-based optimization. Meanwhile, NeRV-Dec simplifies video decoding, outperforming conventional codecs with a loading speed 11× faster, and surpassing RAM loading with pre-decoded videos (2.5× faster while being 65× smaller in size).

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 41 of its 51 references that are in the map. First posted on arXiv 28 Sep 2024.

Builds on

41 of 51 references.

References · 41

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2020End-to-End Object Detection with Transformerscited by 7,384
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  6. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  7. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  8. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  9. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  10. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  11. 2017The Kinetics Human Action Video Datasetcited by 1,894
  12. 2021Alias-Free Generative Adversarial Networkscited by 1,181
29 more
  1. 2017The "something something" video database for learning and evaluating visual common sensecited by 1,092
  2. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  3. 2016HyperNetworkscited by 1,003
  4. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  5. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  6. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
  7. 2022Masked Autoencoders As Spatiotemporal Learnerscited by 428
  8. 2019Dynamic Convolution: Attention over Convolution Kernelscited by 355
  9. 2019CondConv: Conditionally Parameterized Convolutions for Efficient Inferencecited by 273
  10. 2021NeRV: Neural Representations for Videoscited by 255
  11. 2021COIN: COmpression with Implicit Neural representationscited by 232
  12. 2018Video Compression through Image Interpolationcited by 143
  13. 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
  14. 2020Adversarial Generation of Continuous Imagescited by 135
  15. 2020Image Generators with Conditionally-Independent Pixel Synthesiscited by 105
  16. 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
  17. 2019Video Compression With Rate-Distortion Autoencoderscited by 97
  18. 2018Learned Video Compressioncited by 89
  19. 2022Transformers as Meta-Learners for Implicit Neural Representationscited by 79
  20. 2022E-NeRV: Expedite Neural Video Representation with Disentangled Spatial-Temporal Contextcited by 76
  21. 2021ELF-VC: Efficient Learned Flexible-Rate Video Codingcited by 68
  22. 2019A Multigrid Method for Efficiently Training Video Modelscited by 52
  23. 2020Conditional Entropy Coding for Efficient Video Compressioncited by 42
  24. 2022Generalizable Implicit Neural Representations via Instance Pattern Composerscited by 38
  25. 2023Towards Scalable Neural Representation for Diverse Videoscited by 37
  26. 2022Scalable Neural Video Representations with Learnable Positional Featurescited by 29
  27. 2021Efficient Video Compression via Content-Adaptive Super-Resolutioncited by 26
  28. 2022CNeRV: Content-adaptive Neural Representation for Visual Datacited by 21
  29. 2019Neural Video Compression using Spatio-Temporal Priorscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 6.

11 papers.

  1. 2025How to Design and Train Your Implicit Neural Representation for Video Compressioncited by 3
  2. 2025LIFT: Latent Implicit Functions for Task- and Data-Agnostic Encodingcited by 2
  3. 2025SIEDD: Shared-Implicit Encoder with Discrete Decoderscited by 1
  4. 2025NeRV360: Neural Representation for 360-Degree Videos with a Viewport Decodercited by 1
  5. 2026Implicit Neural Representation Facilitates Unified Universal Vision Encodingcited by 1
  6. 2026TeCoNeRV: Leveraging Temporal Coherence for Compressible Neural Representations for Videoscited by 1
  7. 2025NeRV-Diffusion: Diffuse Implicit Neural Representations for Video Synthesiscited by 0
  8. 2026HyperGS: Fast and Generalizable Gaussian Video Representationcited by 0
  9. 2026CoANeRV: Coordinate-Aware Token-Space Neural Video Representationcited by 0
  10. 2026PIC: Revisiting INR for Image Coding with Fast Encoding and Sub-Millisecond Decodingcited by 0
  11. 2026ScoutNeRV: Rapid Encoding of Grid-Based Video INRs via ScoutNetcited by 0